Howard Chu writes:I think we need to have separate queues per worker thread. The frontend can operate in single-producer mode where only the single listener thread is allowed to submit jobs into the pool. The workers can just access their own individual work queues, thus significantly reducing mutex contention.
Won't otherwise-fast requests then be stuck waiting behind the occational slow request? In our server I'm more concerned with worst- case times than the average time.