R
RunPod5d ago
zeeb0t

Queue waiting 5+ minutes with dozens of idle workers

Lately I am often finding that the queue is sitting there with items that have been queued over 5 minutes, meanwhile there are dozens of idle workers. Why are the workers not picking up the queued items immediately? My application is in production and this delay on requests for seemingly no reason is not really acceptable. Thanks
2 Replies
zeeb0t
zeeb0tOP5d ago
Btw, what I have done for now is set the idle timeout higher (was 5 seconds, now 120 seconds) so that once a worker comes to life, it sticks around longer for more work. This has drastically helped manage the queue. It seems the delays may be related to the startup time - although I do have fast start enabled.
yhlong00000
yhlong000004d ago
Have you seen a worker in the running state not working on requests, or all workers showing as idle while requests are in the queue?

Did you find this page helpful?