Why are requests waiting even with free workers?
I’m running a serverless setup and noticed something weird. When multiple requests come in at the same time, some of them end up waiting, even though there are available workers to handle them
Does anyone know why this might be happening? I’m using this kind of scaling strategy
Would appreciate any insights or suggestions!
5 Replies
is it the cold start time probably?
That's exactly right—cold start workers were being selected. It seems that in such cases, the system prefers to wait for active workers to become available rather than immediately starting new ones...
Is there any way to force the system to spin up workers immediately in such scenarios?
Oh really?
@sandwich
Escalated To Zendesk
The thread has been escalated to Zendesk!
Maybe that shouldn't happen? How long does it wait for