idle time duration
Hi, i am running a comfyui script on serverless endpoint. I have set the idle timeout to 5 seconds but the first worker keeps running up to 7 minutes after the last request got executed. Could you explain why it's keeping running for such a long time? (ywzdlqxw0yg6ec)
5 Replies
Got the same issue
With serverless vLLM (i set the idle 1sec)
I got the anwser, it's certainly because you activated Active Workers.
It's 40% cheaper but run always
I didn’t set a active worker
So like the request is returned and then still running?
yes all requests get completed - for example i have 4 workers - 3 get shut down after a couple of seconds but the last one runs for several minutes
Hmm weird, does the one have different task?
Or it is the same for every task