R
RunPod2mo ago
prongs

Job delay

Hello, I have been seeing an increase in delay time while workers boot up, even while using Flashboot. I am using 1.5.3 which seems to have improved it a bit but not significantly. Having said that, is there an API that can be called to boot up the worker if there is an incoming request in let's say 5 seconds. This would ensure that the worker is warm and ready when it arrives. Does idle timeout perform a similar function?
2 Replies
nerdylive
nerdylive2mo ago
i don't think idle timout means what you explained there, its more like for the idle time that worker stays up after a job is completed in that worker
yhlong00000
yhlong000002mo ago
Idle timeout cold help reduce the number of cold start, also you can try to upgrade sdk to 1.7.4
Want results from more Discord servers?
Add your server