Warming up workers
Hi. I've been noticing some substantial delay times and I'd like to know if there's a built-in tool in RunPod that lets me "warm up" my workers before the user will use it.
I'm aware of idle timeout which can help in some situations, but if possible I'd like to keep costs to a minimum.
If there's not a "built-in" solution to this, then I can just implement a warm-up logic myself. I just wanted to check this first, since I'm running faster-whisper models and sometimes I can have more than 10s of delay time, which is too much.
2 Replies
There is no built in way to warm-up a worker, unless you use something like active workers.
Gotcha. Many thanks!