R
RunPod8mo ago
Rodka

Question on Flash Boot

Hello. I'm aware Flash Boot is more or less a "caching system" that keeps a worker on stand-by for some time, preventing large delay times. For example, my first request of the day takes from 8s to 15s of delay time, and subsequent requests have much faster delay times even with 5s idle timeout -- which I guess comes from the flash boot being enabled. I know that Flash Boot will stop working after an X amount of time has passed with no requests in the "cached worker"; in this case my new request after this X amount of time will take the "8s to 15s" delay time. My question is, what exactly is this "X"amount of time? Is it an exact value?
2 Replies
nerdylive
nerdylive8mo ago
No it's random But also be affected by your max workers
Rodka
RodkaOP8mo ago
Gotcha. Thanks.
Want results from more Discord servers?
Add your server