MaxHager
RRunPod
•Created by MaxHager on 8/10/2024 in #⚡｜serverless
Confusion with IDLE time
I have a serverless endpoint deployed with an idle timeout of 5 seconds. I expect that after 5 seconds, if I send a new request, the Docker image is downloaded again. Instead, the idle timeout is much longer. Even after minutes pass following sending a request again, the Docker image is already loaded, resulting in a very quick response which is good but i dont understand.
19 replies