Ralph
RRunPod
•Created by Ralph on 4/8/2024 in #⚡｜serverless
Serverless can take several minutes to initualise...?
Should this be the case? An on-demand H100 is pointless to our business if I have to wait 30 seconds on average for it to start up and sometimes several minutes.
13 replies
Pods shutting down
Is it normal behaviour for a GPU cloud pod that is paid to be on 24/7 to require a cold boot every time it hasn't been used for a while? We have been paying for a GPU to be on all the time so it is quick to respond when we do demos of our software and it's always slow because the pod has to boot up
7 replies