Serverless can take several minutes to initualise...?
Should this be the case? An on-demand H100 is pointless to our business if I have to wait 30 seconds on average for it to start up and sometimes several minutes.
9 Replies
Hi what template do you use?
I have attached screenshots
oh and 30 seconds~ in cold starts?
@Ralph are you able to provide your pod ID?
Its serverless, no pod id
Probably need endpoint id
Ah wait yeah, endpoint ID, sorry
td0ztman6jeou9
It could well be user error by me. When we first tried serverless it was taking 10-20 seconds from a cold boot to start working
hmm alright lets wait for the runpod's team to check later too!