ofer
RRunPod
•Created by ofer on 1/16/2025 in #⚡｜serverless
"Throttled" and re-"Initializing" workers everywhere today
Things are looking good at the moment, but earlier today I did have a few hours where delays, throttling an reinitializations were occurring frequently.
I have to say RunPod Serverless has been rock solid so far, I'm very hopeful that you will be able to iron out these kinks and be able to continue offering an excellent service
9 replies
RRunPod
•Created by ofer on 1/16/2025 in #⚡｜serverless
"Throttled" and re-"Initializing" workers everywhere today
Thank you for the follow up.
Most of the affected workers were A5000/L4/3090 class.
I was not very restrictive in global distribution, I only excluded a handful of eastern european locations because of longer round trip times from my own servers.
Most of the A5000s just "organically" allocated themselves from CA-MTL-1
Extending to all global locations did not really help either.
9 replies
RRunPod
•Created by ofer on 11/10/2024 in #⚡｜serverless
First attempt at serverless endpoint - "Initializing" for a long time
nevermind - I figured it out. I was too restrictive on the GPU types in my endpoint selection. as soon as I allowed more types, the initialization happened and the workers were able to run.
It would have been nice to have some indication in the management console...
3 replies