CPU Availability in North America?
I spent all day trying to create a new CPU serverless endpoint. It kept getting stuck on "Initializing" for many minutes at a time. After spending a few hours digging through my Docker pipeline, I realized that the actual reason no workers were available is because I was attempting to stand up the servers in North America. When I picked the entire world, I saw that I could only get CPU servers in Romania and Iceland. Specifically
EU-RO-1 and EUR-IS-1.
That's understandable, I guess, but the Serverless » New Endpoint UI shows "High" availability of CPU3 and CPU5 workers across the board, even when narrowing it down to a single datacenter in the US. I learned to rely on that label when picking GPU workers for a different endpoint.
Can you please confirm if my intuition is correct? And if so, perhaps you could improve the labeling in the UI to reflect the true availability of those workers?3 Replies
you are correct, cpu pod only available in EU-RO-1 and EUR-IS-1. We have some UI change coming, hope it will make this easy in future👌🏻
Thanks for confirming. I'm looking forward to the updated UI. Do you have any plans to offer CPU pods in North America in the future?
Maybe next year Q1🙏