Is there a way to scale pods?

I would like to scale up number of pods in order to meet demand. Is there a way to do that?
8 Replies
zkreutzjanz
zkreutzjanz7mo ago
use serverless
digigoblin
digigoblin7mo ago
Yep, pods can't scale up automatically, serverless is designed for scalability.
nerdylive
nerdylive7mo ago
well you can create a custom code that handles scaling like kubernetes using the graphql runpod api you can gather their load and check if you need to deploy another one
digigoblin
digigoblin7mo ago
I don't recommend doing that, using serverless is better.
nerdylive
nerdylive7mo ago
yeah easier too
digigoblin
digigoblin7mo ago
Easier and probably cheaper too.
ChueyChueykin
ChueyChueykinOP7mo ago
Problem is that serverless doesn't have H100 gpus
nerdylive
nerdylive7mo ago
Yeah that's currently high in demand
Want results from more Discord servers?
Add your server