How to scale pod GPU count properly?
Hello, we have some pods running with 2x4090, and what is the best way to increase this to e.g 4x4090 without making sure that our existing allocated gpus will not be taken by others even if we are running on-demand?
4 Replies
@Papa Madiator Do you know anyone who can help with this matter or give us some suggestions?
nothing can be done
Yeah you have to start off with 4xGPU, you can't add more GPU afterwards and will always have the risk that others will take your existing GPUs.
I see, so best way is start 4x GPU and attach the same network volume, and shut down previoud pair of pods
Hmm, looks like cannot create network volume for US