what is the best way to access more gpus a100 and h100
flux is of 25 gb , if i download that model in network volume, then i can only access that region gpus only , and I can see everytime , a100 and h100 gpus are in LOW in all the regions .
If i download the model flux in the container itself while building the docker image, instead of network volume, then it has to download 25 size of docker image everytime for the new pod
could anyone please help me with this
3 Replies
for the new image if you build the model inside the image yes
or have multiple network storage
i think those are the only ways
But even though if we have the multiple network storages there aren't any a100 GPUs much right ?
yeah, you surely can contact support to request more gpu's or just wait for more gpu's