Network Volume and GPU availability.
I am deploying automatic1111 as an endpoint . hosting the models on a network volume and then accessing them from the endpoint seems a good choice to avoid having an endpoint per model .However it looks like whenever I use a network volume the GPU availability displays either "low availability" or "not available ". Is there a specific region with a highly available 3090 , A5000 or 4090 GPU's ?
1 Reply
Solution
Best bet for 24GB tier is RO but it's mostly L4.