enfys
A40 availability
L40 is a good shout, but it's not routinely available in the two regions I use (EU-SE and CA-MTL), A40s have been a bit better supplied over the past 24 hours which is nice, and I've signed up with an alternative provider which offers a better price than RunPod (~$1.15/hr) on A100 80GB which also works for me, it's good to have a backup! I'm not overly price-sensitive but don't want to spend multiple $/hr on very high-end cards just for inference.
40 replies
A40 availability
I used to start and stop them based on workload, I'm not running a 24/7 workload so savings plans don't really work for me, if I could I'd get my credit out of RunPod so I could put it into an alternative provider with slightly higher pricing but much better availability but I can't
40 replies