How fast are network volumes?
Hey, this kind of belongs into here, and also into serverless. For a client we're currently architecting some stuff, and the question we're having is, just exactly how fast are network volumes.
My limited benchmarks make it feel like they add about a minute for an SDXL Model to the execution time, because the Model needs to be loaded to RAM. This seems to be much faster with local storage.
What are your experiences, any pieces of advice? Any gotchas?
Thank you so much 🙂
A confused Devops Engineer who has to handle the customers need for speed.
2 Replies
Local Storage will always be much faster. You have lower latency, higher bandwidth. You can keep Network Storage for sharing between pods, sync to local storage and load from local storage.
yeah i guess if you need the need for speed, then its best to keep your things in local container storage