AMooMoo
RRunPod
•Created by AMooMoo on 7/6/2024 in #⚡｜serverless
Question about Network Volumes
Hi!
Just a quick 2 questions about network volumes working in tandem with Serverless endpoints:
- Does it reduce the cold start time or availability of the serverless gpus? I want to store AI models inside a network volume and access it with a serverless gpu endpoint, I would like to know the issues I may run into as cold starts and availability are pretty important to me.
- What's the file path to a network volume if I want to set up my serverless container to use stuff in it?
Thanks all!
12 replies
RRunPod
•Created by AMooMoo on 6/7/2024 in #⚡｜serverless
Quick question about what "Extra workers" are
8 replies
Question about Pods and data
Hi!
I have a quick question for pods regarding how data on them works. Let's say I use the ComfyUI stable diffusion template, but I want to add some models, so I go into the pod, and I add some models in whatever way, whether through CLI or the ComyUI manager thing.
If the pod goes down or some kind of interruption happens, do I lose my custom models when the pod restarts?
9 replies