VERY LOW SPEED FOR DOWNLOAD
Sometimes the same files download at 120 mb/s and sometimes at 15mb/s it is too slow, and worse if I need to load several models and I use a very expensive GPU
Considering that they are the same files that I download every day that I use the platform
16 Replies
@Kevin "Literally Who?" Abanto
Escalated To Zendesk
The thread has been escalated to Zendesk!
Try to open a ticket, a way is to download model to the network storage first using cpu pods, cheaper
What do you mean by cheaper model? I need to download the Civit AI and Hugginface models.
just edited for clarity, meaning you download your models with less cost (than gpu pods)
I don't understand anything, I use A100 and my money goes more to downloading the models than to using the GPU
Do you know about cpu pods?
nop
Do you mean I can download everything to a cheaper server, but use it on my A100?
No, to a network storage / volume
I think you have the solution to what I'm looking for, but I need a step-by-step explanation, like for a fool like me, since I'm not an expert.
Do you have a network storage?
If not, create one, make sure the dc has your gpu, and supports cpu pods
Then, create a cpu pod, to run the download script to your /workspace or wherever it's mounted
Then run your gpu pod, point the app to your saved path for your model
It's abit technical I think but if it's too hard try to use chatgpt to help or don't do it hahah
That's the basic idea
Basically, can I use the Checkpoints and Loras I have on my PC so that I only run them in the cloud?
That is, without having to download everything to RunPod? Or do I always have to download them to RunPod?
sure its possible, but you'll have to move it into a pod or network volume/storage which is accessible by the pods
downloading into runpod ofc
So I could use 2 pods, one where I store everything (CPU only and cheap) and another where I run comfyui, then I would use the CPU pod to read the files and run them in the comfyui pod, is that true?
no, you store the file in some kind of Network attached storage, a network volume
you can read docs to learn more
its up, and you can attach it to pod anytime, try to create one in the "storage" page in website menu
Create a network volume | RunPod Documentation
Create a network volume in Secure Cloud to access high-performance storage and flexibility for multiple pods, with options for data center selection, naming, and size allocation, and enjoy cost-effective storage solutions with robust infrastructure and NVME SSDs.
and another where I run comfyui(GPU), then I would use the CPU pod to download only and run them in the comfyui pod(GPU)
yes