move network storage between data centers
Is there a way to move network volumes between different data centers on an ad-hoc basis?
Currently, we select data centers primarily for cost reasons. However, in the near future, we will need to start doing tests on more powerful machines, and eventually, we may migrate most of our workloads to these higher-performance systems. The issue is that the current system doesn’t seem to support moving a network volume to a different data center. Ideally, we would like to have mirrors of a network volume across multiple data centers, which would significantly accelerate our production.
3 Replies
Probably next best thing is you get a source and destination machine to connect to your source and destination network volumes
Connect to a terminal in both
On source machine, run “runpodctl send <your directory to transfer>” to send everything down which zips everything in the folder and then prints a command like “runpodctl receive some-random-words-1234”
On destination machine, run that command that was printed and wait until it finishes
Make sure to cd into the runpod volume where your network volumes are mounted
Hmm, while not ideal, that would definitely do the job, but slower. Thanks. 🙏
yea defniitely note ideal bc it's slow and youre paying for the gpu for data trasnfer, not actual compute
i couldnt' really find another way tho , so curious if there are others doing something differently
i guess there is a way for the runpod network volume to sync with a GCS storage bucket or s3 bucket but not sure if that's any different
for my case, i had to upload locally from my local drive on my pc so runpodctl was the most direct way