How to connect to SFTP via rclone/Fuse
I've got a question which prevents me from using Runpod for my use-case at the moment: I'd like to connect Runpod to an SFTP server, and mount the corresponding remote volume to the local filesystem of the pod container - so it can be used like any other directory by apps like blender.
The way to do this usually is to use rclone, or a Fuse mount. This would let me connect multiple pods to a folder for them to write - I know I can do this with a runpod network folder - but also to read from that SFTP drive, which is a local NAS in our office on which we update regularly a lot of massive files, in order to avoid doing the sync manually.
Crawling through the doc, for now I can see how to connect TO the pod via SSH, export data snapshots to S3 & co and use network volume. I've come across the issue below that since "Fuse is not supported by Runpod because it requires granting privileges to the container. Since Fuse is a kernel module, it needs to be supported by the host". Another option would be to use a cloud sync utility like dropbox/gdrive, but this would involve an additional data-transfer from our office volumes to the cloud.
Would love to know if there is a workaround from your team!...
I lost my mininconda env after I start my runpod
I have a miniconda installed in my runpod and I found that miniconda folder installed under
/workspace is gone. Is my data not safe in runpod?How can you move a network drive to another region?
Even if I have to buy a 2nd network drive (which I'd prefer not to do if it can be avoided), what is the most efficient way to move the files?
Create Pod with networkVolume using runpodctl
Hi, I create a network volume and give it a name. How to create a pod with this volume attach ?
How can I create a pod with public ip using graphql?
When I create a pod using GraphQL, the supportPublicIp parameter doesn't take effect. The created pod's IP address is private, not public.
Anyone know any good cmd's for downloading files in Jupyter Notebook?
I'm trying to download flux off huggingface. I've been using wget, aria2 and cURL, but none of them are working for me.
aria2c -x 16 --header="Authorization: Bearer <huggingface token>" -o flux.safetensors "https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/flux1-dev.safetensors"
wget --header="Authorization: Bearer <huggingface token>" -o flux.safetensors "https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/flux1-dev.safetensors"...
Is there a way to determine my SSH username for a pod through runpodctl?
It seems like the username to connect to ssh is always of the format {pod id}-{some hex number}. If I spin up a pod using runpodctl and call
runpodctl get pod, I can get the pod ID. However, what is this hex number? Where do I get it from?Need help for error
Excuse me everyone, I need help where my pod can't start, it says error starting container and almost 2 hour. Can someone help me?
Where's the network volume?
Hey all,
The documentation about network volumes are frustratingly poor. I created a pod and SSH'd into it, have no idea where to put my files so they're stored. Really annoying.
I'm using the ComfyUI with Flux template and my goal is to store Flux models in a folder so I do not need to re-download it all the time....
I want to get a Public Url
I want to deploy my web app in RUNPOD and get a public url which i can use as a webapp. My Web app should open anytime and anywhere. Is this possible with on demand pods?
How can I access more logs from a pod?
when I view pod logs, it seems like I can only access a few hundred lines of logs. I'm dealing with an error that outputs a huge amount of logs, and concurrent requests cause a downstream error to print. Because of this I'm unable to view the logs of the original error, or what inputs caused it.
Is there any way to download a full log dump of a pod?...
Running pod Terminal is not starting
I just launched a new pod with a specific container. when i click on start web terminal, button reacts but the connect to web terminal is not enabling
Llama
Hello! For those who tried, how much GPU is needed for inference only, and for fine-tuning of Llama 70B? How about the inference of the 400B version (for knowledge distillation)? Is the quality difference worth it? Thanks!
Solution:
Only for inference
XXXX.safetensors is not a safetensors file
Hi, I have problems when generating an image, it tells me that the safetensors file is not a file, I have tried to install it from wget and gdown --fuzzy, there is no way it works.
Any ideas? I would really appreciate your help, I have been having this problem for many days 😦
The file works on my local machine, other people have tried it and it works for them too, I think something is missing....
I cannot use my SSH key for authentication process for my pod.
I have been using my pods using ssh key. but afew hours ago, I purchased Saving Plan. Then I cannot login to the new pods using my ssh key. The ssh key have been working well for other pods(not saving plan) so far. Please help me with this issue. Thanks in advance.
502 Error when attempting HTTP 8188 connection
I continue getting a 502 error when trying to connect to ComfyUI via HTTP 8188. The Jupyter Notebook is accessible. I have a GPU attached. I also do not see any errors in the logs. Any ideas?
connection refused for port forwarding (for colab)
1. I set up a pod and it's running...
2. Added the env variable for JUPYTER_PASSWORD
3. Set up ~/.ssh/id_ed25519
4. Pushed the Jupyter lab [Port 8888] button in Connect
5. Ran the port fwd cmd: ...
Volume with no files is registered as having 23GB
Started a new pod and /workspace had unusual amount of data used for the pod. Deleting everything from the volume still shows substantial usage. Seems like a bug in calculating storage.
root@5c5eadaefa32:/workspace# df -h
Filesystem Size Used Avail Use% Mounted on
overlay 10G 64M 10G 1% /...
How to Keep Installed Python Modules Persistent and How to Mount Multiple Volumes?
I'm running into a couple of issues on Runpod and would appreciate some help:
Whenever I pause and restart my pod, all of my installed Python modules are lost. How can I make sure the Python modules I install remain persistent even after restarting?
I know that this issue with persistence could probably be solved by mounting multiple volumes, but I can't find any method to mount multiple volumes in Runpod. Could you guide me on how to do this?...