RunPod

R

RunPod

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

Join

⚡|serverless

⛅|pods

Nonexistant download speed.

I've had issues with download speed on RunPod before, but in those cases it was usually merely slow. It's currently slow to the point of nonfunctionality. I'm using secure cloud as I'm training and I'm entirely willing to pay a little extra not to be interrupted, but even sample images take 20 seconds or so to load. It's not my internet. I can do other things just fine, and speedtest.net says I've got half a gigabit of download speed....
No description

IPv6 Support?

Hello, I wanted to know if RunPod have IPv6 support. Thanks!

Docker issues on RTX A6000 ADA gpu pod.

I am constantly having issues running dockers on this gpu pod. I have removed dockers and all related files and have tried installing again but when I run 'sudo dockerd' I get this error over and over again.. any help?...
No description

Error connecting to gpu cloud instance.

I have added a public ssh key on runpod.io and tried to connect using mac terminal: ssh [email protected] /path/to/my/pem/file.pem But with the above command, I just get 'Permission denied (publickey). ...

Unable to register, email blocked.

I'm not sure the best place to put this question, but I am unable to register. I have a custom domain where all my email is hosted so I think that I'm possibly getting flagged as though it were a disposable address. Is there any way to get through? The error:
This email address is blocked. Please use a different one....

Jupyter Notebook is not showing the output of any code

I have my model but when I run the .safetensors and ask a question the cells do not respond to anything and I have already tried restarting it.
No description

How to find the proper template: "The NVIDIA driver on your system is too old"

trying with "runpod/pytorch :2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04"...
No description

Cannot SSH login from Cursor (VS Code)?

I'm using Cursor.so, I try to ssh login to remote machine but I get error. With vast.ai I don't get any error.
No description

Mass files download from google drive

Hi guys I have a quite large amount of files, that I would like to send to my pods. However, I ran into the following limitations : - gdown is limited to 50 files per folder ( I have hundreds of folders containing hundreds of files, so it's not right pick) - I can't set up gdrive to save my life (see pic related, I don't understand)...
No description

Hosting RTX A4000 GPU's in Community Cloud

Hello, I am trying to host RTX A4000 16GB GPUs to community cloud, but it looks like I have no option to Add Machines as it says I have reached the machine limit count. In the past we have hosted around 800 no's of A4000 GPU's and that might be the reason for the machine limit count. So, if I delete those old machines do you think Add Machine button will be activated?...

RTX 4090 POD Cuda issue

Hi, I'm trying to load a community POD and I run into this issue with the Cuda drives ERROR: The NVIDIA Driver is present, but CUDA failed to initialize. GPU functionality will not be available. 2024-02-08T16:56:04.457515868Z [[ Initialization error (error 3) ]]...

Secrets character limit & validation

There appears to be a character limit for RunPod secrets but its not surfaced to the user very well. In the initial creation it will fail, when editing it will accept the secret and show no indication it was not changed.

NO Region Pods keeping block when start my docker image.

NO Region Pods blocking when start my private docker image.

Public setup IP Unreliable

Hey, just relaying some feedback (or requesting some guidance if I'm mistaken). Details: - I'm using runpod through the GraphQL API primarily. - When creating a pod using podFindAndDeployOnDemand, I set ports: "22/tcp", supportPublicIp: true and startSsh: true. - Occasionally however, I receive a pod which has no public address/only supports the proxied basic SSH access....

Host payout

Hi community, we trying to find documentation but we don’t find anything helpful. What’s the percentage a host gets paid on community cloud? to my understanding , on the hosting partner page rupod takes a 24% fee so this would mean you get 76% payout, is correct can someone confirm?

GraphQL: Query specific Endpoints and getting running worker amount

My goal is to adjust the amount of Active Workers for serverless endpoints dynamically. 1. Is there a way to query specific endpoints, instead of all? https://docs.runpod.io/graphql/manage-endpoints ...

podTerminate query returns error GRAPHQL_VALIDATION_FAILED

Hi, I am trying to terminate pods through the GraphQL API. I am sending the query through the python requests module, and my method has worked for starting and listing pods. However, for podTerminate it doesn't work and gives this error: {"errors":[{"message":"Something went wrong. Please try again later or contact support.","locations":[{"line":3,"column":39}],"extensions":{"code":"GRAPHQL_VALIDATION_FAILED"}}]}...
No description

How do I run custom code on a Runpod instance?

This sounds like you need to create a publicly accessible Docker image to run any code, is that true?
No description

Running on local URL but can't access from outside

Hi guys, I have this service running in my pod but I can't seem to access it through the intended way. I have the service ready Running on local URL: http://127.0.0.1:7860 I checked using curl from the pod on localhost and I get the interface....
Solution:
You don't need to edit the code.
export GRADIO_SERVER_NAME="0.0.0.0"
export GRADIO_SERVER_NAME="0.0.0.0"
...
No description

How can I use ollama Docker image?

Hello. I've been trying to serve ollama on RunPod using ollama Docker image (https://hub.docker.com/r/ollama/ollama) but haven't found a way to run it. I tried using the docker run ... command in the Container Start Command input but I encountered an error: unknown command "docker" for "ollama". Does anyone know the correct method to use ollama on RunPod?...