Buil docker with environment variables
Hi,
I try to build a docker from github repo:https://github.com/weaviate/multi2vec-clip-inference. And I setup env variables but I have the error:
2025-03-31 18:51:46 [INFO] > [8/9] RUN ./download.py:...
Hi!Currently, the serverless service I created keeps initialzing. Is this normal?
Endpoint ID
wi7hpbtrbmc6qh...
Unexpected Infinite Retries Causing Unintended Charges
I recently ran my serverless workload using my custom Docker image on RunPod, and I encountered an issue that resulted in significant unexpected charges. My application experienced failures, and instead of stopping or handling errors appropriately, it kept retrying indefinitely. This resulted in:
- $166.69 charged by OpenAI due to repeated API calls.
- $14.27 charged on RunPod for compute usage....
Serverless vLLM workers crash
Whenever I create a serverless vLLM (doesn't matter what model I use), the workers all end up crashing and having the status "unhealthy". I went on the vLLM supported models website and I use only models that are supported. The last time I ran a serverless vLLM, I used meta-llama/Llama-3.1-70B, and used a proper huggingface token that allows access to the model. The result of trying to run the default "Hello World" prompt on this serverless vLLM is in the attached images. A worker has the status...
Runpod ComfyUI Serverless Huggingface Models does nothing
When deploying a ComfyUI serverless endpoint, the attached screen appears which asks for Hugging Face Models. However when I checked the repo, it is not utilized at all.
https://github.com/search?q=repo%3Arunpod-workers%2Frunpod-worker-comfy%20MODEL_NAME&type=code
How do I download required models (.safetensors) and comfy nodes when deploying an endpoint?...
Solution:
when you press next, until there is environment variable, you can check what is added there. then you can do add same env's with the same docker image template
