Topics

RunPod•2mo ago

Peter | CTO @ CoUnity

502 Bad Gateway Error

Greetings. I am attempting to use The Block LLMs One-Click UI. Whenever I try to connect to HTTP Service [Port 7860] I get a 502 Bad Gateway Error. I can't figure out how to fix it. Please help.

Solution:

https://github.com/ValyrianTech/dockerLLM

GitHub

GitHub - ValyrianTech/dockerLLM: Text-generation-webui oneclick UI ...

Text-generation-webui oneclick UI + API. Contribute to ValyrianTech/dockerLLM development by creating an account on GitHub.

Jump to solution

7 Replies

Madiator2011•2mo ago

do not use The Block LLMs One-Click UI template has not been updated and now it's broken

Peter | CTO @ CoUnity•2mo ago

Is there an alternative?

Madiator2011•2mo ago

if you rly want to use it there is community fork that is updating it https://runpod.io/console/gpu-cloud?template=00y0qvimn6&ref=2vdt3dn9

Solution

Madiator2011•2mo ago

https://github.com/ValyrianTech/dockerLLM

GitHub

GitHub - ValyrianTech/dockerLLM: Text-generation-webui oneclick UI ...

Text-generation-webui oneclick UI + API. Contribute to ValyrianTech/dockerLLM development by creating an account on GitHub.

Peter | CTO @ CoUnity•2mo ago

Thank you

digigoblin•2mo ago

This one works and is well maintained

No description

Peter | CTO @ CoUnity•2mo ago

Excellent, thank you very much!

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

12KMembers

View on Discord

Want results from more Discord servers?

Add your server

More Posts

Serverless Error Kept Pod ActiveI have a LLM deployed on runpod serverless. Due to a certain error that occurred after a request: T Community Cloud - Med Speed network - Slow outbound connections < 1MbpsUploading trained checkpoints to huggingface or just downloading from pod to my machine is very slow Is it possible to SSH into a serverless endpoint?I can SSH into the box when I deploy docker images to regular pods. But is it possible to SSH into t How to authenticate with Google Cloud in a Docker container running Serverless?I'm trying to authenticate using a service account json key file running a Docker container so I can NFS mount is not allowed in pod?Hello, I'm trying to mount my NAS server with NFS mount. but when I tried to mount it, I got mount.n Skypilot & expose-portsHi, I'm using Skypilot to create and deploy Vllm on POD. If I'm correct, currently, the template `Issue with deploying gpu pod in CA-MTL-3 RegionIn region : CA-MTL-3, when I try to depoy big server with more resource and container disk storage 4 When update handler.py using "runpodctl project deploy", Old worker does not auto update handlerAlthough handler.py in deploy directory in volume has updated, but if I use run to test, the old wor Network issue with long-running pod lf5zot1ukb8gy8Can't access since almost 24h Network issue with runpodHey folks my pod id (sb3ogh2mqvkuy6) has become unavailable. The error message I'm getting: "This se