RunPod•3mo ago

Pod's connection is less stable that the tower of babel

I'm trying to use ollama in a container on runpod as a pod and I keep running into connection errors over and over again. I've tried different pods, Secure Cloud vs Community and different GPUs but I keep getting timeouts like this:

ResponseError: <!DOCTYPE html> <!--[if lt IE 7]> <html class="no-js ie6 oldie" lang="en-US"> <![endif]--> <!--[if IE 7]> <html class="no-js ie7 oldie" lang="en-US"> <![endif]--> <!--[if IE 8]> <html class="no-js ie8 oldie" lang="en-US"> <![endif]--> <!--[if gt IE 8]><!--> <html class="no-js" lang="en-US"> <!--<![endif]--> <head> <title>3k27lkqzwstw36-11434.proxy.runpod.net | 524: A timeout occurred</title>

ResponseError: <!DOCTYPE html> <!--[if lt IE 7]> <html class="no-js ie6 oldie" lang="en-US"> <![endif]--> <!--[if IE 7]> <html class="no-js ie7 oldie" lang="en-US"> <![endif]--> <!--[if IE 8]> <html class="no-js ie8 oldie" lang="en-US"> <![endif]--> <!--[if gt IE 8]><!--> <html class="no-js" lang="en-US"> <!--<![endif]--> <head> <title>3k27lkqzwstw36-11434.proxy.runpod.net | 524: A timeout occurred</title>

Occasionally it works, but I need a stable connection on a GPU to work on my project properly. Last weekend, I probably spent 15$ without making any progress, just trying to fix the connection. I use the proxy on 11434 to reach ollama but when the timeout occurs, I can't even reach it in the terminal using ollama run my-model Please help!

2 Replies

nerdylive•3mo ago

you should use tcp connection instead.. http connections are limited to like 60secs max from cloudflare ( the proxy ) so after 1mins ish, the connection will close

Sir FalkOP•3mo ago

It's actually working well now, thank you so much! And the solution was so easy, wow!

Gaming

Programming

Pod's connection is less stable that the tower of babel