Is the pod network down ?

Cant connect to anything
95 Replies
nerdylive
nerdylive4mo ago
Pod ID?
PRB
PRB4mo ago
Please send pod id
nerdylive
nerdylive4mo ago
Btw is it possible that the pod is down and it has no notice?
utmostmick0
utmostmick04mo ago
8wznoz1csrmful
PRB
PRB4mo ago
We check pods every minute. So could be before the minute, the pod was checked
utmostmick0
utmostmick04mo ago
nerdylive
nerdylive4mo ago
Your hf isn't authenticated And im not sure about this error cannot remove 'Notebooks.txt': No such file or directory Might be from your template
utmostmick0
utmostmick04mo ago
hf shouldnt even b connected
Madiator2011 (Work)
it throws you are not authorized are you using some costum docker image?
nerdylive
nerdylive4mo ago
What do you mean it shouldnt be connected
utmostmick0
utmostmick04mo ago
Isk how , I literally delete my pods when im not using them i havnt logged into it nope fast stable defusion template
Madiator2011 (Work)
@TheLastBen did your HF mayby got hacked?
utmostmick0
utmostmick04mo ago
just closed and deleted pop and tried to start a ned one same thing Now i'm getting a cloudflare error
nerdylive
nerdylive4mo ago
Yeah you should if you want to use that private dataset, oh but this is totally unrelated to the downed pod network right
Madiator2011 (Work)
@nerdylive it should not require auth for that one it's looks like that dataset it's deleted from HF servers
nerdylive
nerdylive4mo ago
oh its storing a notebook file ic
Madiator2011 (Work)
good thing there are some forks
nerdylive
nerdylive4mo ago
it's deleted or private repo its not there anymore yea
TheLastBen
TheLastBen4mo ago
Runpod decided to discontinue supporting fast stable diffusion template
Madiator2011 (Work)
I never heard that info?
nerdylive
nerdylive4mo ago
huh why
Madiator2011 (Work)
@TheLastBen where is that info comes from? kinda want to understand what happened Cause it kinda not make sense
Marcus
Marcus4mo ago
Lots of people use that template so makes no sense to me either.
TheLastBen
TheLastBen4mo ago
I was informed by email
Madiator2011 (Work)
Would you be still intresting on letting it be as community template. I would be happy to still continue it as I also liked template.
Marcus
Marcus4mo ago
Sure its not the dreambooth endpoint rather than the pod template? RunPod isn't doing hosted endpoints anymore.
Madiator2011 (Work)
GitHub
GitHub - kodxana/madiator-docker-runpod: RunPod Docker Containers f...
RunPod Docker Containers for RunPod. Contribute to kodxana/madiator-docker-runpod development by creating an account on GitHub.
Marcus
Marcus4mo ago
Template is still there so someone probably got their wires crossed and meant that the dreambooth endpoint is getting discontinued. I don't see any reason to discontinue the pod template.
No description
Madiator2011 (Work)
@Marcus got offcial info and yes it got discontinued
Marcus
Marcus4mo ago
Wow, I wonder why The template should be delisted in that case, isn't it?
WarrenSilver
WarrenSilver4mo ago
So for those of us using that template with network storage with many models and such... what is the best template to change to?
nerdylive
nerdylive4mo ago
the default Pytorch... or custom template with your code or script
WarrenSilver
WarrenSilver4mo ago
and then start A1111 how? (sorry always done it via the notebook)
nerdylive
nerdylive4mo ago
Hmm call the start script of a1111 just use the a1111 template for the easiest way i guess
Madiator2011 (Work)
probably best thing would to be migrate to other template
nerdylive
nerdylive4mo ago
what why
Madiator2011 (Work)
as the template is getting removed
nerdylive
nerdylive4mo ago
ah ic
WarrenSilver
WarrenSilver4mo ago
why is it getting removed?
Madiator2011 (Work)
I mean unless @TheLastBen would allow me to continue and adopt the template as community one
WarrenSilver
WarrenSilver4mo ago
and what template is suggested to change to, for those of us not python experts
Madiator2011 (Work)
Kinda asking as it's his work so I respect the decision.
nerdylive
nerdylive4mo ago
use ashleyk's a1111 template probably
WarrenSilver
WarrenSilver4mo ago
👍 will try that.... just hoping it doesnt mess up the network storage... really wish runpod had a way to copy network storage
Marcus
Marcus4mo ago
Why can't TheLastBen just maintain it as a community template instead of a RunPod official one? Or is he not interested in doing so.
WarrenSilver
WarrenSilver4mo ago
would be nice... but quite curious the runpod reasoning here...?
Madiator2011 (Work)
I think it's some early adopter agrements but cant tell much or it's just case that there are a lot more templates nowdays
Marcus
Marcus4mo ago
Too many actually Especially broken ones RunPod should focus more on removing broken templates causing issues than taking away things that work
Madiator2011 (Work)
planning something to help solve the case for now Explorer page is not being much curated
Marcus
Marcus4mo ago
Yeah its like pulling the handle of a slot machine and hoping you get lucky
nerdylive
nerdylive4mo ago
most ppl rely on external link to get a good one hahah
Madiator2011 (Work)
I mean #🧩|templates is best source for good templates
nerdylive
nerdylive4mo ago
yeah like that probably
Marcus
Marcus4mo ago
Templates need ratings so people can find the best ones Almost like an app store
nerdylive
nerdylive4mo ago
I agree
yhlong00000
yhlong000004mo ago
good idea❤️
Marcus
Marcus4mo ago
Anyway, thanks for your valuable contributions TheLastBen, RunPod would not be where it is today without people like you who helped make it what it is.
utmostmick0
utmostmick04mo ago
is it just me or doesn't any other template work ? or are they that much slower to serup / setup
Marcus
Marcus4mo ago
They are slower thats why it was called "Fast Stable Diffusion" The others have much larger docker images which take a long time to pull, and also not cached on all machines since they are Community and not Official ones.
utmostmick0
utmostmick04mo ago
lol even the offical sd is broken
Marcus
Marcus4mo ago
Official SD as in a1111? its just out of date not broken isn't it?
WarrenSilver
WarrenSilver4mo ago
so the fastest loading and most usable SD template is getting the boot....hmmmmm
Marcus
Marcus4mo ago
You can use official pytorch templates, they load fast, but then you have to install everything yourself, so there are pros and cons. A lot of people used that Fast SD template so it honestly makes no sense to me why RunPod are getting rid of it.
utmostmick0
utmostmick04mo ago
yeah , i don't get it
Marcus
Marcus4mo ago
And worst of all, is that they don't delist it, so people spin up pods and waste their money because it can't start.
utmostmick0
utmostmick04mo ago
i was using it , went for dinner and come back and couldnt launch it again
WarrenSilver
WarrenSilver4mo ago
how to start webui with pytorch?
Marcus
Marcus4mo ago
Add the port(s) to your pod after installing the webui.
utmostmick0
utmostmick04mo ago
RunPod Stable Diffusion is broken
WarrenSilver
WarrenSilver4mo ago
thats it? add the ports and restart pod?
Marcus
Marcus4mo ago
Broken how? Pod will restart by itself when you save the ports if I can remember correctly.
utmostmick0
utmostmick04mo ago
error 504 bad gateway
WarrenSilver
WarrenSilver4mo ago
yes but it doesnt start webui
utmostmick0
utmostmick04mo ago
cloudflare sorry 502
Marcus
Marcus4mo ago
What do the logs say? 502 usually happens when its syncing to /workspace
WarrenSilver
WarrenSilver4mo ago
Install script for stable-diffusion + Web UI Tested on Debian 11 (Bullseye), Fedora 34+ and openSUSE Leap 15.4 or newer. ################################################################ ################################################################ ERROR: This script must not be launched as root, aborting... ################################################################
Marcus
Marcus4mo ago
Takes about 15+ mins
utmostmick0
utmostmick04mo ago
15 mins to start , this is doing my hed in i'll try again in the morning
Marcus
Marcus4mo ago
Where did you see this?
WarrenSilver
WarrenSilver4mo ago
trying to instal A1111
Marcus
Marcus4mo ago
Install it where? Pytorch template?
utmostmick0
utmostmick04mo ago
if you guys figure something out can you tag me and let me know please
Marcus
Marcus4mo ago
You're probably using network storage, its slow to sync to network storage, no way around that really.
WarrenSilver
WarrenSilver4mo ago
yeah I have no idea what I am doing, this is is freaking frustrating... the fast SD just worked and now nothing works, spent 40-50 a week on runpod now about to give up
Marcus
Marcus4mo ago
But you should be root on pytorch template, so you shouldn't get that issue
Marcus
Marcus4mo ago
This template has latest A1111 webui and some cool extensions preinstalled
No description
WarrenSilver
WarrenSilver4mo ago
So I have run into this before with ashleyk templates, they all get stuck on syncing main venv to workspace... if it ever finishes, its usually 20-30 minutes
utmostmick0
utmostmick04mo ago
yep
Marcus
Marcus4mo ago
They finish, there is no "if they ever finish", network storage is just slow. And they are not stuck at all, it says wait so you have to follow the instructions and wait.
WarrenSilver
WarrenSilver4mo ago
paying to wait, awesome such improvement
Marcus
Marcus4mo ago
It only has to sync the first time, once its synced it doesn't have to sync again, and there is also a DISABLE_SYNC environment variable that can be set to disable syncing.
WarrenSilver
WarrenSilver4mo ago
So sync just this once, then add that anytime I go to deploy a pod so it doesnt sync again?
Madiator2011 (Work)
it's slow on network storages
Want results from more Discord servers?
Add your server