cant get my pod to work right
hi im new to runpod im trying to add models and loras to my runpod as well as trying to install runpodctl but i cant figure it out
when i try to follow the tutorial for the runpodctl i keep getting errors.
Help would be greatly appreciated thank you in advance
197 Replies
what error you get?
when i put the windows link like in the tutorial i get error 404
and whenever i try running python relauncher.py like in the video i get an error message and it keeps trying again and idk how to stop it
shutting down the terminal doesnt work
like error 404 and it doesnt recognize the ckpt file
you need use powershell
how do i do that
do i need to download it from somewher?
btw if you use one of @ashleyk templates they have my uploader tool included
where do i get it and what does the uploader tool do?
aka you can upload models via web browser
that would be most useful
where can i find the template?
most recent is at https://www.runpod.io/console/explore/ts8ze6urzh
Note you need use filter and pick CUDA 12+
whats that
also read the text you will see in that link
after pressing deploy you will see this click the last icon
then change allowed CUDA version
then select a pod that has it
pick then gpu you want
k i launched it
btw on customize section you might up volume storage
wheres that before starting it?
after you pick gpu
o i already launched the pod its downloading stuff
extracting*
you can always press 3 lines icon and edit pod
should i wait until its done with all the setting up or is it safe to do it now
it's safe just make sure to up it if you plan uploading lot of models
k
its up where do i upload models and stuff?
click connect and button with 2999 is my uploader tool
then you can drop model files there
k its taking a bit tho bc models files are big...
i dont need to do this again unless i terminate right
if you stop pod the models will stay but someone can take the hpu so you could end up with 0 GPU issue
if you terminate pod it will delet both container and volume storage
its not an issue if i wait until its free again tho right
yes
btw my uploader has cool thing that allows you to pause and resume upload
you wouldnt have something to speed the upload up by chance š
also does it work to upload more stuff while i use it and refresh/restart if after?
not sure what you mean?
like can i upload a model or lora and generate stuff in another window at the same time
I mean you can upload multiple file at once
can i upload vaes as well or are some already included?
I mean my tool is not made to limit what file you can upload note you will need to move them after upload as they are saved to /workspace
k i suppose thatll be in the port 888 in the folder like it would be if i had it locallly
yes there is jupiter nootebook included
anyway late here just in case ask @justin [Not Staff]
k
ty for your help
https://discord.com/channels/912829806415085598/1194711850223415348
https://discord.com/channels/912829806415085598/1208261602315345951
i mean many ways to upload if ur talking about from ur computer to the pod
as said in the easy way to ssh to pod / file transfer; or using the uploading tool madiator has
some faster than others
and then downloading models directly to the pod just standard hf / civitai requests
madiators seems to work well but its quite slow
for me at least
ur ultimately bottlenecked by ur internet / http request
yea...
the fastest u can get is probably
scp through ssh connection
with an existing pod u can do the password ssh setup i detail in the ssh guide / then use scp to transfer stuff over
that the fastest ull get if from local computer
or u make the request to download from the pod
which can be decently fast
so instead of ur computer to pod, which is prob bottleneck by ur internet, the pod has faster internet in general
and can download direct from some source
ill try that but i didnt understand a thing you just said sry
Just like from the pod u run a curl command to download ur model
lile curl <some url> to download model
from ur pod terminal
Is prob the easiest
can read the hugging face / civitai download guide
you mean the jupiter notebook?
@justin [Not Staff] is the openssh already on the template?
No from terminal
If ur using runpod official templates yes
The jupiter notebook has a tab u can open called terminal
where u can write commands
o that ty i was confused
https://www.phind.com/search?home=true
/ Chatgpt are great to ask more questions. just know that if anything tells u to do
sudo some command u can remove sudo
for runpodso i need to setup this right
You can for a running pod
use the
password setup
GitHub
Runpod-Tips-and-Tricks/SSH On Runpod at main Ā· justinwlin/Runpod-Ti...
Runpod Tips and tricks repository. Contribute to justinwlin/Runpod-Tips-and-Tricks development by creating an account on GitHub.
in the future u can do the:
https://github.com/justinwlin/Runpod-Tips-and-Tricks/tree/main/SSH%20On%20Runpod#option-2-using-password-ssh-must-setup-every-time-on-a-new-pod
But for now, I recommend the option 2
GitHub
Runpod-Tips-and-Tricks/SSH On Runpod at main Ā· justinwlin/Runpod-Ti...
Runpod Tips and tricks repository. Contribute to justinwlin/Runpod-Tips-and-Tricks development by creating an account on GitHub.
so i put this in terminal?
pip install OhMyRunPod
OhMyRunPod --setup-ssh
cat /workspace/root_password.txt
as individual commands
and not all at once yes
so line by line
copy and paste it in
and click enter
i did so now what do i need to do
btw if you have my uploader app you can go to admin pannel
open admin pannel in new window and press setup ssh
what do i do with the password it gives me?
you also get 2 files for connecting with windows or linux
WHen you run the SCP command
or an ssh command
it will ask u for a password
GitHub
Runpod-Tips-and-Tricks/SSH On Runpod/README.md at main Ā· justinwlin...
Runpod Tips and tricks repository. Contribute to justinwlin/Runpod-Tips-and-Tricks development by creating an account on GitHub.
U can run the ssh command
from ur actual computer terminal / command prompt
and see if u can connect to runpod
and then if that works, in a new terminal
u can run the SCP command
you mean my own computer or the terminal of jupyter
ur own computer
ur laptop / desktop
so the cmd terminal
you can also use filezilla
which one is it
run the ssh command in command prompt from ur actual computer
to see if u can establish a connection
for testing
U must btw
switch out the @root address to whatever it is for ur pod
whats the command tho i cant find the right one
press connect button on m y pods page
wonder if it told him this lol
where do i see the root of my pod
root is just udername
username
oh rlly? huh. but i guess as another way is u can look under tcp port mapping
and replace the numbers
with ur own
-p is that external port i believe
so for ex. the image i sent it is:
you can just copy command from connect button
i think his doesn't show it
cause he has no ssh public keys on his runpod profile
from this image
i put the ssh command in my pc it didnt work
with changing the root and external as well
what did u get?
no such file or directory
can u copy and paste ur command? that seems wrong
connect to hos ... connection refused
hm
send me ur command?
just wondering
does this pod matter?
like do u have existing stuff on it? XD
no
Ok
Just for the sake of simplicity:
You can terminate the pod then
i did
Just wondering, I guess, let's just start with first:
What do u want to download? Are these models custom?
Or from where?
from civitai
And then in the future, if you want to set up SSH this is how you can do it, I recommend just use my wrapper:
Pod ID is what i sent in the picture, that establishes an ssh connection. Again, an SSH connection is different than running a pure SCP command, since the SCP will establish a SSH command independently, so if u run an SCP command or something like that you always need it to be in a new terminal tab locally with no connections.
https://github.com/justinwlin/Runpod-Tips-and-Tricks/blob/main/SSH%20On%20Runpod/README.md#using-an-ssh-wrapper
And then in the future u can run the commands I have here:
Since you are using my custom wrapper.
Okay cool
What model / templates are you using?
I think honestly
civitai if you are doing that
1) I think is great to setup ssh anyways, so u can just do :
If you want for the future, which is why i said just terminate it for now. But u prob dont need SSH realistically right now. You can just run the command in ur Pod terminal to download, but is good to have, in case u need to download large amount of files or outputs
2) I just wanted to know exactly what is happening so I can recommend u steps for u to try and go through, without u just burning compute time
With civitai in the future for your pod you want to do in the pod terminal:
where do i do all of this
This is for ur local pc
/ whatever
this is prob more helpful if u end up wanting to download a large amount of outputs
or files from ur pod in the future
not so much uploading a civitai checkpoint
BUt for civitai model in runpod u would run in the runpod terminal:
So an example command might be:
Or the -P is wherever you want to download the model to
In this case for ex. I was saying put it in the ~/workspace directory
Source: https://www.reddit.com/r/StableDiffusion/comments/19f8wdm/comment/ko92bzg/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button
Honestly SSHing your models up to runpod is prob slower than you just telling ur Pod to download it
im so lost
so like there is a way to just input the civitai links in the runpod terminal to access everything on my pod?
Okay I guess let's simplify:
1) If you make a pod you go to the terminal
2) You run the following to download:
No, you need to get the model id
but i dont need to download it or upload it i just need the civitai page for that
Yes
https://civitai.com/api/download/models/367044
This is an example
the model id is: 367044
So then I would do:
wget -P ~/workspace -q --show-progress --content-disposition https://civitai.com/api/download/models/367044?token=supersecretauth
with the right token authentication
whats the token authentication
Reddit
terrariyum's comment on "Need Help with Civitai Model Download Auth...
Explore this conversation and more from the StableDiffusion community
its in ur user settings
on civitai
otherwise civitai will block u from downloading at times
o ok
Yeah lots of ppl complain about their model not working, but it just a civitai issue where they have required u to generally have an authentication token
Yea
anyways
I recommend
u can do it locally, if u have wget / curl, if u have window subsystem linux installed. im not a windows user so i can't speak much to it. but u can do it locally just to play before u use runpod
but my best bet is if ever confused, just ask chatgpt / phind about the commands / if it can fix it up for u as long as u give it context
anyways yeah
hope that clarifies things
1) Runpod Pod you can run a wget command to download the model directly
2) in the future, you can use SSH/SCP to download outputs from ur model, I assume they are images to ur computer, or some other method if u have it, like pushing up to github, some script to upload to somewhere, etc.
idk
?
im sorry im bad at programming i understand half of what youre saying also im on windows
Yea no worries, i wasn't used to all it either
idk if that changes anything to what you said
I guess the main thing is just play around
No not really
if u want to use the service u can, if u dont, u dont have to xD
but i guess, the main thing is that if u want to use any service, i think runpod is relatively the easiest
but u do need to get over the linux curve
which i just did so by asking chatgpt
i mean having windows instead of linux
I mean runpod is linux
U can use mac / windows
just know that u generally need to be able to run a command prompt / some sort of way to connect to linux servers
*since runpod is a linux server
mb thats why the ssh command earlier didnt work on my pc?
No, u can run ssh commands on window, just most ppl use something called windows subsystem linux (WSL) to do it. But that's a whole thing in itself. as Madiator said, there is also Firezilla which allows you to have GUI to connect to a linux server
thro username / password, but im not familiar with it
Personally, for my windows computer, i just watched a tutorial on how to do WSL on YT, and just set it up, and i never think about it much
since all the commands that work on mac, should work on PC
but there are maybe other alternatives, im not familiar with
xD
ok back to work
š
... fr
ssh client if build in windows so
still having issues or no issue?
or I should make new issue if no issues?
im still at the starting point i feel like i didnt understand anything i needed to do at all
not that both of you explained it badly i just dont understand programming at all
yea no fr im dogshit when it comes to programming
1) I guess, let's start with the:
Make a wget request, start up a runpod pod, and then paste the command into the terminal to run it
š
That is a great first step
2) Once you get that going, then I guess you can really do whatever you want
Do not worry let me kick out Justin for now
xD
Off i go
lol
@Waosh76 so lets start from start.
so curently you have pod running or not?
do i need to make one of those as a start?
no i dont so it doesnt charge for nothing
ssh keys are easy though requires setup from your side
Let me guide you how to use Filezilla is it ok?
sure
so here is link for client https://filezilla-project.org/download.php?platform=win64
Download FileZilla Client for Windows (64bit x86)
Download FileZilla Client 3.66.5 for Windows (64bit x86)
manual or no?
also are you deploying pod on Secure Cloud or Community?
secure
good so that Filezilla you install on your pc
filezilla or filezilla with manual?
FileZilla just normal FileZilla
ok
let me know when you install it
my firewall removes it...
I mean you get pop up?
mind showing the error you get?
its not an error my firewall says its unsafe and deletes it
what firewall?
norton
i restored it
Filezilla is known app so its wierd that Norton delets it
norton likes to do that with a bunch of stuff
ye it's agresive sometimes reason I switched to bitdefender
ok i got it installed whats next
Shall we start with new pod or you want reuse old one
btw I have max 10min
i terminated it so i need a new one anyway
we can do it tomorrow if its better for u
ok it's fine just deploy new pod remember about cuda filter
whats cuda filter..
nah as it's new pod it will be fast
do i use the template again?
it was this one right
o right that
No this one is combo
here https://www.runpod.io/console/explore/ts8ze6urzh
The one you gave would take long time to start
and you only want auto1111 web ui with models
its downloading and extracting everything again so its gonna take a while as well
ok its fine
is it up?
@Waosh76
not yet
so after you get it up press button 8888 and you will see
download file named filezilla
then you can follow this part of my video https://peer.madiator.cloud/w/f26mTiyttvbRRtiyvofDLZ?start=2m11s
Madiator2011v2
PeerTube
RunPod Stable Diffusion - SFTP Edition Tutorial
RunPod Stable Diffusion - SFTP Edition Link to template: https://runpod.io/gsc?template=gmeogp0jor&ref=vfker49t
this is whats in the workspace
check pod logs
or try refresh jupiter
look at container logs
you should see like this
it says please wait
mind showing full log?
btw make sure to press the play icon in corner
got it now
said container is ready
it was pressed
already
good it requires syncing python venv in most templates and that takes time
so now look at video and you will see what to do
Madiator2011v2
PeerTube
RunPod Stable Diffusion - SFTP Edition Tutorial
RunPod Stable Diffusion - SFTP Edition Link to template: https://runpod.io/gsc?template=gmeogp0jor&ref=vfker49t
btw if you go to web ui on port 3000 you get automatic1111 with civitAI extension that lets you download models without having to upload them manually
anyway im off now
ok ty
cant connect the thing with filezilla
"connection refused"
"unable to establish connection"
just tells me i need an api key and that i can get it in the civitai browser+ settings but idk where that is
Just saying you can use browser and if model do not work use FileZilla
wheres the sd webui settings tab in jupyter i guess but cant find it
if youre still there
Web ui is separate thing
On my pods page press connect button clicking 8888 will open Jupiter, 3000 will open automatic1111 web ui
ye ik i think i get it but i need to put my api somewhere in 8888
nvm
im stupid
theres a setting window in the webui
Can you show me where it ask you to put api key?
i got it
it was here in the settings tab on the webui
i downloaded a model refreshed the ui and it didnt seem to do anything
worked
tysm for the help
hi, sorry to bother you, i ran into an issue the browser+ thing shows up error whenever i try to search for anything that ever happen before?
i suppose this in the corner has something to do with it
i think its just the civitai changed their api and the civitai broswer+ extension now has a newer model which hasnt been implemented yet
Probably