nerdylive
RRunPod
•Created by BadNoise on 7/5/2024 in #⚡｜serverless
Pipeline is not using gpu on serverless
I guess it can be a dependency issue ( torch ) thats causing it not to use the gpu
69 replies
RRunPod
•Created by BadNoise on 7/5/2024 in #⚡｜serverless
Pipeline is not using gpu on serverless
ahh i thought you found it already hahah
69 replies
RRunPod
•Created by BadNoise on 7/5/2024 in #⚡｜serverless
Pipeline is not using gpu on serverless
yeah whats wrong with that?
69 replies
RRunPod
•Created by BadNoise on 7/5/2024 in #⚡｜serverless
Pipeline is not using gpu on serverless
Hmm okay cool, whats the difference with badnoise's code?
69 replies
RRunPod
•Created by BadNoise on 7/5/2024 in #⚡｜serverless
Pipeline is not using gpu on serverless
Did it work? used gpu?
69 replies
RRunPod
•Created by blabbercrab on 7/5/2024 in #⚡｜serverless
Serverless is timing out before full load
No i don't really have any idea if this is normal... i never tried loading that much lora's, but i guess its a normal time for loading all of them?
21 replies
RRunPod
•Created by AMooMoo on 7/6/2024 in #⚡｜serverless
Question about Network Volumes
Try to keep it below 10 ish
8 replies
RRunPod
•Created by AMooMoo on 7/6/2024 in #⚡｜serverless
Question about Network Volumes
I guess more than 15gb is bulky alr
8 replies
RRunPod
•Created by blabbercrab on 7/5/2024 in #⚡｜serverless
Serverless is timing out before full load
did you also use .to("cuda")
21 replies
RRunPod
•Created by blabbercrab on 7/5/2024 in #⚡｜serverless
Serverless is timing out before full load
maybe thats normal in huggingface?
21 replies
RRunPod
•Created by singhtanmay345 on 3/4/2024 in #⚡｜serverless
IN-QUEUE Indefinitely
I think its easy enough to make your own serverless code if its only for sdxl lightning try it out
26 replies
RRunPod
•Created by singhtanmay345 on 3/4/2024 in #⚡｜serverless
IN-QUEUE Indefinitely
maybe this is because an improper handler code, no worker took the job, so the job stays in the queue...
26 replies
RRunPod
•Created by ssssteven on 7/3/2024 in #⚡｜serverless
network connections are very slow, Failed to return job results.
yeah i've been seeing it too in my endpoints
6 replies
RRunPod
•Created by blabbercrab on 7/5/2024 in #⚡｜serverless
Serverless is timing out before full load
lou do you have the same problem too?
21 replies
RRunPod
•Created by blabbercrab on 7/5/2024 in #⚡｜serverless
Serverless is timing out before full load
Wow how many lora's do you use? and how do you load it in code?
21 replies
RRunPod
•Created by AMooMoo on 7/6/2024 in #⚡｜serverless
Question about Network Volumes
It depends, if your container is bulky enough because of the model, or files, etc, it may be beneficial to move them model files in network volumes
8 replies
RRunPod
•Created by BadNoise on 7/5/2024 in #⚡｜serverless
Pipeline is not using gpu on serverless
Btw @BadNoise have you tried this
export CUDA_VISIBLE_DEVICES=069 replies
RRunPod
•Created by BadNoise on 7/5/2024 in #⚡｜serverless
Pipeline is not using gpu on serverless
Hahahah if you got your code right, and you think it's a gpu problem feel free to report it in the site's contact button on the left menu thrn
69 replies
RRunPod
•Created by BadNoise on 7/5/2024 in #⚡｜serverless
Pipeline is not using gpu on serverless
In gpu it takes more?
69 replies
RRunPod
•Created by BadNoise on 7/5/2024 in #⚡｜serverless
Pipeline is not using gpu on serverless
Wow...
69 replies