digigoblin Comments - Answer Overflow

pip3 install --no-cache-dir torch==2.3.0+cu121 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121 && \
    pip3 install --no-cache-dir xformers==0.0.26.post1 --index-url https://download.pytorch.org/whl/cu121

pip3 install --no-cache-dir torch==2.3.0+cu121 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121 && \
    pip3 install --no-cache-dir xformers==0.0.26.post1 --index-url https://download.pytorch.org/whl/cu121

Assming your base image is CUDA 12.1

70 replies

RRunPod

•Created by smoke on 7/6/2024 in #⚡｜serverless

CUDA out of memory (80GB GPU)

Must be something wrong with your implementation. Nobody can help you unless you share the code.

8 replies

RRunPod

•Created by smoke on 7/6/2024 in #⚡｜serverless

CUDA out of memory (80GB GPU)

Thats ridiculous for training a LoRA, you can do full Dreambooth training with 24GB

8 replies

RRunPod

•Created by blabbercrab on 7/5/2024 in #⚡｜serverless

Serverless is timing out before full load

Why do you need to load 30 Lora anyway?

21 replies

RRunPod

•Created by blabbercrab on 7/5/2024 in #⚡｜serverless

Serverless is timing out before full load

You can't really fix this, RunPod expects the handler to kick in within a certain time period.

21 replies

RRunPod

•Created by DDV-PYRMD on 7/3/2024 in #⚡｜serverless

serverless

It doesn't have xformers etc, use the link I sent, it works well.

9 replies

RRunPod

•Created by BadNoise on 7/5/2024 in #⚡｜serverless

Pipeline is not using gpu on serverless

its already doing that

70 replies

RRunPod

•Created by BadNoise on 7/5/2024 in #⚡｜serverless

Pipeline is not using gpu on serverless

Yep, will be useful for us to help you test it

70 replies

RRunPod

•Created by ssssteven on 7/3/2024 in #⚡｜serverless

network connections are very slow, Failed to return job results.

Problem seems to be a connection timeout to api.runpod.ai, I've also seen this in my endpoint logs from time to time. The connection shouldn't time out.

6 replies

RRunPod

•Created by BadNoise on 7/5/2024 in #⚡｜serverless

Pipeline is not using gpu on serverless

How are you running the model?

70 replies

RRunPod

•Created by zole2271 on 7/5/2024 in #⛅｜pods

why it download bar does not show in some browsers. I have no idea how long will it take to download

-u makes output unbuffered

49 replies

RRunPod

•Created by zole2271 on 7/5/2024 in #⛅｜pods

why it download bar does not show in some browsers. I have no idea how long will it take to download

!python -u script.py

!python -u script.py

should do the trick

49 replies

RRunPod

•Created by zole2271 on 7/5/2024 in #⛅｜pods

why it download bar does not show in some browsers. I have no idea how long will it take to download

Probably won't work unless its part of the same cell

49 replies

RRunPod

•Created by zole2271 on 7/5/2024 in #⛅｜pods

why it download bar does not show in some browsers. I have no idea how long will it take to download

Thats for notebook thats why I asked what they are using

49 replies

RRunPod

•Created by zole2271 on 7/5/2024 in #⛅｜pods

why it download bar does not show in some browsers. I have no idea how long will it take to download

What are you talking about when you say "Jupyter", that can be many different things, Jupyter Lab, a Jupyter notebook etc

49 replies

RRunPod

•Created by zole2271 on 7/5/2024 in #⛅｜pods

why it download bar does not show in some browsers. I have no idea how long will it take to download

You do it from terminal

49 replies

Gaming

Programming