Madiator2011 (Work)

PostsComments

RRunPod

•Created by nielsrolf on 11/12/2024 in #⚡｜serverless

Incredibly long startup time when running 70b models via vllm

also serverless is not using /workspace

11 replies

RRunPod

•Created by nielsrolf on 11/12/2024 in #⚡｜serverless

Incredibly long startup time when running 70b models via vllm

usually you dont want download models on sending request

11 replies

RRunPod

•Created by Ana on 11/11/2024 in #⛅｜pods

Import backup from volume disk to Network volume

I would only copy models folder

14 replies

RRunPod

•Created by Ana on 11/8/2024 in #⛅｜pods

Pod with Comfy (flux + stable diffusion)

https://peer.madiator.cloud/w/mFxwXpgQyLT3yBkGv1ZWkx

5 replies

RRunPod

•Created by deepblhe on 11/7/2024 in #⚡｜serverless

(Flux) Serverless inference crashes without logs.

what version of SDK?

10 replies

RRunPod

•Created by Putu Ganteng on 11/5/2024 in #⛅｜pods

Custom template

it's looking like it loops cause wrong start command

7 replies

RRunPod

•Created by Putu Ganteng on 11/5/2024 in #⛅｜pods

Custom template

what do you see in logs?

7 replies

RRunPod

•Created by nikolai on 11/5/2024 in #⛅｜pods

GraphQL Schema

nope

6 replies

RRunPod

•Created by nikolai on 11/5/2024 in #⛅｜pods

GraphQL Schema

inspection is disabled for security reasons

6 replies

RRunPod

•Created by justk on 11/4/2024 in #⛅｜pods

Where are default models mounted? I can't find them under /comfy-models

I do not think that templte comes with models

8 replies

RRunPod

•Created by Ergin Bilgin on 11/1/2024 in #⚡｜serverless

Llama-3.1-Nemotron-70B-Instruct in Serverless

For 70b + models I would recomend using pod to cache model to network storage then try to run on serverless

3 replies

RRunPod

•Created by coffeewaffles. on 10/30/2024 in #⛅｜pods

Stable diffusion checkpoint list empty with Better Forge template

and placed to what folder?

9 replies

RRunPod

•Created by coffeewaffles. on 10/30/2024 in #⛅｜pods

Stable diffusion checkpoint list empty with Better Forge template

what command you used for download?

9 replies

RRunPod

•Created by coffeewaffles. on 10/30/2024 in #⛅｜pods

Stable diffusion checkpoint list empty with Better Forge template

@coffeewaffles. if the models not show up you most likely not downloaded model

9 replies

RRunPod

•Created by coffeewaffles. on 10/30/2024 in #⛅｜pods

Stable diffusion checkpoint list empty with Better Forge template

How did you downloaded models?

9 replies

RRunPod

•Created by Srikant Dash on 10/29/2024 in #⛅｜pods

Udp ports

for now nope

2 replies

RRunPod

•Created by shydow on 10/20/2024 in #⛅｜pods

How can I create a pod with public ip using graphql?

did you use secure cloud?

15 replies

RRunPod

•Created by Randyandy040 on 10/28/2024 in #⛅｜pods

Cannot set TCP-Port 3000 for Dreambooth

depends if you want to use network storage or not

12 replies

RRunPod

•Created by Randyandy040 on 10/28/2024 in #⛅｜pods

Cannot set TCP-Port 3000 for Dreambooth

why not use normal auto1111 template?

12 replies

RRunPod

•Created by Randyandy040 on 10/28/2024 in #⛅｜pods

Cannot set TCP-Port 3000 for Dreambooth

I do not know what is the fuser toll exacly doing do you have link?

12 replies