Superintendent

PostsComments

RRunPod

•Created by Superintendent on 2/16/2024 in #⚡｜serverless

Deepseek coder on serverless

thanks

17 replies

RRunPod

•Created by Superintendent on 2/16/2024 in #⚡｜serverless

Deepseek coder on serverless

neat

17 replies

RRunPod

•Created by Superintendent on 2/16/2024 in #⚡｜serverless

Deepseek coder on serverless

oh really

17 replies

RRunPod

•Created by aswath on 1/28/2024 in #⛅｜pods

Deploying yolov8 on RunPod

if its possible inside a docker container ig it be possible on runpod

3 replies

RRunPod

•Created by Brolios on 1/19/2024 in #⛅｜pods

how can i see the GB usage of my network volume?

math.

4 replies

RRunPod

•Created by Concept on 1/15/2024 in #⚡｜serverless

Rundpod VLLM Cuda out of Memory

not only do you need to have space for fp16 weights u need space for context, which should be about 2 to 3gb for 4k to 8k context

76 replies

RRunPod

•Created by Concept on 1/15/2024 in #⚡｜serverless

Rundpod VLLM Cuda out of Memory

what context are u running at

76 replies

RRunPod

•Created by Superintendent on 1/15/2024 in #⛅｜pods

a6000 is apparently all gone but still available on page

thats neat

6 replies

RRunPod

•Created by Superintendent on 1/15/2024 in #⛅｜pods

a6000 is apparently all gone but still available on page

ah

6 replies

RRunPod

•Created by Sagar on 1/13/2024 in #⛅｜pods

connect ssh vscode to runpod gpu server

then your ssh key isnt setup right

42 replies

RRunPod

•Created by Ercan on 1/13/2024 in #⛅｜pods

[Urgent] One GPU suddenly went away

yes

64 replies

RRunPod

•Created by Ercan on 1/13/2024 in #⛅｜pods

[Urgent] One GPU suddenly went away

understood

64 replies

RRunPod

•Created by Ercan on 1/13/2024 in #⛅｜pods

[Urgent] One GPU suddenly went away

did the restart fix anything?

64 replies

RRunPod

•Created by Ercan on 1/13/2024 in #⛅｜pods

[Urgent] One GPU suddenly went away

or really 48

64 replies

RRunPod

•Created by Ercan on 1/13/2024 in #⛅｜pods

[Urgent] One GPU suddenly went away

oh nice u can cram all that into 24gb of vram?

64 replies

RRunPod

•Created by Ercan on 1/13/2024 in #⛅｜pods

[Urgent] One GPU suddenly went away

is it sd that ur running?

64 replies

RRunPod

•Created by Ercan on 1/13/2024 in #⛅｜pods

[Urgent] One GPU suddenly went away

i personally havent had any issues on community tbh

64 replies

RRunPod

•Created by Ercan on 1/13/2024 in #⛅｜pods

[Urgent] One GPU suddenly went away

yes

64 replies

RRunPod

•Created by Ercan on 1/13/2024 in #⛅｜pods

[Urgent] One GPU suddenly went away

oof is the 4090 ok with the load?

64 replies

RRunPod

•Created by Ercan on 1/13/2024 in #⛅｜pods

[Urgent] One GPU suddenly went away

i have no friggin clue, can u try to restart it?

64 replies