Théo Champion

PostsComments

RRunPod

•Created by SATAN on 5/22/2024 in #⚡｜serverless

OutOfMemory

I do load my models outside the handler function

34 replies

RRunPod

•Created by heyado on 5/31/2024 in #⚡｜serverless

Endpoint stuck in init

Are you downloading a model at init?

9 replies

RRunPod

•Created by Pranav on 5/25/2024 in #⛅｜pods

Slow download

I'm experimenting similar issues on serverless. Super slow bandwidth since a couple of weeks

6 replies

RRunPod

•Created by Théo Champion on 5/30/2024 in #⚡｜serverless

Issue loading a heavy-ish (HuggingFaceM4/idefics2-8b) model on serverless (slow network?)

Yeah, if it is the case, I wish it was documented somewhere

9 replies

RRunPod

•Created by Théo Champion on 5/30/2024 in #⚡｜serverless

Issue loading a heavy-ish (HuggingFaceM4/idefics2-8b) model on serverless (slow network?)

9 replies

RRunPod

•Created by SATAN on 5/22/2024 in #⚡｜serverless

OutOfMemory

I'm running into the same issue, started getting OOM errors the past few weeks. No code change. I contacted support but got no reply yet

34 replies