Xqua
RRunPod
•Created by Xqua on 10/10/2024 in #⚡｜serverless
Some serverless requests are Hanging forever
I'm not sure why but I "often" (often enough) have jobs that just ... hang there even if multiple gpus are available on my serverless endpoint. new jobs might come it and go through while the old job just "stalls" there.
any idea why ?
5 replies
RRunPod
•Created by Xqua on 10/10/2024 in #⚡｜serverless
Application error on one of my serverless endpoints
Getting a
TypeError: e.machine is null
when I try to access https://www.runpod.io/console/serverless/user/endpoint/[HIDDEN]
6 replies
RRunPod
•Created by Xqua on 9/26/2024 in #⚡｜serverless
6x speed reduction with network storage in serverless
To reduce my docker image size I wanted to use the network storage to store the models, but the main issue I am running against now is that I went from 20sec per request to 120sec.
When looking at the logs, it takes almost 100sec (vs a few sec) to load the model in GPU memory.
Why is the network storage so slow ??? its a major drawback and means you and I have to handle 10s of Gb of Docker image for nothing.
3 replies