sandwich
RRunPod
•Created by nerdylive on 12/6/2024 in #⚡｜serverless
Serverless vllm running but still downloading?
Understood. I'll try it while keeping the Active Worker running. Thank you!
15 replies
RRunPod
•Created by nerdylive on 12/6/2024 in #⚡｜serverless
Serverless vllm running but still downloading?
Is there a behavior where the worker’s Docker image is periodically removed after it remains inactive for a certain period of time?
If this, too, is expected behavior, I apologize .
15 replies
RRunPod
•Created by nerdylive on 12/6/2024 in #⚡｜serverless
Serverless vllm running but still downloading?
15 replies
RRunPod
•Created by nerdylive on 12/6/2024 in #⚡｜serverless
Serverless vllm running but still downloading?
15 replies
RRunPod
•Created by nerdylive on 12/6/2024 in #⚡｜serverless
Serverless vllm running but still downloading?
@nerdylive
I encountered this issue as well, particularly with endpoints created after the update. Has anyone filed a support ticket or found a solution for this?
15 replies
RRunPod
•Created by sandwich on 11/30/2024 in #⚡｜serverless
Why are requests waiting even with free workers?
That's exactly right—cold start workers were being selected. It seems that in such cases, the system prefers to wait for active workers to become available rather than immediately starting new ones...
Is there any way to force the system to spin up workers immediately in such scenarios?
6 replies