River
River
RRunPod
Created by Cl0n0s on 1/4/2025 in #⚡|serverless
Error starting container on serverless endpoint
if you could reach back to me with the appropriate details, that would help me out quite a bit!
8 replies
RRunPod
Created by Cl0n0s on 1/4/2025 in #⚡|serverless
Error starting container on serverless endpoint
Hey, I have replied to you in the zendesk ticket
8 replies
RRunPod
Created by nerdylive on 12/6/2024 in #⚡|serverless
Serverless vllm running but still downloading?
would you just be able to always use the network volume hre?
15 replies
RRunPod
Created by nerdylive on 12/6/2024 in #⚡|serverless
Serverless vllm running but still downloading?
Yup that should work, Keep it in the same data centre as uh the network volume
15 replies
RRunPod
Created by nerdylive on 12/6/2024 in #⚡|serverless
Serverless vllm running but still downloading?
I'll speak to the team about optimizing this behavior, but this is an edge case do we likely will take some time to do this. Nonetheless, the downloading new data occurs because we need to change all the Workers to be only from the data center connected to the network volume.
15 replies
RRunPod
Created by nerdylive on 12/6/2024 in #⚡|serverless
Serverless vllm running but still downloading?
Hi there. This is not optimized behavior, but it is expected behavior., Since when you switch to using a network volume, all the running containers need to be removed, and need to be changed to be from the same data center the network volume is in
15 replies
RRunPod
Created by smile^v^ on 5/15/2024 in #⚡|serverless
how to expose my own http port and keep the custom HTTP response?
I would recommend trial/error here, but I don't believe so
17 replies
RRunPod
Created by smile^v^ on 5/15/2024 in #⚡|serverless
how to expose my own http port and keep the custom HTTP response?
yeah, this should work
17 replies
RRunPod
Created by smile^v^ on 5/15/2024 in #⚡|serverless
how to expose my own http port and keep the custom HTTP response?
You mean get the port
17 replies
RRunPod
Created by smile^v^ on 5/15/2024 in #⚡|serverless
how to expose my own http port and keep the custom HTTP response?
Hi there Smile, could you clairfy your comment here further please?
17 replies
RRunPod
Created by smile^v^ on 5/15/2024 in #⚡|serverless
how to expose my own http port and keep the custom HTTP response?
Hi there, we currently do not support options for this at the moment
17 replies
RRunPod
Created by andyh3118 on 3/5/2024 in #⚡|serverless
Hi, is there currently an outage to Serverless API?
it appears to be broken
39 replies
RRunPod
Created by andyh3118 on 3/5/2024 in #⚡|serverless
Hi, is there currently an outage to Serverless API?
i think you need to debug your docker image here
39 replies
RRunPod
Created by Chanchana on 12/25/2023 in #⚡|serverless
How do I estimate completion time (ETA) of a job request?
@Chanchana you can use the /health endpoint for this https://docs.runpod.io/docs/serverless-endpoint-urls#health
29 replies