Tomi
RRunPod
•Created by nikolai on 12/15/2024 in #⚡｜serverless
Consistently timing out after 90 seconds
32 replies
RRunPod
•Created by nikolai on 12/15/2024 in #⚡｜serverless
Consistently timing out after 90 seconds
32 replies
RRunPod
•Created by nikolai on 12/15/2024 in #⚡｜serverless
Consistently timing out after 90 seconds
32 replies
RRunPod
•Created by nikolai on 12/15/2024 in #⚡｜serverless
Consistently timing out after 90 seconds
We’re using the OpenAI path https://api.runpod.ai/v2/:pod_id/openai/v1/chat/completions, but the connection keeps closing after a minute. We tried deploying a new worker today in case the changes hadn’t been applied, but we’re still facing the same issue. I’m attaching a screenshot of a Postman request. Is there any new configuration we should consider when deploying a new worker?
32 replies
RRunPod
•Created by nikolai on 12/15/2024 in #⚡｜serverless
Consistently timing out after 90 seconds
sure! we’ve been experiencing issues with the timeout mentioned in this thread. the Runpod response stops after 1 minute while using streaming for the response, and in some cases, I don’t get the complete response for the request.
32 replies
RRunPod
•Created by nikolai on 12/15/2024 in #⚡｜serverless
Consistently timing out after 90 seconds
Hey, how are you? Just checking in to see if there’s any update on this. We’ve been running into issues with the timeout
32 replies
RRunPod
•Created by Tomi on 6/27/2024 in #⚡｜serverless
Error Handling Issue: Updating Response Status in Python’s Runpod
Thanks for the answers, I was guiding me by the runpod doc https://docs.runpod.io/serverless/workers/handlers/handler-error-handling to implement a custom error response. I going to keep trying.
7 replies