Satpal
RRunPod
•Created by Satpal on 5/8/2024 in #⚡｜serverless
Serverless Error Kept Pod Active
I have a LLM deployed on runpod serverless.
Due to a certain error that occurred after a request:
The pod got stuck on {"requestId": null, "message": "Failed to get job, status code: 502", "level": "ERROR"}
This kept pod active and therfore caused me to lose money.
Shouldn't pod deactivate automatically in case of errors after certain time?
51 replies