vesper Comments - Answer Overflow

vesper

•Created by vesper on 2/1/2025 in #⚡｜serverless

Job Never Picked Up by a Worker but Received Execution Timeout Error and Was Charged

This is the part I am struggling with. On my end, I just got a timeout after 57 seconds but on the runpod console there was no logs for this request at all.

11 replies

RRunPod

•Created by vesper on 2/1/2025 in #⚡｜serverless

Job Never Picked Up by a Worker but Received Execution Timeout Error and Was Charged

It only happened once, but I am still in the testing phase. I want to make sure it doesn't happen when I go live in two weeks. I have a retry method for end users, but the main issue is that I am getting charged for these failed requests, which is a deal breaker. Do you provide any refunds if your worker causes this issue?

11 replies

RRunPod

•Created by Simon on 1/31/2025 in #⚡｜serverless

Serverless worker keeps failing

So it failed and set refresh_worker to true but the next request failed due to out of memory error?

7 replies

RRunPod

•Created by Simon on 1/31/2025 in #⚡｜serverless

Serverless worker keeps failing

I got this from here: https://docs.runpod.io/serverless/workers/handlers/handler-additional-controls

7 replies

RRunPod

•Created by Simon on 1/31/2025 in #⚡｜serverless

Serverless worker keeps failing

I am not sure if it will work in production but I added this to my code:

if torch.cuda.memory_allocated() / 1024**3 > 12:
  return {
      "refresh_worker": True,
      "job_results": {
          "status": "FAILED",
          "error": f"CUDA out of memory: {str(e)}"
      }
  }

if torch.cuda.memory_allocated() / 1024**3 > 12:
  return {
      "refresh_worker": True,
      "job_results": {
          "status": "FAILED",
          "error": f"CUDA out of memory: {str(e)}"
      }
  }

7 replies

RRunPod

•Created by vesper on 1/22/2025 in #⚡｜serverless

How do I calculate the cost of my last execution on a serverless GPU?

Ah, thanks.

3 replies

RRunPod

•Created by profondob1ue on 12/16/2024 in #⚡｜serverless

Incrase serverless worker count after 30.

Ok Thanks

12 replies

RRunPod

•Created by profondob1ue on 12/16/2024 in #⚡｜serverless

Incrase serverless worker count after 30.

@yhlong00000 what are the requirements of increasing workers to 50 and beyond?

12 replies

Gaming

Programming