tzar_impersonator
tzar_impersonator
PostsComments
RRunPod
Created by tzar_impersonator on 1/7/2025 in #⚡｜serverless
no compatible serverless GPUs found while following tutorial steps
hey, thanks for your help. my best guess is that the pod hadn't initialised properly or something when i ran it the first time. it started working perfectly on the 2nd try
9 replies
RRunPod
Created by tzar_impersonator on 1/7/2025 in #⚡｜serverless
no compatible serverless GPUs found while following tutorial steps
the latest weird stuff that i've seen was this response to a request 
{
  "delayTime": 7579,
  "error": "model \"orca-mini:3b\" not found, try pulling it first",
  "executionTime": 2749,
  "id": "2858b743-fc92-43df-bc93-4ad6cb67ca25-e1",
  "status": "FAILED",
  "workerId": "j2fos5d965rol9"
}
{
  "delayTime": 7579,
  "error": "model \"orca-mini:3b\" not found, try pulling it first",
  "executionTime": 2749,
  "id": "2858b743-fc92-43df-bc93-4ad6cb67ca25-e1",
  "status": "FAILED",
  "workerId": "j2fos5d965rol9"
}
9 replies
RRunPod
Created by tzar_impersonator on 1/7/2025 in #⚡｜serverless
no compatible serverless GPUs found while following tutorial steps
update 2 - this was caused by my not following the tutorial properly. i wasn't using the appropriate request
9 replies
RRunPod
Created by tzar_impersonator on 1/7/2025 in #⚡｜serverless
no compatible serverless GPUs found while following tutorial steps
update - having moved to 4vCPUs, i instead get this error message in the logs when i send a request 
2025-01-07T22:27:28.942725265Z verifying sha256 digest
2025-01-07T22:27:28.942728975Z writing manifest
2025-01-07T22:27:28.942730835Z removing any unused layers
2025-01-07T22:27:28.942733695Z success 
2025-01-07T22:27:31.218137093Z --- Starting Serverless Worker |  Version 1.6.2 ---
2025-01-07T22:27:31.511124984Z {"requestId": "2e61a451-6bb4-4fbc-b83b-415bfa5423e6-e1", "message": "Started.", "level": "INFO"}
2025-01-07T22:27:31.512377468Z {"requestId": "2e61a451-6bb4-4fbc-b83b-415bfa5423e6-e1", "message": "Captured Handler Exception", "level": "ERROR"}
2025-01-07T22:27:31.512648227Z {"requestId": null, "message": "{\n    \"error_type\": \"<class 'KeyError'>\",\n    \"error_message\": \"'input'\",\n    \"error_traceback\": \"Traceback (most recent call last):\\n  File \\\"/usr/local/lib/python3.10/dist-packages/runpod/serverless/modules/rp_job.py\\\", line 134, in run_job\\n    handler_return = handler(job)\\n  File \\\"//runpod_wrapper.py\\\", line 26, in handler\\n    input[\\\"input\\\"][\\\"stream\\\"] = False\\nKeyError: 'input'\\n\",\n    \"hostname\": \"j2fos5d965rol9-6441166f\",\n    \"worker_id\": \"j2fos5d965rol9\",\n    \"runpod_version\": \"1.6.2\"\n}", "level": "ERROR"}
2025-01-07T22:27:31.669738576Z {"requestId": "2e61a451-6bb4-4fbc-b83b-415bfa5423e6-e1", "message": "Finished.", "level": "INFO"}
2025-01-07T22:27:28.942725265Z verifying sha256 digest
2025-01-07T22:27:28.942728975Z writing manifest
2025-01-07T22:27:28.942730835Z removing any unused layers
2025-01-07T22:27:28.942733695Z success 
2025-01-07T22:27:31.218137093Z --- Starting Serverless Worker |  Version 1.6.2 ---
2025-01-07T22:27:31.511124984Z {"requestId": "2e61a451-6bb4-4fbc-b83b-415bfa5423e6-e1", "message": "Started.", "level": "INFO"}
2025-01-07T22:27:31.512377468Z {"requestId": "2e61a451-6bb4-4fbc-b83b-415bfa5423e6-e1", "message": "Captured Handler Exception", "level": "ERROR"}
2025-01-07T22:27:31.512648227Z {"requestId": null, "message": "{\n    \"error_type\": \"<class 'KeyError'>\",\n    \"error_message\": \"'input'\",\n    \"error_traceback\": \"Traceback (most recent call last):\\n  File \\\"/usr/local/lib/python3.10/dist-packages/runpod/serverless/modules/rp_job.py\\\", line 134, in run_job\\n    handler_return = handler(job)\\n  File \\\"//runpod_wrapper.py\\\", line 26, in handler\\n    input[\\\"input\\\"][\\\"stream\\\"] = False\\nKeyError: 'input'\\n\",\n    \"hostname\": \"j2fos5d965rol9-6441166f\",\n    \"worker_id\": \"j2fos5d965rol9\",\n    \"runpod_version\": \"1.6.2\"\n}", "level": "ERROR"}
2025-01-07T22:27:31.669738576Z {"requestId": "2e61a451-6bb4-4fbc-b83b-415bfa5423e6-e1", "message": "Finished.", "level": "INFO"}
9 replies
RRunPod
Created by tzar_impersonator on 1/7/2025 in #⚡｜serverless
no compatible serverless GPUs found while following tutorial steps
i'm using 2vCPUs with 5GB of storage space
9 replies