yassinemenace
RRunPod
•Created by yassinemenace on 8/9/2024 in #⚡｜serverless
Timeout Error even if higher timeout it set
I set timeout to 1200 second altough when running the request i get {
"delayTime": 36534,
"error": "ReadTimeout: HTTPConnectionPool(host='127.0.0.1', port=5000): Read timed out. (read timeout=600)",
"executionTime": 601182,
"id": "a2bf98f6-2201-44ea-9710-d588521fda45-e1",
"status": "FAILED",
"rp_handler": "Error in run_inference function",
"rp_job": "Error in run_job function"
} TTPConnectionPool(host='127.0.0.1', port=5000): Read timed out. (read timeout=600)\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File \"/opt/venv/lib/python3.10/site-packages/runpod/serverless/modules/rp_job.py\", line 132, in run_job\n handler_return = handler(job)\n File \"/rp_handler.py\", line 61, in handler\n json = run_inference({\"input\": event[\"input\"]})\n File \"/rp_handler.py\", line 48, in run_inference\n response = cog_session.post(url=f'{LOCAL_URL}/predictions',\n File \"/opt/venv/lib/python3.10/site-packages/requests/sessions.py
2 replies
RRunPod
•Created by yassinemenace on 8/8/2024 in #⚡｜serverless
whisper
I built docker using official github runpod and i get 024-08-08T20:20:40.508212050Z {"requestId": null, "message": "{\n "error_type": "<class 'RuntimeError'>",\n "error_message": "Library libcublas.so.12 is not found or cannot be loaded",\n "error_traceback": "Traceback (most recent call last):\n File \"/usr/local/lib/python3.10/dist-packages/runpod/serverless/modules/rp_job.py\", line 134, in run_job\n handler_return = handler(job)\n File \"/usr/local/lib/python3.10/dist-packages/runpod/serverless/utils/rp_debugger.py\", line 165, in call\n result = self.function(*args, **kwargs)\n File \"/rp_handler.py\", line 72, in run_whisper_job\n whisper_results = MODEL.predict(\n File \"/predict.py\", line 76, in predict\n segments, info = list(model.transcribe(str(audio),\n File \"/usr/local/lib/python3.10/dist-packages/faster_whisper/transcribe.py\", line 344, in transcribe\n encoder_output = self.encode(segment)\n File \"/usr/local/lib/python3.10/dist-packages/faster_whisper/transcribe.py\", line 767, in encode\n return self.model.encode(features, to_cpu=to_cpu)\nRuntimeError: Library libcublas.so.12 is not found or cannot be loaded\n",\n "hostname": "08h82mdvx3cl2d-64411542",\n "worker_id": "08h82mdvx3cl2d",\n "runpod_version": "1.6.2"\n}", "level": "ERROR"} here is the git i used https://github.com/runpod-workers/worker-faster_whisper
2 replies