fredericp5433
fredericp5433
RRunPod
Created by Concept on 2/1/2024 in #⚡|serverless
VLLM Worker Error that doesn't time out.
I have the same problem. I think the problem is here: File "/usr/local/lib/python3.10/dist-packages/runpod/serverless/modules/rp_logger.py", line 81, in log print(json.dumps(log_json), flush=True) when log_json is not serializable, it fails to report the error and keeps the worker running.
10 replies