Ben
Ben
RRunPod
Created by Ben on 12/7/2024 in #⚡|serverless
Serverless request returns None from python client but web status says completed successfully
My specific error had to do with how I handed null vals
19 replies
RRunPod
Created by Ben on 12/7/2024 in #⚡|serverless
Serverless request returns None from python client but web status says completed successfully
I found the solution - basically my output could be written to JSON in python but whatever service in runpod that calls the serverless endpoint and forwards to the users (idk the names for all services in internal runpod arch) could NOT read it as valid JSON I fixed it, but, as a developer id like to see 1) an error message 2) a 500 error not a 400 error
19 replies
RRunPod
Created by Ben on 12/6/2024 in #⚡|serverless
Can't make serverless endpoints from GHCR container with new Runpod website update
Ok, update, this only sortof works? This morning I created a new severless endpoint no problem, was able to use a serverless template. Now just a few hours later going to custom source > docker image > and the templates dropdown has nothing.
6 replies
RRunPod
Created by Ben on 12/7/2024 in #⚡|serverless
Serverless request returns None from python client but web status says completed successfully
I just pushed a new docker image version with more logging in my handler.py... including a print statement at the very end of my handler. Im getting these logs: The first line here is my own code's success message that gets printed at the very end of the handler
2024-12-07T21:11:02.666019804Z Finished processing video
2024-12-07T21:11:02.666028688Z {"requestId": "sync-404d83ab-3710-49c1-9fda-b0900d70814a-u1", "message": "Failed to return job results. | 400, message='Bad Request', url='https://api.runpod.ai/v2/182hdt7pnz6xwx/job-done/l39e5w9ar6se5j/sync-404d83ab-3710-49c1-9fda-b0900d70814a-u1?gpu=NVIDIA+RTX+A4000&isStream=false'", "level": "ERROR"}
2024-12-07T21:11:02.666040220Z {"requestId": "sync-404d83ab-3710-49c1-9fda-b0900d70814a-u1", "message": "Finished.", "level": "INFO"}
2024-12-07T21:11:02.666019804Z Finished processing video
2024-12-07T21:11:02.666028688Z {"requestId": "sync-404d83ab-3710-49c1-9fda-b0900d70814a-u1", "message": "Failed to return job results. | 400, message='Bad Request', url='https://api.runpod.ai/v2/182hdt7pnz6xwx/job-done/l39e5w9ar6se5j/sync-404d83ab-3710-49c1-9fda-b0900d70814a-u1?gpu=NVIDIA+RTX+A4000&isStream=false'", "level": "ERROR"}
2024-12-07T21:11:02.666040220Z {"requestId": "sync-404d83ab-3710-49c1-9fda-b0900d70814a-u1", "message": "Finished.", "level": "INFO"}
19 replies
RRunPod
Created by Ben on 12/7/2024 in #⚡|serverless
Serverless request returns None from python client but web status says completed successfully
I found 1 thread online when searching for that error and the github issue is still open
19 replies
RRunPod
Created by Ben on 12/7/2024 in #⚡|serverless
Serverless request returns None from python client but web status says completed successfully
but I see them in my working endpoint as well so I didn't really worry
19 replies
RRunPod
Created by Ben on 12/7/2024 in #⚡|serverless
Serverless request returns None from python client but web status says completed successfully
Im also seeing these in my logs:
"message":"Failed to return job results. | 400, message='Bad Request', url='https://api.runpod.ai/v2/<ENDPOINT_ID>/job-done/4v7s7hbe3u4a52/a6a0096f-c893-45d7-bb2a-a78a75867edf-u1?gpu=NVIDIA+RTX+4000+Ada+Generation&isStream=false'"
"message":"Failed to return job results. | 400, message='Bad Request', url='https://api.runpod.ai/v2/<ENDPOINT_ID>/job-done/4v7s7hbe3u4a52/a6a0096f-c893-45d7-bb2a-a78a75867edf-u1?gpu=NVIDIA+RTX+4000+Ada+Generation&isStream=false'"
19 replies
RRunPod
Created by Ben on 12/7/2024 in #⚡|serverless
Serverless request returns None from python client but web status says completed successfully
my entrypoint on my docker image is CMD [ "python3", "-u", "/handler.py" ]
19 replies
RRunPod
Created by Ben on 12/7/2024 in #⚡|serverless
Serverless request returns None from python client but web status says completed successfully
ok so my inference script (run.py) is running on my laptop and is just using the runpod-python client to make a request with a sample video, call my serverless endpoint, and show the results. When I use my "release" endpoint, it works great. When I change the runpod endpoint ID to my "staging" endpoint im getting this issue
19 replies
RRunPod
Created by Ben on 12/7/2024 in #⚡|serverless
Serverless request returns None from python client but web status says completed successfully
My execution timeout is 600s
19 replies
RRunPod
Created by Ben on 12/7/2024 in #⚡|serverless
Serverless request returns None from python client but web status says completed successfully
the TLDR of my confusion and frustration is why isn't there an error message from either the runpod service or runpod pythong client!?
19 replies
RRunPod
Created by Ben on 12/7/2024 in #⚡|serverless
Serverless request returns None from python client but web status says completed successfully
My endpoint accepts a video, and trying with a differe shorter video it also terminates arbitrarily in the middle of its progress
19 replies
RRunPod
Created by Ben on 12/7/2024 in #⚡|serverless
Serverless request returns None from python client but web status says completed successfully
more info: This is my "staging endpoint" for a project im working on. I have an older version of my image in a different endpoint working flawlessly, so theres no crazy CICD / docker image related changes that I could attribute this to
19 replies
RRunPod
Created by Ben on 12/6/2024 in #⚡|serverless
Can't make serverless endpoints from GHCR container with new Runpod website update
excellent ty everyone
6 replies