R
RunPod2mo ago
Nicholas

Testing Async Handler Locally

Hi, I am trying to test the async handler locally. I am following the documentation very closely (attached is an example of something I tried). However, I cannot seem to get the /status/{job_id} endpoint to return anything while the job is in progress (I expected it to return IN_PROGRESS and perhaps the values that have thus far been yielded) -- that is, I recieve no response. I am testing locally by running the handler with the --rp_serve_api flag. Is there something I am doing wrong? Why can't I see the status of a job in progress? Thanks so much for the help!
No description
2 Replies
nerdylive
nerdylive2mo ago
maybe that async generator doesn't work locally try deploying it into a cpu/GPU endpoint and test it there
yhlong00000
yhlong000002mo ago
the /status won't work locally. You need to use /runsync to test locally
Want results from more Discord servers?
Add your server