Testing Async Handler Locally
Hi,
I am trying to test the async handler locally. I am following the documentation very closely (attached is an example of something I tried). However, I cannot seem to get the /status/{job_id} endpoint to return anything while the job is in progress (I expected it to return IN_PROGRESS and perhaps the values that have thus far been yielded) -- that is, I recieve no response. I am testing locally by running the handler with the --rp_serve_api flag.
Is there something I am doing wrong? Why can't I see the status of a job in progress?
Thanks so much for the help!
2 Replies
maybe that async generator doesn't work locally
try deploying it into a cpu/GPU endpoint and test it there
the /status won't work locally. You need to use /runsync to test locally