Are stream endpoints not working?
This is a temp endpoint just to show you all.
/stream isn't available, what's up?
1 Reply
Potentially nevermind, I think I understand now... You start an async job with run, then get the id from that, and retrieve the results with stream/{job_id}
Based off of testing this in Postman, I don't think this supports actual streaming, or am I mistaken?
I need these endpoints for LLMs for use with a FE application and I want to literally stream tokens
text/event-stream style, is that supported?