Fimbul
RRunPod
•Created by Fimbul on 7/12/2024 in #⚡|serverless
Stream using ReadableStream (SSE - Server Sent Events)
Answering my own question for posterity:
No, this is not supported, you have to poll the
/stream
endpoint, but this is not so bad, because it is blocking, meaning it will wait until a chunk arrives and reply immediately7 replies