streaming
i'm used to using openai to stream text all in one request that is done async. why does runpod just spam requests for the /stream endpoint instead of making it one request and feeding data as it's generated?
3 Replies
deadass why yall doing that fr
theres gotta be a way
i spent an hour setting up streaming thinking yall were actually streaming the data live ðŸ˜