Is it possible to response with Transfer-Encoding: Chunked
Hello, I'm using serverless endpoints. Currently return a JSON object. Is it possible to lets say directly return a wav file with Transfer-Encoding chunked
So the response headers would be
Content-Type: audio/wav
Transfer-Encoding: chunked
this would be different from SSE as it's just writing it back in the response stream as the chunk is generated.
4 Replies
we have a new type of serverless coming out in a month which will allow you bring any http server, so yes then you can stream http responses as you like from a http server running in your workers, let me know if you want to give this a try, its being tested currently in production
yes please, would love give it a try. What do you need from me?
create a new endpoint and maybe send the endpoint id
pm me endpoint id, here is vllm example you can see https://github.com/pandyamarut/vllm-load-balancer