R
RunPod3w ago
zaid

Is it possible to response with Transfer-Encoding: Chunked

Hello, I'm using serverless endpoints. Currently return a JSON object. Is it possible to lets say directly return a wav file with Transfer-Encoding chunked So the response headers would be Content-Type: audio/wav Transfer-Encoding: chunked this would be different from SSE as it's just writing it back in the response stream as the chunk is generated.
4 Replies
flash-singh
flash-singh3w ago
we have a new type of serverless coming out in a month which will allow you bring any http server, so yes then you can stream http responses as you like from a http server running in your workers, let me know if you want to give this a try, its being tested currently in production
zaid
zaidOP3w ago
yes please, would love give it a try. What do you need from me?
Jason
Jason3w ago
create a new endpoint and maybe send the endpoint id
flash-singh
flash-singh3w ago
pm me endpoint id, here is vllm example you can see https://github.com/pandyamarut/vllm-load-balancer

Did you find this page helpful?