Maximum size of single output for streaming handlers
We are currently trying to refactor our RunPod handlers to work asynchronously with streaming of results. Unfortunately, we ran into this error when trying to yield result images:
After some trial and error, it seems to be related to the payload size with the limit set somewhere around 100 KB, although this doesn't seem to be documented anywhere. Since we want to stream the outputs of an image generation model, this constraint would pretty much destroy our efforts and nullify the use for generative image models.
What is the actual payload size limit and is there a workaround for streaming images, possibly larger than 1 MB?
2 Replies
Hmm, i dont think there is a payload size limit im trying it on like 9Mbs+ still works fine
Heres the limits for it:
https://docs.runpod.io/serverless/references/operations
Ill cite it here:
* /run: Asynchronous endpoint for submitting jobs. Returns a unique Job ID.
Payload capacity: 10 MB
...
Job availability: Job results are accessible for 30 minutes after completion
* /runsync: Synchronous endpoint for shorter running jobs, returning immediate results.
Payload capacity: 20 MB
...
Endpoint operations | RunPod Documentation
Comprehensive guide on interacting with models using RunPod's API Endpoints without managing the pods yourself.