How to get around the 10/20 MB payload limit?
For use cases such as training LoRAs with Stable Diffusion, where a user could upload tens of photos, 10/20MB is quite small. This is especially true because you have to convert an image to base64 before sending it to the endpoint, which will increase the size of each photo.
My app requires the user to upload photos of themselves for training purposes. And if I can't find a way around the 10 MB payload limit, I just realized I can't use runpod's serverless GPUs.
Are there any clever ways of getting around this payload limit?
Solution:Jump to solution
Upload your photos to cloud storage and your serverless workers can download from a link. The limits are fixed and there is no way around them, you must use a link to download the resources instead.
4 Replies
Solution
Upload your photos to cloud storage and your serverless workers can download from a link. The limits are fixed and there is no way around them, you must use a link to download the resources instead.
@ashleyk That's the best solution. Thank you
You can use the built in functions to download:
https://github.com/runpod/runpod-python/blob/main/runpod/serverless/utils/rp_download.py
GitHub
runpod-python/runpod/serverless/utils/rp_download.py at main · runp...
🐍 | Python library for RunPod API and serverless worker SDK. - runpod/runpod-python
for example I am using cloudinary to store images and I want it to use on my runpod, how can I know the ip or anything that I can whitelist on my cloudinary account. because I want to limit my cloudinary account to accept only request from my runpod serverless