well I could also try that from my

well, I could also try that from my backend (without workers) but my experience (maybe I am just stupid) was that the file is buffered entirely due to the client uploading faster than the r2/s3 connection being build up + posted

divby0OP•7/27/22, 12:29 PM

@kian do you get what I mean? Maybe you have some ideas here, because streaming would be ideal.

kian•7/27/22, 12:30 PM

How streaming is implemented on a application/network level is beyond me - a question for someone much smarter than myself haha

I don't think it's particularly avoidable in your case. If users aren't uploading the file but rather giving it to you to upload, you'll always need to have the file yourself I suppose

divby0OP•7/27/22, 12:32 PM

yes, that's what I fear will also happen to the workers. I think I'll just try with the memory held option and a small file size limit

kian•7/27/22, 12:32 PM

What issue do you think will happen with Workers?

kian•7/27/22, 12:32 PM

It'd be the same as presigned except instead of the presigned URL, you give them the Worker URL

Kkian It'd be the same as presigned except instead of the presigned URL, you give them...

divby0OP•7/27/22, 12:36 PM

The worker would have to buffer the whole uploaded file probably before being able to upload it

kian•7/27/22, 12:37 PM

I don't see why

kian•7/27/22, 12:37 PM

Cloudflare's earlier 'layers' of webserver might do but the Worker will have no issues since it's not being buffered into the Worker's memory

kian•7/27/22, 12:38 PM

https://developers.cloudflare.com/workers/learning/using-streams/

divby0OP•7/27/22, 12:43 PM

Yes I am currently trying that but on my normal backend. Seems like with http2 there are some possibilities of real streaming