11 Replies
increasing limits is always on our list 🙂 too soon to provide a timeline here though. curious, what are you using Queues & workers for? how would larger batches help?
Great, in this case we it for storing data for model fine tuning, we receive data via API queue and process to store as batchs of jsonl
Those jsonl ends in R2
1000 would be nice for our use case
similar in my case: lots of little requests coming in and getting queued, with the batch queue handler doing aggregate updates/inserts to R2. So increasing the batch limit translates directly to lower R2 put costs, 1000msg/2560kb would be fantastic
@scotto any chance you'd be interested in something new we're building? Quick sneak preview here
If yes, send me your account ID and I can get you setup (safe to share here)
it should make it much easier for you to build larger files in R2!
Would love to have access to that
could you send me your account ID @scotto? I'll get you enabled right away
here it's 920b1a6e159cf77dab28969103a4765b
just sent you an email with details @scotto 🙂
Unknown User•2mo ago
Message Not Public
Sign In & Join Server To View
For sure - send me over your account ID or feel free to send me an email to pranshu @ cloudflare
Unknown User•2mo ago
Message Not Public
Sign In & Join Server To View