daniel_klungo
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
thank you for your time and help, hope you have a great weekend Thomas!
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
I think this was a blessing in disguise either way, as it affected only a very few users, and now you made me aware of something that might've been a bigger issue down the road. it's not unimaginable that we could be hitting the 1200/5min limit in just some months 🙂
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
roger!
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
I don't really need the bulk writing API since it's just a max of 20 keys
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
I'll create another endpoint in the Worker that handles adding the values to KV as well — at least that way we're pretty much guaranteed not to be rate-limited no matter what load we'll see in the future
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
I don't think it's necessarily important, but I'm writing keys to KV for all image variants that should be allowed, then I have a Worker that handles image requests, and if a variant is not in R2, it will check KV if it's allowed, and if it is will use Image Resizing to create the variant
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
I'm bulk writing 1-20 keys
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
so what you're suggesting is just doing a single write per key, perhaps throttling so I don't go above the maximum concurrent subrequest limit?
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
I think this is why I ended up using the API in the first place https://developers.cloudflare.com/kv/api/write-key-value-pairs/#write-data-in-bulk
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
ah, it doesn't support it if I understand correctly
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
haven't used the bulk api from a worker though
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
oh ofc not, just using it directly
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
thank you for confirming!
are you saying that a Worker does not have this rate limiting?
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
first error was at 10:51:31 UTC yesterday
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
timestamp in my screenshot is not UTC btw, apologies
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
429
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
I think with the dynos we have we're sharing IPs
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
I guess? ¯\_(ツ)_/¯
37 replies
CDCloudflare Developers
•Created by daniel_klungo on 11/15/2024 in #kv
Perhaps I'm not being clear enough —
that would explain why it disappeared after another restart, and also why this has been running in production, with much heavier load than what we had during this period, for several months without issue
37 replies