AKStriker98
CDCloudflare Developers
•Created by AKStriker98 on 6/4/2024 in #kv
Is there a way to deal with the
Just wanting to check if you found anything on this as the size of the “graveyard” does make filtering by prefixes in the dashboard relatively slow and have a lot of of the 30 item list only have a couple of entries
6 replies
CDCloudflare Developers
•Created by AKStriker98 on 6/7/2024 in #kv
Workers KV bulk reads
Following up to see if this example was helpful or if you need further information
4 replies
CDCloudflare Developers
•Created by AKStriker98 on 6/7/2024 in #kv
Workers KV bulk reads
I can’t say exactly on a public forum, but essentially it is a client in-browser that fires up a request to a worker to provide the processing power that the browser cannot provide. It uses 6 different KV stores that store simple information used to determine the action of the worker. The kv stores are split up for other workers and are fed data via a kv api call from local data centers.
I’m working on a way to optimize it to help prevent the chaining up problem that I’m having with the browser only allowing between 4-6 parallel requests up at a time by bundling the information and sending it in one request.
The problem is that a worker can only send 6 simultaneous requests at once. By my testing, a ramped up KV get request on these resources requires about a 50ms transmit delay. Very impressive, but I’m wanting to send batches of 200-300 items to be processed. The chaining of sending so many get requests to the KV stores makes the round trip a 2.5 second delay per batch leaving my tool to have up to a 12 second delay on a time sensitive process.
Does this help?
4 replies
CDCloudflare Developers
•Created by AKStriker98 on 6/4/2024 in #kv
Is there a way to deal with the
Thanks for looking into this, for our use case it’s fine since we do a direct read, but we wanted to put in a system to monitor to make sure if API keys expire again we get alerts on misalignment in the kv and local databases. This is where the listing would be helpful
6 replies
CDCloudflare Developers
•Created by AKStriker98 on 6/4/2024 in #kv
Is there a way to deal with the
And this is on worker binding and dashboard. The whole loop for the list doesn’t end because of the sheer amount of expired key-value pairs.
6 replies
CDCloudflare Developers
•Created by AKStriker98 on 6/4/2024 in #kv
Is there a way to deal with the
@thomasgauvin, sorry for the late response. The list is listing through expired items and returning a bunch of empty lists of keys with a new pointer. I’ve had this problem before with a logging system and had to do logs based on inverse time labeling to have the new logs appear before any expired logs
6 replies