Queues Throttling
Hi, I am new to serverless, so I am not familiar with design patterns (I'd love to hear where can I learn more of this). I am wondering what's the best way to throttle API calls.
Let's say I am using thirdparty API endpoints, one which lists all of the objects and the other query an object. My goal is to list all of them, push them into a queue, then have a consumer slowly querying each object, without finishing them as fast as possible in one goal.
Is using "delay messages" the way to go? Assigning different delays while pushing them to the queue to achieve throttling?
delay messages: https://developers.cloudflare.com/queues/configuration/batching-retries/#delay-messages
I am using rust if that's relevant.
Cloudflare Docs
Batching, Retries and Delays · Cloudflare Queues
When configuring a consumer Worker for a queue, you can also define how messages are batched as they are delivered.
0 Replies