Some updates for @Queues users:
Some updates for @Queues users:
- We're working on landing HTTP Pull, which will allow you to poll a queue and consume it from outside of a Worker (or use a Worker in a poll-based flow vs. push-based). This will likely land just before/just after the holidays.
- Queue throughput: our major milestone is about 3-5k msg/sec per queue (message size plays a role here), up from the ~400 msg/sec/queue currently
- We're also working on landing controls around setting message delays - e.g.
await env.MY_QUEUE.send(msg, { deliveryDelay: 600 }) on the producer side, and retry delays on the consumer side - e.g. messages.batch.retryAfter(300) or .retryAfter(seconds: number) on a per-message basis. API not final.
- Bringing Queues to GA late Q1/early Q2 next year alongside other scaling and performance improvements.12 Replies
Hi @Matt do you think the
delay feature will be out sometime soon? Similar timeline as HTTP pull?really great, looking forward to finishing our migration to cloudflare queues, with the increased throughput coming soon.
is there any news on partitioning? mainly to have concurrency per some sort of group key in a single queue @Matt
Right now we are focusing on HTTP Pull + Message Delay controls + per-queue throughput before anything else.
Per the pinned message: https://discord.com/channels/595317990191398933/1008691665688604783/1174739796116131920
Is there a beta version that is available by chance? Looking for the
delay functionality similar to @trogdorCan this retryAfter be tried yet? Would be super useful 🙏
also very interested in delaying messages, any news/eta?
also http pull wouldn't yet allow to publish messages via http from outside a worker right?
When will HTTP pull rollout? I would like to replace SQS by Queues 😂
Soon - in the next 2-3 weeks.
You can write a very small Worker - since a Worker can accept HTTP requests - for that today: https://developers.cloudflare.com/queues/examples/publish-to-a-queue-over-http/
Cloudflare Docs
Queues - Publish Directly via HTTP · Cloudflare Queues
The following example shows you how to publsh messages to a queue from any HTTP client, using a shared secret to securely authenticate the client.
Wow, thanks. We can consume the message outside Worker now :facehappy: