Cloudflare Developers

CD

Cloudflare Developers

Welcome to the official Cloudflare Developers server. Here you can ask for help and stay updated with the latest news

Join

workers-help

pages-help

general-help

durable-objects

workers-and-pages-discussions

pages-discussions

wrangler

coding-help

kv

🦀rust-on-workers

miniflare

stream

general-discussions

functions

zaraz

âš¡instant-logs

email-routing

r2

pubsub-beta

analytics-engine

d1-database

queues

workers-for-platforms

workerd-runtime

web3

🤖turnstile

radar

web-research

logs-engine

cloudflare-go

terraform-provider-cloudflare

workers-ai

browser-rendering-api

logs-and-analytics

next-on-pages

cloudflare-ai

build-caching-beta

hyperdrive

vectorize

ai-gateway

python-workers-beta

vitest-integration-beta

workers-observability

workflows-beta

ajgeiss0702
ajgeiss0702
View on Discord
2/23/2025

Did the queues `sendBatch` api change?

Did the queues sendBatch api change? I've been running a worker in production for around 7 months now, and it has been working fine. The past few days (first occurance was Febuary 21st, 23:40 UTC, and the previous successful evocation was 23:10 UTC), i've suddenly been getting an error: sendBatch() requires at least one message I've added an additional check in my code to make sure the batch isnt empty to fix the issue, but I missed 2 days of data (that I cannot recover) before I noticed the issue....
HowlOftheSun
HowlOftheSun
View on Discord
2/17/2025

~~What would cause a queue to send the

What would cause a queue to send the same msg multiple times? Is there a timeout i might have set wrong? Errors cause retries.... 🤦 which cause more errors 🤦 🤦
scotto
scotto
View on Discord
2/17/2025

thanks, any plans to increase those

thanks, any plans to increase those limits?
scotto
scotto
View on Discord
2/17/2025

Build software better, together

setting this in queues consumer 
[[queues.consumers]]
queue = "gopersonal-llm-ranking-queue"
max_batch_size = 100
max_batch_timeout = 180
max_concurrency = 1
[[queues.consumers]]
queue = "gopersonal-llm-ranking-queue"
max_batch_size = 100
max_batch_timeout = 180
max_concurrency = 1
and getting the error...
Pranshu Maheshwari
Pranshu Maheshwari
View on Discord
2/14/2025

Customize queue message retention period...

A quick feature update to share: you can now customize the retention period for a queue https://developers.cloudflare.com/changelog/2025-02-14-customize-queue-retention-period/
EndiM
EndiM
View on Discord
2/13/2025

Hello. What would the average queue

Hello. What would the average queue backlog be, on a healthy queue? Our right now keeps on being 760, with a delayed backlog of around 530..
Brett Willis
Brett Willis
View on Discord
2/12/2025

Feature request: would be nice to be

Feature request: would be nice to be able to message set expiry (max age and/or max retries) at the message level. We have a scenario where some messages are important to be processed eventually, and some messages should be discarded if not processed within a certain timeframe....
EndiM
EndiM
View on Discord
2/6/2025

Hello. Is there an issue on the queues

Hello. Is there an issue on the queues right now? Our queue has around 500 messages in the backlog. Started 15 minutes ago.
pat
pat
View on Discord
2/2/2025

Also is there a way to flush a queue? My

Also is there a way to flush a queue? My queue grows much quicker than I consume it so once I have enough data I'd like to just flush all the messages to save the cpu time of consuming to ignore them
pat
pat
View on Discord
2/2/2025

Hey guys, is there any problem with

Hey guys, is there any problem with recursive queue consumers/producers? I have a consumer that produces to the same queue it consumes from and it seems like metrics are significantly delayed. That said though, my queue jobs do take ~30s to run each and can only run one at a time by design. Perhaps it takes some time for a new deployment to be hooked up as I'm testing some stuff and deploying pretty often. I can see that the queue I am using is increasing in size and my db is getting new data so it is consuming and producing. It seems that as soon as I stop producing to the same queue I am consuming from, the metrics return Another question that I am struggling to find any information on is how to interpret the execution duration GB-sec value on workers. What does this mean?...
Mitya
Mitya
View on Discord
1/30/2025

Is there a preferred way to simulate

Is there a preferred way to simulate queues locally with the remote flag? Sort of like the __schedule query string arg for testing CRON schedules locally.
flof.fly
flof.fly
View on Discord
1/26/2025

How do I increase the max concurrency

How do I increase the max concurrency workers to 500 (the maximum) when polling messages from Queue?
pat
pat
View on Discord
1/26/2025

Hey all, wondering if theres a way to

Hey all, wondering if theres a way to set a limit on the number of requests to a worker over a given period of time before it starts rejecting new requests? If I can avoid implementing it myself that'd be great
rivage
rivage
View on Discord
1/23/2025

Hey there, my Queue has had a

Hey there, my Queue has had a concurrency of 3 for the last 12 hours. Failure rate is low. Maximum concurrency is 250. Any ideas on how to increase this?
Brett Willis
Brett Willis
View on Discord
1/23/2025

I've had to disconnect the queue

I've had to disconnect the queue consumer in my application to effectively pause a certain processing pipeline while I sort out a bug. As the messages accumulate in the queue without a consumer, will they safely stay around until I resume (until the 96hr retention period)?...
sup filistine
sup filistine
View on Discord
1/19/2025

Queue retries not happening consistently with either message or global retry_delay wrangler setting

i saw this same behavior yesterday. curious what’s up. i didn’t pass an explicit retry delaySeconds for the message, just an empty .retry(), and was hoping it will respect the retry_delay configured under the wrangler consumer section. will do some more tests today
xintercept
xintercept
View on Discord
1/15/2025

anyone else run into problems with

anyone else run into problems with queues today? we hit a bunch of "Queue send failed: Service Temporarily Unavailable" around 2025-01-14T19:51:06.333Z
John Spurlock
John Spurlock
View on Discord
1/12/2025

yes, and through the dashboard - the

yes, and through the dashboard - the config seems correct, it's similar to a prod dlq queue in that same account which works fine - it's just that queue 8c720189e5c54eefa03f53eefb7162f1 that gives messages cannot be pulled unless http_pull mode is enabled. I even tried previewing and deleting the 3 messages in there, didn't help
slagathor
slagathor
View on Discord
1/10/2025

I currently have a queue setup where the

I currently have a queue setup where the consumer worker initiates a CSV download from an API, continues to poll the API until the CSV is available, downloads the CSV, and then stores it in R2. Right now only 2 messages are getting sent to the queue at a time (via a cron job at the top of every hour), but only the first one ever gets processed (it's processed to completion). Could this be a CPU limit issue? I don't see any error logs. These are my current .toml settings:...
jacky
jacky
View on Discord
1/9/2025

guys i got over an hour of consumer

guys i got over an hour of consumer delay, is this normal?
No description
Next