Cloudflare Developers

CD

Cloudflare Developers

Welcome to the official Cloudflare Developers server. Here you can ask for help and stay updated with the latest news

Join

~~What would cause a queue to send the

What would cause a queue to send the same msg multiple times? Is there a timeout i might have set wrong? Errors cause retries.... 🤦 which cause more errors 🤦 🤦

thanks, any plans to increase those

thanks, any plans to increase those limits?

Build software better, together

setting this in queues consumer
[[queues.consumers]]
queue = "gopersonal-llm-ranking-queue"
max_batch_size = 100
max_batch_timeout = 180
max_concurrency = 1
[[queues.consumers]]
queue = "gopersonal-llm-ranking-queue"
max_batch_size = 100
max_batch_timeout = 180
max_concurrency = 1
and getting the error...

Hello. What would the average queue

Hello. What would the average queue backlog be, on a healthy queue? Our right now keeps on being 760, with a delayed backlog of around 530..

Feature request: would be nice to be

Feature request: would be nice to be able to message set expiry (max age and/or max retries) at the message level. We have a scenario where some messages are important to be processed eventually, and some messages should be discarded if not processed within a certain timeframe....

Hello. Is there an issue on the queues

Hello. Is there an issue on the queues right now? Our queue has around 500 messages in the backlog. Started 15 minutes ago.

Also is there a way to flush a queue? My

Also is there a way to flush a queue? My queue grows much quicker than I consume it so once I have enough data I'd like to just flush all the messages to save the cpu time of consuming to ignore them

Hey guys, is there any problem with

Hey guys, is there any problem with recursive queue consumers/producers? I have a consumer that produces to the same queue it consumes from and it seems like metrics are significantly delayed. That said though, my queue jobs do take ~30s to run each and can only run one at a time by design. Perhaps it takes some time for a new deployment to be hooked up as I'm testing some stuff and deploying pretty often. I can see that the queue I am using is increasing in size and my db is getting new data so it is consuming and producing. It seems that as soon as I stop producing to the same queue I am consuming from, the metrics return Another question that I am struggling to find any information on is how to interpret the execution duration GB-sec value on workers. What does this mean?...

Is there a preferred way to simulate

Is there a preferred way to simulate queues locally with the remote flag? Sort of like the __schedule query string arg for testing CRON schedules locally.

How do I increase the max concurrency

How do I increase the max concurrency workers to 500 (the maximum) when polling messages from Queue?

Hey all, wondering if theres a way to

Hey all, wondering if theres a way to set a limit on the number of requests to a worker over a given period of time before it starts rejecting new requests? If I can avoid implementing it myself that'd be great

Hey there, my Queue has had a

Hey there, my Queue has had a concurrency of 3 for the last 12 hours. Failure rate is low. Maximum concurrency is 250. Any ideas on how to increase this?

I've had to disconnect the queue

I've had to disconnect the queue consumer in my application to effectively pause a certain processing pipeline while I sort out a bug. As the messages accumulate in the queue without a consumer, will they safely stay around until I resume (until the 96hr retention period)?...

Queue retries not happening consistently with either message or global retry_delay wrangler setting

i saw this same behavior yesterday. curious what’s up. i didn’t pass an explicit retry delaySeconds for the message, just an empty .retry(), and was hoping it will respect the retry_delay configured under the wrangler consumer section. will do some more tests today

anyone else run into problems with

anyone else run into problems with queues today? we hit a bunch of "Queue send failed: Service Temporarily Unavailable" around 2025-01-14T19:51:06.333Z

yes, and through the dashboard - the

yes, and through the dashboard - the config seems correct, it's similar to a prod dlq queue in that same account which works fine - it's just that queue 8c720189e5c54eefa03f53eefb7162f1 that gives messages cannot be pulled unless http_pull mode is enabled. I even tried previewing and deleting the 3 messages in there, didn't help

I currently have a queue setup where the

I currently have a queue setup where the consumer worker initiates a CSV download from an API, continues to poll the API until the CSV is available, downloads the CSV, and then stores it in R2. Right now only 2 messages are getting sent to the queue at a time (via a cron job at the top of every hour), but only the first one ever gets processed (it's processed to completion). Could this be a CPU limit issue? I don't see any error logs. These are my current .toml settings:...

guys i got over an hour of consumer

guys i got over an hour of consumer delay, is this normal?
No description
Next