Cloudflare Developers

CD

Cloudflare Developers

Welcome to the official Cloudflare Developers server. Here you can ask for help and stay updated with the latest news

Join

No: batch timeout is on the producer

No: batch timeout is on the producer side. It does not determine how the consumer scales. Your volume/message rate is very low, and (right now) we prefer to avoid scaling too quickly on the consumer side.

Of course : )

Of course : ) So basically I want to locally debug the queue producer and queue consumer. The queue producer is a cloudflare pages app, built on Remix. The queue consumer is a worker with plain typescript, no framework. I kept the worker that simple intentionally because it doesn't need database access or routing or whatever, it's basically a proxy for queue consumption (because cloudflare pages apps can't consume from a queue yet and other limitations)....

elithrar

@Matt ! Thanks for 1 and 3. For 2: we finally got a reply from our Cloudflare TAM and yes, they stated we need to add a payment method on our non-prod account. I'm working on us setting that up....

Debugging fetch in a consumer

Yes, I'm awaiting the fetch and I also put inside a try/catch, but no error is logged. The last log I see is the API URL log, and then the code skips everything below the log ```ts try {...

are there any plans to offer amqp

are there any plans to offer amqp support for remote integration with queues? I'd love to use this as an alternative to RabbitMQ.

RuntimeError: memory access out of bounds

Som of my Rust queue consumers throw exceptions very frequently before even starting the queue event handler, see https://github.com/cloudflare/workers-rs/issues/374. Or it times out without anything happening. It somehow feels like there's an issue outside of my code. Any idea what could cause this? I've tried instrumenting for a core dump, but the recordCoredump in wasm-coredump expects a request object, see https://github.com/cloudflare/wasm-coredump/issues/3.

I’m just trying to make sure that there

I’m just trying to make sure that there isn’t any unexpected issue or asterisk with keeping them colocated

Any updates on when Queues might come

Any updates on when Queues might come out of beta? Considering it for a production use case, but a bit hesitant, since as far as I understand it's not officially recommended for production use yet.

Consumer not receiving messages

Hi all, hate to jump in with questions, but saw this channel and figured I'd give it a shot. I have a queue set up on a worker as a producer/consumer combo between multiple environments. Meaning, my wrangler.toml looks something like this: ``` [[env.development.queues.producers]] queue = "tasks-development"...

Is your Worker specifically your `queue`

Is your Worker (specifically your queue handler throwing exceptions? If your script fails and you're out of retries, the message will be dropped.

Took a quick look I can see your queue

Took a quick look - I can see your queue did at one point get up to a max concurrency of 7 (but it's out of range in the graph you screenshotted). Sometimes the dash takes a bit to update but I can see your backlog should be clear now. I'll check about the 'one worker consumes 4 different queues' bit but that shouldn't cause any issues.

He has a couple of weird issues in his

He has a couple of weird issues in his queue lul

Async Processing

so our users are connected to our worker indefinitely while the article is created

Limits · Cloudflare Queues

https://developers.cloudflare.com/queues/platform/limits/ The limits for Queues are related but distinct from those for standard Workers

Multiple Producers on same Queue

I’m not an expert on miniflare but I’ll look into how to make sure multiple local workers are bound to the same Queue.

Message consumption throughput

Generally, yes. Though, in a well functioning Queue, the writes per second should correlate strongly with reads and deletes per second.

I m on paid unbound plan so 600ms should

I'm on paid, unbound plan, so 600ms should not be my CPU limit.
No description

Hey folks Heavy Cloudflare Workers user

Hey folks! Heavy Cloudflare Workers user here, and new Queues user - great to meet you all 👋 I'm struggling to bind a queue to a worker - specifically I can't get the binding to show up in the env argument in the fetch default exported function....

Hey 🙂 I was curious about how consuming

Hey! 🙂 I was curious about how consuming from queues works from a per-worker perspective. I know that it's limited to 100/s right now, but for example if I have a worker set to a batch of 50, and I have 101 items in the queue, will it immediately spawn 3 workers? Or will one worker sequentially process batches of up to 50?