Hi everyone, I like the worker and queue
Hi everyone, I like the worker and queue features in cloudflare, and been trying out about few weeks already.
I got a question, I noticed the consumer for the queue, after some time (like 2 days), it will stop processing the queue message. (the backlog size increase and doesnt get consume)
I attached the screenshot on the consumer setting, is this a bug or is just because of my consumer setting?
9 Replies
the backlog continue to grow until i disconnect the consumer and reconnect again, then it start consume the backlog message
other metric
Can you tell if the consumer is not consuming messages at all or is just consuming them slowly? I ask because I (and it sounds like a couple other people) are experiencing 30 second delays between messages being consumed, which with the volume of messages you posted would look a lot like not consuming at all
I tried disconnecting and reconnecting my consumer from dash and did not see any changes in the delay I'm experiencing so maybe unrelated issue
hey @NoGameNoFun, this is probably a bug on our side. Could you send me over your queue ID & account id? Both are safe to share here
Hi @Pranshu Maheshwari thanks for the reply, I private sent you my queue ID, account ID, and the consumer worker name. Hopefully can help identify the issue
Another update, in the last 12 hours, producer got keep sending message into the queue, can see from the worker request count and the average backlog count in the queue
but the backlog doesnt get reduce for the past 12 hour, so for @ManaGeorge message, I think mine issue is not the delay in processing message, because is way greater than the possible delay for batching the message to be processed
@Pranshu Maheshwari any update on this issue?
Hey! Just saw your dm @NoGameNoFun, digging into this
I have been experiencing a similar issue, did you find out what was the issue?