Getting "exceededCPU" error on workers with queues.
I am using workers to with push based queues to process my videos.
The videos are barely 20MBs on average, i get them from a usrl and I am uploading it to R2 using stream.
Also my worker takes aroudn 10-15K ms on average with 2-3 seconds of CPU time. but I keep getting 'exceededCpu' error randomly and the metrics display those errors as the Exceeded CPU Time Limits errors.
Wanted to understand - what could the issue be exacly and how can I fix it?
6 Replies
are you on free or paid?
what's your cpu limit?
what's the cpu time on the request that failed?
i am on cloudflare startup plan so it should be paid
I havent set any cpu limits - so it should be the default one - 30s
the CPU time for the request that failed are 2.6K, 2.45K, 2.52K, 2.54K ms requests
account id + worker name?
accountId: 9a55bb0cfa20eb2a04c3530706c4a0f6
worker: sb-backend
thank you in advance, Walshy!
encountered the issue with another batch of requests - thought I should provide more details:
I would like to mention that I notice this issue more when there are a bunch of parellel calls
The request was done 4 times back to back with little gap (mostly because of queue retry mechanism I assume)
And it got the same error everytime "exceededCpu"
RequestIDs:
4MPNGEOZUE2TFIGP
WK1NTHO6OMR84H2R
RP6EW872NGCRYRL6
TWG5YRBDSY104GZH
thanks, i've dug into a bit so far and agree it doesn't look right -- will keep digging and keep you updated
Hey @Walshy | Workers/Pages, any updates on that?
Sorry for long message. TLDR: Can you guys include me in containers beta?
---
I know containers are coming by June end to workers in public beta and it has been in the works for a quite some time.
is it possible for cloudflare team to include me in closed beta for containers on workers?
The pattern for this particular issue of exceededCPU seems to be very much about the memory. Because always the videos over 1.5 minutes, end up getting not processed.
While I still believe the memory being consumed is way less than 128MB, I am ready to move to container based worker till then.
It would be great if you could talk to the containers team.
Thank you again!
just a reminder - if there is any update on this. thank you!