Having such a bad experience with Queues & DOs
I have a lot of data to fetch from an external API.
I queue up each page which then distributes additional processing via durable objects.
It starts out perfectly fine, but once it reaches half of the pages it needs to process, it just hangs.
Each page has a unique shared ID to keep durable objects alive for in-memory state. After a page finishes fetching, I dispose the DO.
Is there something I am not understanding?
(this is all local & using RPC )
0 Replies