Https Queues... Is Zeplo.io active?
So we are using vercel and we are having the following problem:
1) We receive a lot of webhooks from multiple services (No problem for Vercel)
2) Some of those Webhooks should be inserted into our DB (Using Neon, again no problem yet)
3) Some webhooks depend on the previous step for example: if a new "order" is created we get a webhook and if a shipping method is updated we get another webhook (from the same order). The PROBLEM starts here, when we get both of this webhooks too close to each other like 50ms distance from each other and the DB insertion is not finished so the second webhooks fails or we end up duplicating the creation of an order that should actually be unique.
Zeplo seems to be great for this task since it seems to enable us to first complete the first task and only then run the second one. But the project is abandoned (or at least it seems that).
Do you know any other alternatives? or ways to solve this?
2 Replies
Endpoint writes the webhook events to files.
Separate process checks for new files, and processes files sequentially in the order they arrived.
or could also write them into a queue table in your db I suppose
Qstash has a "parallelism" parameter that if is set to 1 then it fits perfectly!