Lightweight Message Queue for Long running Background Tasks

I have a nextjs application I want to queue jobs. Essentially I want to queue a job and then I would create that job in the database associated with the user then I would get back its id. User will be able to check its status by its job id later on and once it is finished the the that had been queue will call my nextjs api endpoint to trigger a series of actions which might be store the result of the job in a database.
15 Replies
Gaurang
Gaurang2y ago
Odd I had the same thought this morning and I came across this library: https://quirrel.dev -- seems promising, although I can't say I have any experience with it.
Job Queueing for Serverless
Quirrel makes job queues simple as cake. Set up in 5 minutes - even works locally!
Unknown User
Unknown User2y ago
Message Not Public
Sign In & Join Server To View
Leonidas
Leonidas2y ago
QuirelJS remains awesome and can be self hosted as a docker container - if that is something you dont want i recommend an alternative. But quirelJS has to this day the best dx i experienced for background, cron, fanout and delayed jobs
Unknown User
Unknown User2y ago
Message Not Public
Sign In & Join Server To View
Gaurang
Gaurang2y ago
hey i’m so glad u posted this. Ever since netlify bought it out it seemed like they were going to phase it out, but thankfully it looks like they’ve updated the docs which hopefully means its around to stay
Leonidas
Leonidas2y ago
The benefits of open source software 🤝 Still i feel the same way as you - losing its creator is definitly a big loss. But imo quirelJS is in a good state, it’s responsibility is clearly defined which hopefully slows down the natural „oxidation/rusting process“
Amos
Amos2y ago
Way too expensive for 25k requests per month
Unknown User
Unknown User2y ago
Message Not Public
Sign In & Join Server To View
Gaurang
Gaurang2y ago
QStash looks pretty cool, how would you say it compares to something like https://quirrel.dev
Job Queueing for Serverless
Quirrel makes job queues simple as cake. Set up in 5 minutes - even works locally!
Unknown User
Unknown User2y ago
Message Not Public
Sign In & Join Server To View
Leonidas
Leonidas2y ago
The local dx quirell has is (as i am aware of) unmatched currently. Also quirell provides fanout jobs, a feature i havent found in qstash. But apart from that quirellJS and qstash do the same job. A pro for qstash: their pricing is really really low. Self hosting quirelJS would actually be more expensive on most service providers for most use cases Hard to generalize that pricing statement for all scenarios, since the pricing models are obviously different. Because for qstash you pay per use, with quirell you self host on rented infra and pay for that. Qstash has some „mass production“ efficiency going on for it
Unknown User
Unknown User2y ago
Message Not Public
Sign In & Join Server To View
Leonidas
Leonidas2y ago
Thats nice to know! Thank you I havent really used qstash yet (only read your docs). As soon as i get to use your service I will write a short feedback☝🏼
Gaurang
Gaurang2y ago
Thanks really appreciate that, will def. git Qstash a go!
zoney1337
zoney133717mo ago
giving qstash a go. I'm an old C# dev, are there any TS alternatives to something like Microsoft Orleans, NServiceBus, MassTransit, etc ? Virtual Actor Model framework with qstash support would be awesome !
Want results from more Discord servers?
Add your server