109 questions
0
votes
0
answers
96
views
Updating repeatable job's startDate/pattern does not update next run time (even after deleting and recreating job)
I'm using BullMQ (v5.56) to schedule repeatable jobs with a custom schedulerId as the job name.
When I create a job with repeat options like:
{
startDate: '2025-07-10T09:55:00.000Z',
pattern: '55 *...
0
votes
0
answers
126
views
How to safely handle failed BullMQ jobs and Redis memory limits without data loss?
I've started to work on caching and queuing in my back-end using Redis and BullMQ.
It's my first time ever; so I don't know much about the strategies or how to ensure that I won't lose any data. Since ...
- 198
0
votes
0
answers
129
views
BullMQ: Flow parent job's 'failed' event not triggered when child jobs fail
I'm implementing a job flow using BullMQ (latest version) with NestJS, and I've encountered an issue with error handling in flow jobs.
The setup
I have a parent flow job and multiple child jobs. The ...
- 1,445
1
vote
0
answers
148
views
bullmq deduplicate job while keeping the last one in the queue
I have a bullMq queue (deploy_site) that takes around 20 seconds to finish. There should be no concurrent run per site, so basic deduplication was easy:
deployQueue.add({
id: siteId
},
{
...
- 8,603
-1
votes
1
answer
198
views
Efficiently utilizing puppeteers headless browser's in google cloud?
I have a nodejs codebase deployed on google cloud, using an ubuntu image. This code will open a headless browser using puppeteer, render some HTML and save an image. This is currently taking about 4-6 ...
- 616
0
votes
0
answers
207
views
BullMQ Job Not Removed from Queue After Calling job.remove()
I’m prototyping a project using BullMQ and Redis, and so far, everything seems to be working fine. Jobs are being added to the queue successfully. However, when I process the jobs using a worker and ...
- 170
1
vote
0
answers
393
views
Should I use separate processes or worker threads with BullMQ for asynchronous tasks in NestJS?
I have a typical NestJS application and I integrated BullMQ to make use of queues for the following cases:
Triggering emails and push notifications
Making database reads and writes at specific dates ...
0
votes
1
answer
397
views
How to set maxStalledCount with BullMQ in NestJS?
I have a service that is processing jobs that can take up to 24 hours. When the service gets restarted, active jobs get stalled and are automatically resumed. As you can imagine, the service could get ...
- 43.1k
0
votes
0
answers
247
views
Bull MQ NestJS error removing job from queue
I'm using Bull in a Nestjs-App for multiple tasks, one of them is running scheduled jobs with a delay. When a schedule needs to be updated or deleted, the corresponding jobs need to be deleted using ....
- 86
1
vote
0
answers
239
views
How to prevent Duplicate Task Creation in BullMQ with PM2 Cluster Mode
I use multiple queues to structure my task flow. For example, if a task consists of two actions, I split the task into two queues: Queue A and Queue B. After an HTTP request, a job is created in Queue ...
- 11
0
votes
1
answer
175
views
Why is NestJs not able to resolve dependencies
I am trying to integrate bullmq in NestJs project. But facing the following error:
Error: Nest can't resolve dependencies of the CustomerSubscriptionPaymentsService (CustomerSubscriptionPaymentsRepo, ?...
0
votes
1
answer
747
views
BullMQ and NestJS - Manage Queue Names
I'm building a application using BullMQ and NestJS. It's all working fine, but there is something bugging me.
When register a new queue on my application I do something like that:
@Module({
...
- 519
0
votes
1
answer
1k
views
NestJs BullMQ: "Flow" feature does not execute the parent and children jobs
I am new to BullMQ and I have been trying to implement "flow" feature but the referenced jobs that I have listed in the syncVotesTableAndExtractDataFlow variable which is of type ...
- 1
2
votes
1
answer
312
views
How to deal with chunk data for cronjob with BullMQ?
I am working on a cronjob with BullMQ node module.
I have 3000 users and I want to seperate 3 jobs, which one job is for 1000 users, and process cronjob.
But when I run this code, it performs many ...
- 42
-1
votes
1
answer
839
views
Make sure BullMQ queue pushes data to single node in redis cluster
I've integrated BullMQ into our Node.js application, leveraging Redis Cluster for production. According to the BullMQ and Redis Cluster documentation I understood that we can give some prefix in key ...
- 115
5
votes
3
answers
7k
views
resolve IMPORTANT! Eviction policy is volatile-lru. It should be "noeviction" while using bullmq in node js
I am getting this warning on my terminal while using bullmq on my node express ts project
resolve IMPORTANT! Eviction policy is volatile-lru. It should be "noeviction" while using bullmq in ...
- 81
2
votes
1
answer
2k
views
ioredis - ClusterAllFailedError: Failed to refresh slots cache issue with Redis Cluster to Connect with AWS MemoryDb
i am use redis cluster connect with memoryDB aws
const connection = new Redis.Cluster(
[{ host: "clustercfg.jb-bot-dev-memorydb.czxa87.memorydb.ap-south-1.amazonaws.com", port: 6379}],
{
...
0
votes
1
answer
77
views
Proper use of Ts.ED BullMQ on server init
I'm using Tsed(newb) and want to use the BullMQ plugin.
I want to run a job right after the server starts but I'm not sure how to do it properly. I've been following this guide https://tsed.io/...
- 41
1
vote
0
answers
1k
views
Reached the max retries per request limit (which is 20). BullMQ NestJS
I have configured BullMQ in my project. I can use it on local but getting this error when it's deployed on server.
Reached the max retries per request limit (which is 20). Refer to "...
- 12.4k
2
votes
1
answer
2k
views
BullMq - Facing errors where Jobs are being processed twice which is leading to errors such as Missing key/lock
Provided are the details including code that I am using to implement jobs with Nodejs
Some things to keep in mind, as GCP runs multiple instance, they all have access to this one worker and the same ...
- 23
0
votes
1
answer
515
views
react cron expression generator for bullmq?
we need to generate a corn expression that Bullmq can accept.
I have tried react-cron-generator. but it's not accepted by Bullmq.
Corn expression to run a job every day 3:15 am
react-corn-generator : ...
- 827
1
vote
1
answer
1k
views
Nestjs bullmq worker processor don't works with jest
Step to reproduce
Create a new nest project : nest new nest-app
Install dependencies : npm i @nestjs/bullmq ioredis
Start a redis instance on default port 6379
Create this 2 files
app.service.ts
...
- 1,102
0
votes
0
answers
80
views
Why on server is not running when i use bullmq?
When i try to use this code it's not logging Hello, World also i noticed that my server is not runninng on localhost 3000 what i'm doing wrong? using bullmq
trying to run a function after 10 seconds ...
- 113
0
votes
1
answer
214
views
Bull Arena for bullmq - TypeError: as of 3.0.0, bull-arena requires that the queue constructors be provided to Arena
I'm using bullmq not bull library
import BullMQ from 'bullmq';
import Arena from 'bull-arena';
const arenaConfig = Arena({
BullMQ,
queues: bullQueues,
});
got an error TypeError: as of 3.0.0, ...
- 91
0
votes
1
answer
579
views
How to remove failed retrial jobs using BullMQ?
I use BullMQ to run jobs on the background. I have defined main job using retry strategy. I want to make sure that when main job fails and when retrying this job fails it removes retried failed jobs ...
- 574