526 Commits

Author SHA1 Message Date
Rogger Valverde fbf2fa397c fix(metrics): differentiate points in different minutes to be more accurate (#2770) 2024-09-10 08:09:00 -05:00
Rogger Valverde 603befe439 feat(job): support debouncing (#2760) 2024-07-30 08:49:44 -05:00
Rogger Valverde 021ab7fd8d feat(queue): emit internal duplicated event (#2754) 2024-06-30 12:45:34 -05:00
Rogger Valverde d632ac1010 feat(queue): add global:duplicated event when a duplicated is added (#2749) 2024-06-25 00:06:07 -05:00
Rogger Valverde 6c2719a929 fix(priority): consider paused state when calling getCountsPerPriority (#2748) 2024-06-20 20:38:29 -05:00
Rogger Valverde 0376dcc128 feat(queue): add getCountsPerPriority method (#2746) 2024-06-11 19:24:48 -06:00
Rogger Valverde c29e3b061a fix(retry-job): throw error when job is not in active state (#2741) 2024-05-24 00:35:32 -05:00
Rogger Valverde 7b12be13ea fix(move-to-finished): throw error when job is not in active state (#2739) 2024-05-22 00:31:00 -06:00
Rogger Valverde 63636b181d fix(scripts): throw error when moving non-active job to delayed (#2740) 2024-05-20 23:58:34 -05:00
Rogger Valverde 2112269746 fix(stalled): take in count removeOnFail option (#2734) 2024-05-18 00:47:22 -05:00
Rogger Valverde 1fb15628dc fix(job): validate job existence when adding log (#2738) 2024-05-17 00:17:05 -05:00
Rogger Valverde 09ce146563 fix(retry-job): consider priority (#2737) fixes #1755 2024-05-15 00:12:02 -05:00
Rogger Valverde 6d84156966 fix(job): validate jobKey in updateProgress and update (#2730) 2024-05-10 07:50:52 -06:00
Shinigami92 e94f568085 fix: pass redis string as opts into queue 2023-11-11 13:06:11 +01:00
Manuel Astudillo 9f945d60c6 fix(retry): handle pause queue status 2023-02-09 12:23:09 +01:00
Manuel Astudillo 53f14a8e1d test(clean): verify Redis does not have any keys left 2022-12-21 11:38:40 +01:00
Harry Yu 3331188bce perf(clean): use ZRANGEBYSCORE to improve performance (#2363) 2022-07-27 17:21:32 +02:00
Andreas Lind 11eae6b960 fix: unlock job when moving it to delayed (#2329) 2022-04-21 15:56:59 +08:00
Eric Mc Sween ef5f471725 perf: speed up clean operation (#2326)
The clean operation on sets backed by lists (wait, active, paused)
quickly gets very slow when the list is large. This is because each job
deletion scans the whole list in a LREM call, resulting in O(N * M)
complexity where N is the number of jobs in the list and M is the number
of jobs to delete.

With this change, the deletion is done in two passes. The first pass
sets each item that should be deleted to a special value. The second
pass deletes all items with that special value in a single LREM call.
This results in O(N) complexity.
2022-03-21 09:22:49 +08:00
Andreas Lind b7058e6e8f feat: have Queue#clean consult job.{finishedOn,processedOn,timestamp} (#2309) 2022-03-19 21:12:36 +08:00
Andreas Lind 2dd17f03da test: replace the no longer supported test/mocha.opts by .mocharc.json (#2327) 2022-03-19 21:05:03 +08:00
Manuel Astudillo 5befb9b956 test(metrics): flushdb between tests 2022-03-02 10:37:44 +08:00
Manuel Astudillo 190d6e93bf chore: fix lint errors 2022-03-02 10:37:44 +08:00
Manuel Astudillo 886d764381 feat(metrics): add support for collecting queue metrics 2022-03-02 10:37:44 +08:00
Manuel Astudillo d3b91386e3 fix: better handling of maxRetriesPerRequest 2022-02-23 12:06:42 +08:00
Manuel Astudillo 54e5463bff feat: handle redis uri queries 2022-02-21 15:49:37 +08:00
Manuel Astudillo 193644c5ed fix(queue): return correct workers with getWorkers() 2022-02-14 19:22:58 +08:00
Manuel Astudillo ad7b6474db fix(commands): do not wait for redis to load commands 2022-02-14 18:27:33 +08:00
Manuel Astudillo dd0b853a51 fix(sandbox): broken processor files should fail jobs 2022-02-06 18:26:40 +08:00
rogger andré valverde flores 501b2cc49c feat(queue): add retryJobs for failed status 2022-02-01 10:40:37 +08:00
Manuel Astudillo 90f040c052 feat: add support for removeOn based on time 2022-01-26 22:14:25 +08:00
jfontaine-lifion 16fdbe90a0 feat(queue): enabled queues to share childPool instance (#2237) 2021-12-21 14:34:39 +08:00
Peter Xu c20e469dcd perf: speed up performance of queue.clean when called with a limit (#2205) 2021-12-14 13:00:44 +08:00
manoj kumar 7247b3bb97 feat: emit event on job lock extend failure 2021-10-31 19:09:11 +08:00
Manuel Astudillo 8968e7227d test(connection): fix lint error 2021-10-27 18:42:38 +08:00
Manuel Astudillo 0dfa654443 test(connection): fix broken test 2021-10-27 18:42:38 +08:00
Manuel Astudillo 3ade8e6727 fix: force options to guarantee correct reconnects
BREAKING CHANGE:
If redis opts are missing:
 { maxRetriesPerRequest: null,
   enableReadyCheck: false }
then a exception will be thrown.
2021-10-27 18:42:38 +08:00
Manuel Astudillo 79ce013af6 fix(name-processors): wait for all processors when closing fixes #1618 2021-10-13 13:35:47 +08:00
Mauricio Muñoz 0ca4c6b4d5 fix(connection): fail only if redis connection does not recover 2021-09-08 10:59:03 +08:00
Alexander Lolis 5adcf2ceed feat: support job.discard function in sandboxed processors
* Implement Job.prototype.isDiscarded
2021-07-27 10:26:53 +02:00
DavideViolante b50512e1a8 chore: exec npm run prettier 2021-07-16 16:40:05 +02:00
Manuel Astudillo dab0d82661 feat(repeatable): store key in repeat options 2021-07-16 16:09:01 +02:00
Manuel Astudillo 7f0db0e293 fix(repeatable): honor endDate fixes #1573 2021-07-16 13:11:23 +02:00
Chris M 2a295691b8 feat: pass clientName to createClient function
Overrides the options.redis settings for clientName for creating a new
client
2021-07-15 15:02:17 +02:00
Manuel Astudillo e573010768 feat(backoff): add option to specify options for custom backoff strategy 2021-07-15 14:59:41 +02:00
Jide Osan ff79fb494e feat: support job.update function in sandboxed processors
fixes #1279 , #1608, and #1056
2021-07-13 17:11:42 +02:00
Manuel Astudillo 90763fd664 fix: remove stalled job when finishing fixes #1600 2021-07-13 13:52:12 +02:00
nekocode 82d5de4781 test: add test for queue instantiation 2021-07-01 11:54:00 +02:00
Manuel Astudillo 6ccf2b9089 fix(obliterate): remove job logs fixes #2050 2021-05-31 12:43:15 +02:00
tjhiggins 30aa0a99ac fix(job): fix job log pagination, fixes #2031 2021-05-17 18:25:04 +02:00