892 Commits

Author SHA1 Message Date
Rogger Valverde fbf2fa397c fix(metrics): differentiate points in different minutes to be more accurate (#2770) 2024-09-10 08:09:00 -05:00
Rogger Valverde 3a098406a8 perf(metrics): save zeros as much as max data points (#2767) 2024-09-04 21:54:34 -06:00
Rogger Valverde 8276f72b30 fix(metrics): use batches include when collecting metrics (#2765) fixes #2764 #2763 2024-08-27 23:15:10 -05:00
Rogger Valverde 603befe439 feat(job): support debouncing (#2760) 2024-07-30 08:49:44 -05:00
Rogger Valverde 96675f51d1 fix(job): check jobKey when saving stacktrace (#2755) 2024-07-04 00:00:01 -05:00
Rogger Valverde 021ab7fd8d feat(queue): emit internal duplicated event (#2754) 2024-06-30 12:45:34 -05:00
Rogger Valverde d632ac1010 feat(queue): add global:duplicated event when a duplicated is added (#2749) 2024-06-25 00:06:07 -05:00
Rogger Valverde 6c2719a929 fix(priority): consider paused state when calling getCountsPerPriority (#2748) 2024-06-20 20:38:29 -05:00
Rogger Valverde 0376dcc128 feat(queue): add getCountsPerPriority method (#2746) 2024-06-11 19:24:48 -06:00
Rogger Valverde c29e3b061a fix(retry-job): throw error when job is not in active state (#2741) 2024-05-24 00:35:32 -05:00
Rogger Valverde 7b12be13ea fix(move-to-finished): throw error when job is not in active state (#2739) 2024-05-22 00:31:00 -06:00
Rogger Valverde 63636b181d fix(scripts): throw error when moving non-active job to delayed (#2740) 2024-05-20 23:58:34 -05:00
Rogger Valverde 2112269746 fix(stalled): take in count removeOnFail option (#2734) 2024-05-18 00:47:22 -05:00
Rogger Valverde 1fb15628dc fix(job): validate job existence when adding log (#2738) 2024-05-17 00:17:05 -05:00
Rogger Valverde 09ce146563 fix(retry-job): consider priority (#2737) fixes #1755 2024-05-15 00:12:02 -05:00
Rogger Valverde 8c3bf1f8a4 refactor: add commandTransform utility (#2736) 2024-05-13 18:48:27 -06:00
Rogger Valverde 7ee8f7430a perf(scripts): remove token after moving to wait or delayed (#2731) 2024-05-10 07:51:07 -06:00
Rogger Valverde 6d84156966 fix(job): validate jobKey in updateProgress and update (#2730) 2024-05-10 07:50:52 -06:00
Shinigami92 e94f568085 fix: pass redis string as opts into queue 2023-11-11 13:06:11 +01:00
Manuel Astudillo ccb6cc7ecc fix: catch pause errors when closing 2023-10-14 12:08:54 +02:00
Manuel Astudillo 5910f44b03 fix(worker): better client name support 2023-08-09 00:11:33 +02:00
batrudinych 35f1da3cf6 fix(queue): deep clone opts (#2634) fixes #2633 2023-08-08 10:55:05 +02:00
Gady Piazza 4ce36febe3 fix: remove deprecated debuglog 2023-07-12 23:43:40 +02:00
abdeljalil09 dcca1e8c39 fix(worker): high-memory-usage-when-providing-float-to-concurrency (#2620) 2023-07-06 16:21:06 +02:00
Manuel Astudillo 5b4bc0b4ef test(retry): fix retry test error 2023-02-09 12:23:09 +01:00
Manuel Astudillo 9f945d60c6 fix(retry): handle pause queue status 2023-02-09 12:23:09 +01:00
Hendrik Morée 8a0292a574 fix: don't reschedule delay timer if closing (#2535) 2023-02-03 10:22:40 +01:00
andrewvasilchuk 8ad90fb0d1 chore: delete unused dependency
p-timeout is not used anymore, since it was extracted into
a separate file
2022-11-28 09:59:19 +01:00
andrewvasilchuk f9081dd01f refactor: use TypeError when invalid options are passed 2022-11-28 09:54:14 +01:00
Andrew 8a742c1176 fix(queue): throw error when needed instead of hiding it in a closure 2022-11-24 14:47:37 +01:00
Elliot 75e6775fc3 feat: support .cjs files 2022-09-05 13:15:16 +02:00
Harry Yu 3331188bce perf(clean): use ZRANGEBYSCORE to improve performance (#2363) 2022-07-27 17:21:32 +02:00
Manuel Astudillo b9ea7f4780 fix(worker): better disconnect when blocking connection 2022-06-16 16:59:00 +08:00
Patrick Lussan 2f1fb6cdc1 fix(stalled-jobs): move stalled jobs to wait in batches 2022-05-12 09:35:24 +08:00
Andreas Lind 11eae6b960 fix: unlock job when moving it to delayed (#2329) 2022-04-21 15:56:59 +08:00
Eric Mc Sween ef5f471725 perf: speed up clean operation (#2326)
The clean operation on sets backed by lists (wait, active, paused)
quickly gets very slow when the list is large. This is because each job
deletion scans the whole list in a LREM call, resulting in O(N * M)
complexity where N is the number of jobs in the list and M is the number
of jobs to delete.

With this change, the deletion is done in two passes. The first pass
sets each item that should be deleted to a special value. The second
pass deletes all items with that special value in a single LREM call.
This results in O(N) complexity.
2022-03-21 09:22:49 +08:00
Andreas Lind b7058e6e8f feat: have Queue#clean consult job.{finishedOn,processedOn,timestamp} (#2309) 2022-03-19 21:12:36 +08:00
Manuel Astudillo 190d6e93bf chore: fix lint errors 2022-03-02 10:37:44 +08:00
Manuel Astudillo 886d764381 feat(metrics): add support for collecting queue metrics 2022-03-02 10:37:44 +08:00
Manuel Astudillo d3b91386e3 fix: better handling of maxRetriesPerRequest 2022-02-23 12:06:42 +08:00
Manuel Astudillo 10db479731 fix(sandbox): better error reporting broken processor file 2022-02-21 16:07:24 +08:00
Manuel Astudillo 54e5463bff feat: handle redis uri queries 2022-02-21 15:49:37 +08:00
Manuel Astudillo 232ed85d4c fix(sandbox): wait for result of sending start command 2022-02-20 12:21:15 +08:00
Manuel Astudillo 41b940457b fix(worker): better closing when disconnected 2022-02-16 18:06:43 +08:00
Manuel Astudillo 193644c5ed fix(queue): return correct workers with getWorkers() 2022-02-14 19:22:58 +08:00
Manuel Astudillo ad7b6474db fix(commands): do not wait for redis to load commands 2022-02-14 18:27:33 +08:00
Steven 8ab5b1d1c3 fix(scripts): make it easier for tools like vercel to find the .lua scripts 2022-02-14 10:37:26 +08:00
Manuel Astudillo dd0b853a51 fix(sandbox): broken processor files should fail jobs 2022-02-06 18:26:40 +08:00
rogger andré valverde flores 501b2cc49c feat(queue): add retryJobs for failed status 2022-02-01 10:40:37 +08:00
Manuel Astudillo 90f040c052 feat: add support for removeOn based on time 2022-01-26 22:14:25 +08:00