Investigate the use of job-iteration gem for long running jobs

Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.

  • Label this issue
  • Close this issue

We have many places in our codebase that could benefit from having jobs that are easily pausable/resumable. Any long running batch-like jobs needs to reliably iterate over a set of records, and they all have to implement many safe-guards that could be abstracted into something reusable, making it easier to write, test, and comprehend.

Shopify did that based on ActiveJob abstraction: https://github.com/Shopify/job-iteration. We should investigate if that is a good fit for us (would require to migrate the jobs to use ActiveJob baseclass instead of the Sidekiq one) or if we need to port it to use Sidekiq directly.

Edited Oct 01, 2025 by 🤖 GitLab Bot 🤖
Assignee Loading
Time tracking Loading