Investigate the use of job-iteration gem for long running jobs
Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.
We have many places in our codebase that could benefit from having jobs that are easily pausable/resumable. Any long running batch-like jobs needs to reliably iterate over a set of records, and they all have to implement many safe-guards that could be abstracted into something reusable, making it easier to write, test, and comprehend.
Shopify did that based on ActiveJob abstraction: https://github.com/Shopify/job-iteration. We should investigate if that is a good fit for us (would require to migrate the jobs to use ActiveJob baseclass instead of the Sidekiq one) or if we need to port it to use Sidekiq directly.
Edited by 🤖 GitLab Bot 🤖