Adjust BulkImport::EntityWorker deduplicate stragegy - Direct Transfer
During the test migration of Rails from Staging-Ref to Production, BulkImport::EntityWorker
stopped being re-enqueued.
Based on the logs, the worker got deduplicated and stopped being re-enqueued.
Proposed solution
Changing the strategy from deduplicate :until_executed
to deduplicate :until_executed, if_deduplicated: :reschedule_once
might fix the problem.
Also, increasing the delay for the worker to be re-enqueued from 5 seconds
to 30 seconds
will reduce the chances of workers getting duplicated.