Adjust BulkImport::EntityWorker deduplicate stragegy - Direct Transfer

During the test migration of Rails from Staging-Ref to Production, BulkImport::EntityWorker stopped being re-enqueued.

Based on the logs, the worker got deduplicated and stopped being re-enqueued.

Screenshot_2023-10-26_at_20.15.49

Proposed solution

Changing the strategy from deduplicate :until_executed to deduplicate :until_executed, if_deduplicated: :reschedule_once might fix the problem.

Also, increasing the delay for the worker to be re-enqueued from 5 seconds to 30 seconds will reduce the chances of workers getting duplicated.