Skip to content

Convert batched migrations execution workers to limited capacity workers

Krasimir Angelov requested to merge 372316-paralel-convert-to-limited-capacity-worker into master

What does this MR do and why?

This MR converts the existing batched migrations execution workers into a limited capacity workers. It also introduces new feature flag batched_migrations_parallel_execution. When this feature flag is enabled, instead of execution one migration job at a time, we fetch predefined limit of migrations and enqueue them for parallel execution.

How to set up and validate locally

Here is a MR on top of this one, that can be used to test different scenarios - Draft: Test parallel execution of batched migra... (!104326 - closed).

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Related to #372316 (closed)

Edited by Krasimir Angelov

Merge request reports