Update sub_batch_size to 2500 for BackfillMergeRequestFileDiffsPartitionedTable
What does this MR do and why?
Updates the sub_batch_size from 200 to 2500 for the BackfillMergeRequestFileDiffsPartitionedTable batched background migration.
Additionally, conditionally updates batch_size to 50_000 if it's not already larger than that value. This is necessary to satisfy the constraint that sub_batch_size be less than batch_size.
We are doing this in order to speed up this backfill and use more of the available execution time migrating rows.
MR acceptance checklist
Evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.
Edited by Matt Kasa