Requeue BackfillTerraformModulesMetadataWithSemver BBM

What does this MR do and why?

In Backfill semver for terraform modules (!184181 - merged), we introduced the BackfillTerraformModulesMetadataWithSemver BBM to backfill the SemVer columns in the packages_terraform_module_metadata table.

Unfortunately, the migration has been failed due to query statement timeouts.

In this MR, we requeue the BBM after making these updates:

  • Adding a temp index to help with the BBM batching queries
  • Changing the BBM batching strategy from the LooseIndexScanBatchingStrategy to the normal batching over the primary key with filters (backed by the new temp index).
  • Increase the batch and sub-batch size since we have a dedicated index now.

References

Screenshots or screen recordings

N/A

How to set up and validate locally

N/A

MR acceptance checklist

Evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

Related to #474746 (closed)

Edited by Moaz Khalifa

Merge request reports

Loading