Skip to content

Backfill ci catalog index

Kasia Misirli requested to merge 427930/Backfill_ci_catalog_index into master

What does this MR do and why?

The merge request adds a new migration to backfill the boolean ci_catalog index. The migration is batched with a batch size of 9,000 and a throttle delay of 10 seconds. Parent issue.

How to set up and validate locally

  1. Checkout my branch
  2. Check that none of the project's elasticseach data have the ci_catalog: (true/false) boolean by running project.__elasticsearch__.as_indexed_json on any of the project you have locally.
  3. Run migration with Elastic::DataMigrationService[20231017171659].send(:migration).migrate
  4. Validate that the boolean is present in projects with project.__elasticsearch__.as_indexed_json by finding ci_catalog value set to either true or false depending whether the project is marked at catalog resource or not.

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Kasia Misirli

Merge request reports