Reindex issues from database

Madelein van Niekerkrequested to merge
470138-reindex-issues into master

What does this MR do and why?

Reindex all issues by tracking every issue from the database and removing issue documents with old schema versions.

We are adding two migrations:

  • IndexAllIssuesFromDatabase
  • RemoveIssueDocumentsBeforeSchemaVersion2405

The migration versions are forced to be before BackfillInitialEmbeddings because we have some documents in production which have an issue with es_id that's preventing the migration from completing. Once the two new migrations are complete, this migration will also complete.

MR acceptance checklist

Please evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

How to validate locally

  1. Run the migration worker on repeat until the migrations are finished: Elastic::MigrationWorker.new.perform
  2. You can also view the logs: tail -f log/elasticsearch.log

Related to #470138 (closed)

Edited by Madelein van Niekerk

Merge request reports