Advanced Search should detect and fix docs in index which are missing from database
Problem to solve
During a recent Advanced Search migration, it was found that many projects (and associated data) exist in the main index for projects which are deleted from the database. All of these projects are from the qa-sandbox group and appear to be part of automated testing. The projects are deleted automatically using the API via a clean up script (example job: https://ops.gitlab.net/gitlab-org/quality/staging/-/jobs/9022548)
I was unable to determine how the projects were not deleted from the index.
Proposal
Determine how to detect and fix issues where data exists in the index (but shouldn't) for deleted projects or groups. Add this functionality to the Indexing Integrity worker being developed in the related issue.
Edited by Terri Chu