<!--IssueSummary start--> <details> <summary> Everyone can contribute. [Help move this issue forward](https://handbook.gitlab.com/handbook/marketing/developer-relations/contributor-success/community-contributors-workflows/#contributor-links) while earning points, leveling up and collecting rewards. </summary> - [Close this issue](https://contributors.gitlab.com/manage-issue?action=close&projectId=278964&issueIid=557283) </details> <!--IssueSummary end--> **Title:** Incomplete Elasticsearch Indexing on GitLab-Licensed Instances **Description:** We are experiencing an issue where not all GitLab projects are being indexed for search on our **GitLab-Licensed** instances. Some projects are intermittently missing from the Elasticsearch index, impacting search functionality. Running the following rake task resolves the issue temporarily by manually re-indexing all projects: ```bash sudo gitlab-rake gitlab:elastic:index_projects ``` Prior to re-indexing: ```bash gitlab-rake gitlab:elastic:index_projects_status Indexing was 98.69% complete ``` After rerunning the indexing task, all projects were successfully indexed. **Research Summary:** I investigated related GitLab issues and identified several likely root causes: * [#214601](https://gitlab.com/gitlab-org/gitlab/-/issues/214601) introduces a `search_index_integrity` feature intended to detect and correct incomplete indexes. However, it remains behind a **feature flag** and is not currently recommended for production. * [#360579](https://gitlab.com/gitlab-org/gitlab/-/issues/360579) and [#392981](https://gitlab.com/gitlab-org/gitlab/-/issues/392981) point to **interrupted or silently failing Sidekiq jobs** as a potential cause for incomplete indexing. * GitLab’s ongoing work in [#458804](https://gitlab.com/gitlab-org/gitlab/-/issues/458804) outlines a potential redesign aimed at making indexing more robust and self-healing. **Environment Details:** * **GET version:** 3.7 * **Cloud Provider:** AWS * **GitLab Edition:** Licensed (Premium) * **Elasticsearch:** Enabled on licensed instances only (dev and prod) **Request:** 1. What is the recommended solution or fix for ensuring complete and consistent indexing? 2. Is there a known workaround, or is enabling `search_index_integrity` safe for production in our case? 3. Are there any interim mitigations to avoid these silent failures (e.g. retry strategies, alerting)? 4. Are there updates or ETAs regarding the improved indexing mechanism discussed in [#458804](https://gitlab.com/gitlab-org/gitlab/-/issues/458804)? --- ---