Add migration for backfilling traversal_ids in blobs and wiki blobs
What does this MR do and why?
Describe in detail what your merge request does and why.
Backfills the traversal_ids for blobs and wiki blobs in the main index, more details in the issue #351381 (closed)
Time for completion estimate calculation (internal link): 278 hours (may take a little longer due to having to work through each project). Indexing will not be paused during the migration.
Screenshots or screen recordings
Screenshots are required for UI changes, and strongly recommended for all other merge requests.
How to set up and validate locally
Numbered steps to set up and validate the change are strongly suggested.
- Run the following query to get the blobs and wiki_blobs with missing
traversal_ids
{
"size": 0,
"query": {
"bool": {
"must_not": {
"exists": {
"field": "traversal_ids"
}
},
"must": {
"terms": {
"type": [
"blob",
"wiki_blob"
]
}
}
}
},
"aggs": {
"my-agg-name": {
"terms": {
"size": 1000,
"field": "project_id"
}
}
}
}
- Make sure advanced search is enabled and you run the migration from rails console by entering the following lines:
require File.expand_path('ee/elastic/migrate/20221221110300_add_traversal_ids_in_blobs_and_wiki_blobs.rb')
BackfillTraversalIdsToBlobsAndWikiBlobs.new(20221221110300).migrate
- Run the query again in ES to verify that there are no records with misssing traversal_ids
MR acceptance checklist
This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.
-
I have evaluated the MR acceptance checklist for this MR.
Related to #351381 (closed)
Merge request reports
Activity
changed milestone to %15.8
assigned to @sdungarwal
added typebug label and removed typemaintenance label
- A deleted user
added backend label
- Resolved by John Mason
Reviewer roulette
Changes that require review have been detected!
Please refer to the table below for assigning reviewers and maintainers suggested by Danger in the specified category:
Category Reviewer Maintainer backend Joseph Joshua (
@joseph
) (UTC+0, 1 hour behind@sdungarwal
)Max Woolf (
@mwoolf
) (UTC+0, 1 hour behind@sdungarwal
)To spread load more evenly across eligible reviewers, Danger has picked a candidate for each review slot, based on their timezone. Feel free to override these selections if you think someone else would be better-suited or use the GitLab Review Workload Dashboard to find other available reviewers.
To read more on how to use the reviewer roulette, please take a look at the Engineering workflow and code review guidelines. Please consider assigning a reviewer or maintainer who is a domain expert in the area of the merge request.
Once you've decided who will review this merge request, assign them as a reviewer! Danger does not automatically notify them for you.
If needed, you can retry the
🔁 danger-review
job that generated this comment.Generated by
🚫 DangerEdited by Ghost User
mentioned in issue #351381 (closed)
added 1 commit
- 09200e41 - Add specs and rename migration acc to class name
- Resolved by Siddharth Dungarwal
- Resolved by Siddharth Dungarwal
- Resolved by Siddharth Dungarwal
added 1 commit
- 588b166e - Add specs and rename migration acc to class name
added 1 commit
- e08e3eb4 - Add specs and rename migration acc to class name
- Resolved by Siddharth Dungarwal
marked the checklist item I have evaluated the MR acceptance checklist for this MR. as completed