Iterate on data seeding configuration for multi-version upgrades testing
Summary
As part of Expand data seeding configuration for multi-ver... (#2354 - closed), data seeding for PG dumps was extended to include all factories seeding with Data Seeder and expanded data with DB fixtures seeding with SeedFu. The result was calculated as 92% of base tables having at least one record.
The next iteration would be to expand the variety of the data further. As a lot of migration errors that customers face are usually due to specific record(s) that have incomplete or bad data.
Action Items
-
Revisit data seeding coverage in %17.0 with fixes from Investigate db/fixture seeding errors with Seed... (#2513 - closed) -
Explore further options for expanding factories seeding - if there is a way to seed multiple entities of the same factory -
Expand data seeding based on known previous migration errors that customers faced - related to Analyze common Upgrade issues that customers ha... (#2321) -
Investigate gitlab-org/gitlab!146203 (comment 1834312555) - where update-minor
caught an error and multi-version didn't fail https://gitlab.com/gitlab-org/gitlab/-/jobs/6487723894
Edited by Nailia Iskhakova