In staging, run an Import from `gitlabhq` daily and measure the time it takes to complete
Proactive Measurement
Ideally, we should be running the import process on a known dataset (here GitLabHQ) on a regular/daily basis to detect any performance degradation. We have an export from GitLab but it needs to be refreshed. Export could be a candidate test to run as well.
Steps:
-
Get a refreshed copy of export -
Prep staging for regular testing of import
After discussing a possible target place for such script/scenario (more details in the comments below), we decided that for an MVC it would be easier to go with a separate repository, which would have a script and a scheduled pipeline.
The repository would be transferred under the responsibility of the appropriate team (Manage:Import / Quality) after 12.9
(when Memory team is going to switch from the Import epic).
UPD: The repository: https://gitlab.com/gitlab-org/memory-team/import-export-performance
UPD 2: A successfully completed scheduled pipeline with the gitlabhq
Import: https://gitlab.com/gitlab-org/memory-team/import-export-performance/-/jobs/429651918
@gl-memory