Skip to content

Project metadata validation failed for small project import tarball

I was trying to use the small project import tarball and received import validation errors after successful project import. The import of the standard large tarball works fine without errors although it takes almost 2 hours to complete (hence the desire to test the small tarball).

GPT data generator (v.1.0.26)

GPT data generator command:

docker run --platform linux/amd64 -it -e ACCESS_TOKEN=$my_token -v $(pwd)/k6/config:/config -v $(pwd)/results:/results gitlab/gpt-data-generator --environment 2k.json --large-project-tarball='https://gitlab.com/gitlab-org/quality/performance-data/-/raw/main/projects_export/small-project_13.0.0.tar.gz' -u

GPT data generator output:

Click to expand 
GPT Data Generator v1.0.26 - opinionated test data for the GitLab Performance Tool
Checking that GitLab environment 'https://scm.platform.us-west-2.qa.avalara.io' is available, supported and that provided Access Token works...
Environment and Access Token check complete - URL: https://scm.platform.us-west-2.qa.avalara.io, Version: 15.5.4-ee d3dda7548e0 {"enabled"=>true, "externalUrl"=>"wss://scm.platform.us-west-2.qa.avalara.io/-/kubernetes-agent/", "version"=>"15.5.1"}
Creating group gpt
Creating group gpt/many_groups_and_projects
Updating GitLab Application Repository Storage setting
Updating application settings: {"repository_storages_weighted[default]"=>100, "repository_storages_weighted[storage1]"=>100}
Creating 100 groups with name prefix 'gpt-subgroup-' under parent group 'gpt/many_groups_and_projects'
Generating groups: 100 from 100 |====================================================================================================================>| Time: 00:00:07 Time: 00:00:07

Checking for existing projects under groups: 100 from 100 |==========================================================================================>| Time: 00:00:26 Time: 00:00:26

Creating 10 projects each under 100 subgroups with name prefix 'gpt-project-'
Generating projects: 1000 from 1000 |================================================================================================================>| Time: 00:02:43 Time: 00:02:43

<-> Horizontal data: successfully generated after 3 minutes 22 seconds!

| Vertical data: importing large projects for GPT...
Group gpt already exists
Creating group gpt/large_projects
Checking if project gitlabhq1 already exists in gpt/large_projects/gitlabhq1...
Disabling Max Import Size limit on environment...
Updating application settings: {:max_import_size=>10240}
Updating GitLab Application Repository Storage setting
Updating application settings: {"repository_storages_weighted[default]"=>100}
Tarball is remote, downloading...
Starting import of Project 'gitlabhq1' from tarball 'https://gitlab.com/gitlab-org/quality/performance-data/-/raw/main/projects_export/small-project_13.0.0.tar.gz' under namespace 'gpt/large_projects' to GitLab environment 'https://scm.platform.us-west-2.qa.avalara.io'

Checking that GitLab environment 'https://scm.platform.us-west-2.qa.avalara.io' is available, supported and that provided Access Token works...
Environment and Access Token check complete - URL: https://scm.platform.us-west-2.qa.avalara.io, Version: 15.5.4-ee d3dda7548e0 {"enabled"=>true, "externalUrl"=>"wss://scm.platform.us-west-2.qa.avalara.io/-/kubernetes-agent/", "version"=>"15.5.1"}
Importing project gitlabhq1...
Note that this may take some time to upload a file to the target environment.
If project import takes more than an hour please refer to the troubleshooting docs https://gitlab.com/gitlab-org/quality/performance/-/blob/main/docs/environment_prep.md#import-looks-to-have-hanged.
Start time: 16:06:44 2022-12-13 UTC
Uploading project tarball to the target environment Import API...

Project tarball has successfully uploaded and started to be imported with ID '22880'
Waiting until Project '22880' has imported successfully....
Project has successfully imported in 7 seconds:
https://scm.platform.us-west-2.qa.avalara.io/gpt/large_projects/gitlabhq1
Validating project 'gpt/large_projects/gitlabhq1' imported successfully...
- Project metadata validation failed: issues count '2' should be '6722' or higher as specified in the Project Config file.
To troubleshoot please refer to https://gitlab.com/gitlab-org/quality/performance/-/blob/main/docs/environment_prep.md#project-metadata-validation-has-failed.
- Project metadata validation failed: merge_requests count '1' should be '3609' or higher as specified in the Project Config file.
To troubleshoot please refer to https://gitlab.com/gitlab-org/quality/performance/-/blob/main/docs/environment_prep.md#project-metadata-validation-has-failed.
- Project metadata validation failed: pipelines count '2' should be '11' or higher as specified in the Project Config file.
To troubleshoot please refer to https://gitlab.com/gitlab-org/quality/performance/-/blob/main/docs/environment_prep.md#project-metadata-validation-has-failed.
Checking if project gitlabhq2 already exists in gpt/large_projects/gitlabhq2...
Disabling Max Import Size limit on environment...
Updating application settings: {:max_import_size=>10240}
Updating GitLab Application Repository Storage setting
Updating application settings: {"repository_storages_weighted[storage1]"=>100}
Starting import of Project 'gitlabhq2' from tarball 'https://gitlab.com/gitlab-org/quality/performance-data/-/raw/main/projects_export/small-project_13.0.0.tar.gz' under namespace 'gpt/large_projects' to GitLab environment 'https://scm.platform.us-west-2.qa.avalara.io'

Checking that GitLab environment 'https://scm.platform.us-west-2.qa.avalara.io' is available, supported and that provided Access Token works...
Environment and Access Token check complete - URL: https://scm.platform.us-west-2.qa.avalara.io, Version: 15.5.4-ee d3dda7548e0 {"enabled"=>true, "externalUrl"=>"wss://scm.platform.us-west-2.qa.avalara.io/-/kubernetes-agent/", "version"=>"15.5.1"}
Importing project gitlabhq2...
Note that this may take some time to upload a file to the target environment.
If project import takes more than an hour please refer to the troubleshooting docs https://gitlab.com/gitlab-org/quality/performance/-/blob/main/docs/environment_prep.md#import-looks-to-have-hanged.
Start time: 16:06:56 2022-12-13 UTC
Uploading project tarball to the target environment Import API...

Project tarball has successfully uploaded and started to be imported with ID '22881'
Waiting until Project '22881' has imported successfully....
Project has successfully imported in 7 seconds:
https://scm.platform.us-west-2.qa.avalara.io/gpt/large_projects/gitlabhq2
Validating project 'gpt/large_projects/gitlabhq2' imported successfully...
- Project metadata validation failed: issues count '2' should be '6722' or higher as specified in the Project Config file.
To troubleshoot please refer to https://gitlab.com/gitlab-org/quality/performance/-/blob/main/docs/environment_prep.md#project-metadata-validation-has-failed.
- Project metadata validation failed: merge_requests count '1' should be '3609' or higher as specified in the Project Config file.
To troubleshoot please refer to https://gitlab.com/gitlab-org/quality/performance/-/blob/main/docs/environment_prep.md#project-metadata-validation-has-failed.
- Project metadata validation failed: pipelines count '2' should be '11' or higher as specified in the Project Config file.
To troubleshoot please refer to https://gitlab.com/gitlab-org/quality/performance/-/blob/main/docs/environment_prep.md#project-metadata-validation-has-failed.
| Vertical data: generated with warnings after 3 minutes 48 seconds!

• Project 'gpt/large_projects/gitlabhq1' validation errors:
- Project metadata validation failed: issues count '2' should be '6722' or higher as specified in the Project Config file.
To troubleshoot please refer to https://gitlab.com/gitlab-org/quality/performance/-/blob/main/docs/environment_prep.md#project-metadata-validation-has-failed.
- Project metadata validation failed: merge_requests count '1' should be '3609' or higher as specified in the Project Config file.
To troubleshoot please refer to https://gitlab.com/gitlab-org/quality/performance/-/blob/main/docs/environment_prep.md#project-metadata-validation-has-failed.
- Project metadata validation failed: pipelines count '2' should be '11' or higher as specified in the Project Config file.
To troubleshoot please refer to https://gitlab.com/gitlab-org/quality/performance/-/blob/main/docs/environment_prep.md#project-metadata-validation-has-failed.
Restoring the original 'max_import_size' setting...
Updating application settings: {:max_import_size=>0}
Restoring the original Repository Storage setting in GitLab Application.
Updating application settings: {"repository_storages_weighted[default]"=>100}
Edited by Grant Young