Skip to content
Snippets Groups Projects

rspec migration pg14 single-db-ci-connection 12/26

Passed Started by
Simon Tomlinson
@stomlinson
Log timestamps in UTC.
121:21:50Running with gitlab-runner 17.4.0~pre.110.g27400594 (27400594)
221:21:50 on blue-7.private.runners-manager.gitlab.com/gitlab.com/gitlab-org t2_D8W8T8, system ID: s_70a59484c8db
321:21:50 feature flags: FF_NETWORK_PER_BUILD:true, FF_TIMESTAMPS:true
421:21:50Resolving secrets
5 21:21:50 Preparing the "docker+machine" executor 00:09
621:21:50Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
721:21:52Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1...
821:21:52Authenticating with credentials from job payload (GitLab Registry)
921:21:52Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
1021:21:52Using docker image sha256:82f132c22567f8ce17cc132c14b2f9aa3eaf9bb5424d91c2d966912433f0257d for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:c55e1364ee4327b244a9cfa1750f19feea14fc774eaf792b725967d146eb45f5 ...
1121:21:53WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1221:21:53WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1321:21:53Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12...
1421:21:53Authenticating with credentials from job payload (GitLab Registry)
1521:21:53Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
1621:21:53Using docker image sha256:5c5ba5b83d6c60cb0b225bd670b7a43be8c238cc72347d24af57e5027c3648f3 for registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:46aceab84c42d0e819c8e7940f2f98ce9e184785cd7b22d95872024a35f52407 ...
1721:21:53Starting service redis:6.2-alpine...
1821:21:53Pulling docker image redis:6.2-alpine ...
1921:21:54Using docker image sha256:4100b5bd17430263e85ad9d8ab851959b234acaaf378e093f1f98400f4998815 for redis:6.2-alpine with digest redis@sha256:eaba718fecd1196d88533de7ba49bf903ad33664a92debb24660a922ecd9cac8 ...
2021:21:55Waiting for services to be up and running (timeout 30 seconds)...
2121:21:59Authenticating with credentials from job payload (GitLab Registry)
2221:21:59Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
2321:21:59Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
24 21:21:59 Preparing environment 00:01
2521:21:59Running on runner-t2d8w8t8-project-278964-concurrent-0 via runner-t2d8w8t8-private-1731611046-e3145a80...
26 21:22:00 Getting source from Git repository 00:00
2721:22:00Skipping Git repository setup
2821:22:00Skipping Git checkout
2921:22:00Skipping Git submodules setup
30 21:22:00 Restoring cache 00:19
3121:22:01Checking cache for ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20...
3221:22:01cache.zip is up to date
3321:22:13Successfully extracted cache
34 21:22:19 Downloading artifacts 00:45
3521:22:19Downloading artifacts for clone-gitlab-repo (8368443091)...
3621:22:24Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8368443091 responseStatus=200 OK token=glcbt-66
3721:22:24WARNING: Part of .git directory is on the list of files to extract
3821:22:24WARNING: This may introduce unexpected problems
3921:22:37Downloading artifacts for compile-test-assets (8368443337)...
4021:22:41Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8368443337 responseStatus=200 OK token=glcbt-66
4121:22:47Downloading artifacts for detect-tests (8368443460)...
4221:22:47Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8368443460 responseStatus=200 OK token=glcbt-66
4321:22:47Downloading artifacts for retrieve-tests-metadata (8368443480)...
4421:22:48Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8368443480 responseStatus=200 OK token=glcbt-66
4521:22:48Downloading artifacts for setup-test-env (8368443411)...
4621:22:52Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8368443411 responseStatus=200 OK token=glcbt-66
47 21:23:04 Executing "step_script" stage of the job script
4821:23:04Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
4921:23:05$ echo $FOSS_ONLY
5021:23:05$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
5121:23:05$ export GOPATH=$CI_PROJECT_DIR/.go
5221:23:05$ mkdir -p $GOPATH
5321:23:05$ source scripts/utils.sh
5421:23:05$ log_disk_usage "true"
5521:23:05*******************************************************
5621:23:05This runner currently has 75G free disk space.
5721:23:05*******************************************************
58 21:23:05 Disk usage detail 00:04
5921:23:05df -h
6021:23:05Filesystem Size Used Avail Use% Mounted on
6121:23:05overlay 95G 20G 75G 21% /
6221:23:05tmpfs 64M 0 64M 0% /dev
6321:23:05shm 64M 0 64M 0% /dev/shm
6421:23:05/dev/sda1 95G 20G 75G 21% /cache
6521:23:05tmpfs 3.9G 0 3.9G 0% /sys/devices/virtual/dmi/id
6621:23:05du -h -d 1
6721:23:057.4M ./workhorse
6821:23:05148K ./bin
6921:23:051.2M ./.gitlab
7021:23:05177M ./.git
7121:23:054.0K ./builds
7221:23:0528M ./lib
7321:23:058.0K ./.vscode
7421:23:05560K ./storybook
7521:23:0524K ./log
7621:23:051.8M ./data
7721:23:0511M ./qa
7821:23:053.2M ./.rubocop_todo
7921:23:05856M ./vendor
8021:23:051023M ./public
8121:23:0562M ./doc
8221:23:05484K ./danger
8321:23:0532K ./rspec
8421:23:05556K ./tooling
8521:23:05146M ./ee
8621:23:051.3M ./knapsack
8721:23:05300K ./patches
8821:23:054.3M ./changelogs
8921:23:0520K ./haml_lint
9021:23:0528K ./metrics_server
9121:23:05108K ./keeps
9221:23:0536K ./shared
9321:23:0544K ./generator_templates
9421:23:051.3M ./scripts
9521:23:05763M ./tmp
9621:23:06127M ./spec
9721:23:0620K ./file_hooks
9821:23:0632K ./crystalball
9921:23:0616K ./sidekiq_cluster
10021:23:0617M ./gems
10121:23:061.2M ./fixtures
10221:23:06964K ./rubocop
10321:23:064.0K ./.go
10421:23:0633M ./db
10521:23:0612K ./.github
10621:23:06129M ./locale
10721:23:0620M ./config
10821:23:0682M ./app
10921:23:0620K ./.lefthook
11021:23:063.5G .
11121:23:06$ source scripts/prepare_build.sh
112 21:23:06 Installing gems 00:15
14321:23:21Using two connections, single database config (config/database.yml.postgresql)
14421:23:21Geo DB won't be set up.
14521:23:21Embedding DB won't be set up.
146 21:23:21 Setting up DBs 00:47
15921:24:08$ source ./scripts/rspec_helpers.sh
16021:24:08$ run_timed_command "gem install knapsack --no-document"
16121:24:08$ gem install knapsack --no-document
16221:24:09Successfully installed knapsack-4.0.0
16321:24:091 gem installed
16421:24:08==> 'gem install knapsack --no-document' succeeded in 1 seconds.
16521:24:09$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"
166 21:24:09 Spawning Gitaly 00:04
17021:24:13$ export RSPEC_SKIPPED_TESTS_REPORT_PATH="rspec/skipped_tests-${CI_JOB_ID}.txt"
17121:24:13$ export RSPEC_RETRIED_TESTS_REPORT_PATH="rspec/retried_tests-${CI_JOB_ID}.txt"
17221:24:13$ tooling/bin/create_job_metrics_file || true
17321:24:16[job-metrics] Creating the job metrics file for the CI/CD job.
17421:24:16$ rspec_section rspec_parallelized_job "--fail-fast=${RSPEC_FAIL_FAST_THRESHOLD} --tag ~quarantine --tag ~zoekt --tag ~click_house"
175 21:24:16 RSpec 03:41
17621:24:16[21:24:16] Starting rspec_parallelized_job
17721:24:09RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
17821:24:16KNAPSACK_GENERATE_REPORT: true
17921:24:16FLAKY_RSPEC_GENERATE_REPORT: true
18021:24:16KNAPSACK_TEST_FILE_PATTERN: spec/{migrations}{,/**/}*_spec.rb
18121:24:16KNAPSACK_LOG_LEVEL: debug
18221:24:16KNAPSACK_REPORT_PATH: knapsack/rspec_migration_pg14_single-db-ci-connection_12_26_278964_report.json
18321:24:16FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
18421:24:16FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec_migration_pg14_single-db-ci-connection_12_26_278964_report.json
18521:24:16NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec_migration_pg14_single-db-ci-connection_12_26_278964_report.json
18621:24:16RSPEC_SKIPPED_TESTS_REPORT_PATH: rspec/skipped_tests-8368446066.txt
18721:24:16CRYSTALBALL:
18821:24:16RSPEC_TESTS_MAPPING_ENABLED:
18921:24:16RSPEC_TESTS_FILTER_FILE:
19021:24:16Shell set options (set -o) enabled:
19121:24:16braceexpand on
19221:24:16hashall on
19321:24:16interactive-comments on
19421:24:16pipefail on
19521:24:22Knapsack report generator started!
19621:24:16/builds/gitlab-org/gitlab/vendor/ruby/3.2.0/gems/io-event-1.6.5/lib/io/event/support.rb:27: warning: IO::Buffer is experimental and both the Ruby and C interface may change in the future!
19721:24:55DEPRECATION WARNING: Support for Rails versions < 7.1 is deprecated and will be removed from ViewComponent 4.0.0 (ViewComponent v4 will remove support for Rails versions < 7.1 no earlier than April 1, 2025) (called from <top (required)> at /builds/gitlab-org/gitlab/config/environment.rb:7)
19821:25:03warning: parser/current is loading parser/ruby32, which recognizes 3.2.6-compliant syntax, but you are running 3.2.5.
19921:25:03Please see https://github.com/whitequark/parser#compatibility-with-ruby-mri.
20021:25:07Run options: exclude {:quarantine=>true, :zoekt=>true, :click_house=>true}
20121:25:07# [RSpecRunTime] Starting RSpec timer...
20221:25:07[TEST PROF INFO] EventProf enabled (sql.active_record)
20321:25:07unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
20421:25:11Test environment set up in 0.688500889 seconds
20521:25:12# [RSpecRunTime] Starting example group spec/migrations/20241003110148_queue_backfill_runner_type_and_sharding_key_id_on_ci_runner_managers_spec.rb. Expected to take 32.25 seconds.
20621:25:12QueueBackfillRunnerTypeAndShardingKeyIdOnCiRunnerManagers
20721:25:20ci: == [advisory_lock_connection] object_id: 2053660, pg_backend_pid: 123
20821:25:20ci: == 20241003110148 QueueBackfillRunnerTypeAndShardingKeyIdOnCiRunnerManagers: migrating
20921:25:20ci: == 20241003110148 QueueBackfillRunnerTypeAndShardingKeyIdOnCiRunnerManagers: migrated (0.0248s)
21021:25:20ci: == [advisory_lock_connection] object_id: 2053660, pg_backend_pid: 123
21121:25:24 does not schedule a new batched migration
21221:25:42# [RSpecRunTime] Finishing example group spec/migrations/20241003110148_queue_backfill_runner_type_and_sharding_key_id_on_ci_runner_managers_spec.rb. It took 30.05 seconds. Expected to take 32.25 seconds.
21321:25:42# [RSpecRunTime] Starting example group spec/migrations/20240930143923_queue_backfill_dast_profiles_pipelines_project_id_spec.rb. Expected to take 16.07 seconds.
21421:25:42QueueBackfillDastProfilesPipelinesProjectId
21521:25:50main: == [advisory_lock_connection] object_id: 6667800, pg_backend_pid: 136
21621:25:50main: == 20240930143922 QueueBackfillDastProfilesPipelinesProjectId: migrating ======
21721:25:50main: == 20240930143922 QueueBackfillDastProfilesPipelinesProjectId: migrated (0.0539s)
21821:25:50main: == [advisory_lock_connection] object_id: 6667800, pg_backend_pid: 136
21921:25:54 schedules a new batched migration
22021:26:13# [RSpecRunTime] Finishing example group spec/migrations/20240930143923_queue_backfill_dast_profiles_pipelines_project_id_spec.rb. It took 31.17 seconds. Expected to take 16.07 seconds.
22121:26:13# [RSpecRunTime] RSpec elapsed time: 1 minute 5.95 seconds. Current RSS: ~1226M. Threads: 1. load average: 1.39 1.33 1.20 1/286 387
22221:26:13.
22321:26:13# [RSpecRunTime] Starting example group spec/migrations/20241015080747_queue_backfill_dependency_proxy_manifest_states_group_id_spec.rb. Expected to take 10.67 seconds.
22421:26:13QueueBackfillDependencyProxyManifestStatesGroupId
22521:26:18main: == [advisory_lock_connection] object_id: 10475140, pg_backend_pid: 147
22621:26:18main: == 20241015080747 QueueBackfillDependencyProxyManifestStatesGroupId: migrating
22721:26:18main: == 20241015080747 QueueBackfillDependencyProxyManifestStatesGroupId: migrated (0.0678s)
22821:26:18main: == [advisory_lock_connection] object_id: 10475140, pg_backend_pid: 147
22921:26:22 schedules a new batched migration
23021:26:35# [RSpecRunTime] Finishing example group spec/migrations/20241015080747_queue_backfill_dependency_proxy_manifest_states_group_id_spec.rb. It took 21.67 seconds. Expected to take 10.67 seconds.
23121:26:35# [RSpecRunTime] RSpec elapsed time: 1 minute 27.98 seconds. Current RSS: ~1231M. Threads: 1. load average: 1.28 1.30 1.19 1/286 388
23221:26:35.
23321:26:35# [RSpecRunTime] Starting example group spec/migrations/20231016194927_queue_delete_invalid_protected_branch_push_access_levels_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20231016194927_queue_delete_invalid_protected_branch_push_access_levels_spec.rb.
23421:26:35QueueDeleteInvalidProtectedBranchPushAccessLevels
23521:26:35 schedules a new batched migration (PENDING: Skipping because migration QueueDeleteInvalidProtectedBranchPushAccessLevels is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
23621:26:35# [RSpecRunTime] Finishing example group spec/migrations/20231016194927_queue_delete_invalid_protected_branch_push_access_levels_spec.rb. It took 0.01 second. Missing expected duration from Knapsack report for spec/migrations/20231016194927_queue_delete_invalid_protected_branch_push_access_levels_spec.rb.
23721:26:35# [RSpecRunTime] Starting example group spec/migrations/20240108082419_queue_backfill_partition_id_ci_pipeline_metadata_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240108082419_queue_backfill_partition_id_ci_pipeline_metadata_spec.rb.
23821:26:35QueueBackfillPartitionIdCiPipelineMetadata
23921:26:35 #up
24021:26:35 with migration present
24121:26:35 when migration finished successfully
24221:26:35 does not raise exception (PENDING: Skipping because migration QueueBackfillPartitionIdCiPipelineMetadata is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
24321:26:35 schedules background jobs for each batch of ci_pipeline_metadata (PENDING: Skipping because migration QueueBackfillPartitionIdCiPipelineMetadata is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
24421:26:35 #down
24521:26:35 deletes all batched migration records (PENDING: Skipping because migration QueueBackfillPartitionIdCiPipelineMetadata is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
24621:26:35# [RSpecRunTime] Finishing example group spec/migrations/20240108082419_queue_backfill_partition_id_ci_pipeline_metadata_spec.rb. It took 0.01 second. Missing expected duration from Knapsack report for spec/migrations/20240108082419_queue_backfill_partition_id_ci_pipeline_metadata_spec.rb.
24721:26:35# [RSpecRunTime] Starting example group spec/migrations/20240306120522_queue_update_sbom_occurrences_component_name_based_on_pep503_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240306120522_queue_update_sbom_occurrences_component_name_based_on_pep503_spec.rb.
24821:26:35QueueUpdateSbomOccurrencesComponentNameBasedOnPep503
24921:26:35 schedules a new batched migration (PENDING: Skipping because migration QueueUpdateSbomOccurrencesComponentNameBasedOnPep503 is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
25021:26:35# [RSpecRunTime] Finishing example group spec/migrations/20240306120522_queue_update_sbom_occurrences_component_name_based_on_pep503_spec.rb. It took 0.01 second. Missing expected duration from Knapsack report for spec/migrations/20240306120522_queue_update_sbom_occurrences_component_name_based_on_pep503_spec.rb.
25121:26:35# [RSpecRunTime] Starting example group spec/migrations/20240510113339_finalize_backfill_epic_basic_fields_to_work_item_record_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240510113339_finalize_backfill_epic_basic_fields_to_work_item_record_spec.rb.
25221:26:35FinalizeBackfillEpicBasicFieldsToWorkItemRecord
25321:26:35 #up
25421:26:35 ensures the migration is completed for self-managed instances (PENDING: Skipping because migration FinalizeBackfillEpicBasicFieldsToWorkItemRecord is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
25521:26:35 skips the check for GitLab.com, dev, or test (PENDING: Skipping because migration FinalizeBackfillEpicBasicFieldsToWorkItemRecord is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
25621:26:35# [RSpecRunTime] Finishing example group spec/migrations/20240510113339_finalize_backfill_epic_basic_fields_to_work_item_record_spec.rb. It took 0.01 second. Missing expected duration from Knapsack report for spec/migrations/20240510113339_finalize_backfill_epic_basic_fields_to_work_item_record_spec.rb.
25721:26:35# [RSpecRunTime] Starting example group spec/migrations/20240530122159_queue_backfill_remote_development_agent_configs_project_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240530122159_queue_backfill_remote_development_agent_configs_project_id_spec.rb.
25821:26:35QueueBackfillRemoteDevelopmentAgentConfigsProjectId
25921:26:35 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillRemoteDevelopmentAgentConfigsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
26021:26:35# [RSpecRunTime] Finishing example group spec/migrations/20240530122159_queue_backfill_remote_development_agent_configs_project_id_spec.rb. It took 0.01 second. Missing expected duration from Knapsack report for spec/migrations/20240530122159_queue_backfill_remote_development_agent_configs_project_id_spec.rb.
26121:26:35# [RSpecRunTime] Starting example group spec/migrations/20240611121818_remove_project_statistics_packages_size_and_project_id_index_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240611121818_remove_project_statistics_packages_size_and_project_id_index_spec.rb.
26221:26:35RemoveProjectStatisticsPackagesSizeAndProjectIdIndex
26321:26:35 #up
26421:26:35 does nothing when not on gitlab.com (PENDING: Skipping because migration RemoveProjectStatisticsPackagesSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
26521:26:35 prepares async index removal when on gitlab.com (PENDING: Skipping because migration RemoveProjectStatisticsPackagesSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
26621:26:35 #down
26721:26:35 does nothing when not on gitlab.com (PENDING: Skipping because migration RemoveProjectStatisticsPackagesSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
26821:26:35 unprepares async index removal when on gitlab.com (PENDING: Skipping because migration RemoveProjectStatisticsPackagesSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
26921:26:35# [RSpecRunTime] Finishing example group spec/migrations/20240611121818_remove_project_statistics_packages_size_and_project_id_index_spec.rb. It took 0.01 second. Missing expected duration from Knapsack report for spec/migrations/20240611121818_remove_project_statistics_packages_size_and_project_id_index_spec.rb.
27021:26:35# [RSpecRunTime] Starting example group spec/migrations/20240624135063_queue_backfill_vulnerability_external_issue_links_project_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240624135063_queue_backfill_vulnerability_external_issue_links_project_id_spec.rb.
27121:26:35QueueBackfillVulnerabilityExternalIssueLinksProjectId
27221:26:35 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillVulnerabilityExternalIssueLinksProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
27321:26:35# [RSpecRunTime] Finishing example group spec/migrations/20240624135063_queue_backfill_vulnerability_external_issue_links_project_id_spec.rb. It took 0.01 second. Missing expected duration from Knapsack report for spec/migrations/20240624135063_queue_backfill_vulnerability_external_issue_links_project_id_spec.rb.
27421:26:35# [RSpecRunTime] Starting example group spec/migrations/20240716133952_queue_backfill_evidences_project_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240716133952_queue_backfill_evidences_project_id_spec.rb.
27521:26:35QueueBackfillEvidencesProjectId
27621:26:35 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillEvidencesProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
27721:26:35# [RSpecRunTime] Finishing example group spec/migrations/20240716133952_queue_backfill_evidences_project_id_spec.rb. It took 0.01 second. Missing expected duration from Knapsack report for spec/migrations/20240716133952_queue_backfill_evidences_project_id_spec.rb.
27821:26:35# [RSpecRunTime] Starting example group spec/migrations/20240807143914_remove_crm_contacts_widget_from_work_item_types_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240807143914_remove_crm_contacts_widget_from_work_item_types_spec.rb.
27921:26:35RemoveCrmContactsWidgetFromWorkItemTypes
28021:26:35 #up
28121:26:35 removes definitions for widget (PENDING: Skipping because migration RemoveCrmContactsWidgetFromWorkItemTypes is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
28221:26:35 #down
28321:26:35 creates widget definition in all types (PENDING: Skipping because migration RemoveCrmContactsWidgetFromWorkItemTypes is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
28421:26:35 logs a warning if the type is missing (PENDING: Skipping because migration RemoveCrmContactsWidgetFromWorkItemTypes is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
28521:26:35 when the widget already exists
28621:26:35 upserts the widget definitions and raises no error (PENDING: Skipping because migration RemoveCrmContactsWidgetFromWorkItemTypes is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
28721:26:35# [RSpecRunTime] Finishing example group spec/migrations/20240807143914_remove_crm_contacts_widget_from_work_item_types_spec.rb. It took 0.01 second. Missing expected duration from Knapsack report for spec/migrations/20240807143914_remove_crm_contacts_widget_from_work_item_types_spec.rb.
28821:26:35# [RSpecRunTime] Starting example group spec/migrations/20240906080833_requeue_backfill_packages_dependencies_project_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240906080833_requeue_backfill_packages_dependencies_project_id_spec.rb.
28921:26:35RequeueBackfillPackagesDependenciesProjectId
29021:26:35 schedules a new batched migration (PENDING: Skipping because migration RequeueBackfillPackagesDependenciesProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29121:26:35# [RSpecRunTime] Finishing example group spec/migrations/20240906080833_requeue_backfill_packages_dependencies_project_id_spec.rb. It took 0.01 second. Missing expected duration from Knapsack report for spec/migrations/20240906080833_requeue_backfill_packages_dependencies_project_id_spec.rb.
29221:26:35# [RSpecRunTime] Starting example group spec/migrations/db/post_migrate/20240902114825_truncate_ci_finished_build_ch_sync_events_if_click_house_not_configured_spec.rb. Missing expected duration from Knapsack report for spec/migrations/db/post_migrate/20240902114825_truncate_ci_finished_build_ch_sync_events_if_click_house_not_configured_spec.rb.
29321:26:35TruncateCiFinishedBuildChSyncEventsIfClickHouseNotConfigured
29421:26:35 when ClickHouse is not configured
29521:26:35 truncates p_ci_finished_build_ch_sync_events table (PENDING: Skipping because migration TruncateCiFinishedBuildChSyncEventsIfClickHouseNotConfigured is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29621:26:35 when ClickHouse is configured
29721:26:35 does not truncate p_ci_finished_build_ch_sync_events table (PENDING: Skipping because migration TruncateCiFinishedBuildChSyncEventsIfClickHouseNotConfigured is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29821:26:35# [RSpecRunTime] Finishing example group spec/migrations/db/post_migrate/20240902114825_truncate_ci_finished_build_ch_sync_events_if_click_house_not_configured_spec.rb. It took 0.01 second. Missing expected duration from Knapsack report for spec/migrations/db/post_migrate/20240902114825_truncate_ci_finished_build_ch_sync_events_if_click_house_not_configured_spec.rb.
29921:26:38auto_explain log contains 841 entries for main, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-migration-pg14-single-db-ci-connection-12-26.342.main.ndjson.gz
30021:26:38took 2.768446003
30121:26:39auto_explain log contains 842 entries for ci, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-migration-pg14-single-db-ci-connection-12-26.342.ci.ndjson.gz
30221:26:39took 1.464120991
30321:26:39[TEST PROF INFO] EventProf results for sql.active_record
30421:26:39Total time: 00:47.981 of 01:23.437 (57.51%)
30521:26:39Total events: 45122
30621:26:39Top 5 slowest suites (by time):
30721:26:39QueueBackfill...linesProjectId (./spec/migrations/20240930143923_queue_backfill_dast_profiles_pipelines_project_id_spec.rb:6) – 00:18.547 (16894 / 1) of 00:31.521 (58.84%)
30821:26:39QueueBackfill...RunnerManagers (./spec/migrations/20241003110148_queue_backfill_runner_type_and_sharding_key_id_on_ci_runner_managers_spec.rb:6) – 00:17.299 (16310 / 1) of 00:30.048 (57.57%)
30921:26:39QueueBackfill...tStatesGroupId (./spec/migrations/20241015080747_queue_backfill_dependency_proxy_manifest_states_group_id_spec.rb:6) – 00:12.101 (11841 / 1) of 00:21.713 (55.73%)
31021:26:39RequeueBackfi...nciesProjectId (./spec/migrations/20240906080833_requeue_backfill_packages_dependencies_project_id_spec.rb:6) – 00:00.003 (7 / 1) of 00:00.014 (22.55%)
31121:26:39RemoveCrmCont...mWorkItemTypes (./spec/migrations/20240807143914_remove_crm_contacts_widget_from_work_item_types_spec.rb:6) – 00:00.003 (7 / 4) of 00:00.014 (21.08%)
31221:26:39Knapsack report was generated. Preview:
31321:26:39{
31421:26:39 "spec/migrations/20241003110148_queue_backfill_runner_type_and_sharding_key_id_on_ci_runner_managers_spec.rb": 12.702712091000649,
31521:26:39 "spec/migrations/20240930143923_queue_backfill_dast_profiles_pipelines_project_id_spec.rb": 12.616649337000126,
31621:26:39 "spec/migrations/20241015080747_queue_backfill_dependency_proxy_manifest_states_group_id_spec.rb": 9.010506664000786
31721:26:39}
31821:26:39Knapsack global time execution for tests: 34s
31921:26:39Pending: (Failures listed here are expected and do not affect your suite's status)
32021:26:39 1) QueueDeleteInvalidProtectedBranchPushAccessLevels schedules a new batched migration
32121:26:39 # Skipping because migration QueueDeleteInvalidProtectedBranchPushAccessLevels is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
32221:26:39 # ./spec/migrations/20231016194927_queue_delete_invalid_protected_branch_push_access_levels_spec.rb:9
32321:26:39 2) QueueBackfillPartitionIdCiPipelineMetadata#up with migration present when migration finished successfully does not raise exception
32421:26:39 # Skipping because migration QueueBackfillPartitionIdCiPipelineMetadata is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
32521:26:39 # ./spec/migrations/20240108082419_queue_backfill_partition_id_ci_pipeline_metadata_spec.rb:29
32621:26:39 3) QueueBackfillPartitionIdCiPipelineMetadata#up with migration present when migration finished successfully schedules background jobs for each batch of ci_pipeline_metadata
32721:26:39 # Skipping because migration QueueBackfillPartitionIdCiPipelineMetadata is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
32821:26:39 # ./spec/migrations/20240108082419_queue_backfill_partition_id_ci_pipeline_metadata_spec.rb:33
32921:26:39 4) QueueBackfillPartitionIdCiPipelineMetadata#down deletes all batched migration records
33021:26:39 # Skipping because migration QueueBackfillPartitionIdCiPipelineMetadata is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
33121:26:39 # ./spec/migrations/20240108082419_queue_backfill_partition_id_ci_pipeline_metadata_spec.rb:49
33221:26:39 5) QueueUpdateSbomOccurrencesComponentNameBasedOnPep503 schedules a new batched migration
33321:26:39 # Skipping because migration QueueUpdateSbomOccurrencesComponentNameBasedOnPep503 is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
33421:26:39 # ./spec/migrations/20240306120522_queue_update_sbom_occurrences_component_name_based_on_pep503_spec.rb:10
33521:26:39 6) FinalizeBackfillEpicBasicFieldsToWorkItemRecord#up ensures the migration is completed for self-managed instances
33621:26:39 # Skipping because migration FinalizeBackfillEpicBasicFieldsToWorkItemRecord is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
33721:26:39 # ./spec/migrations/20240510113339_finalize_backfill_epic_basic_fields_to_work_item_record_spec.rb:18
33821:26:39 7) FinalizeBackfillEpicBasicFieldsToWorkItemRecord#up skips the check for GitLab.com, dev, or test
33921:26:39 # Skipping because migration FinalizeBackfillEpicBasicFieldsToWorkItemRecord is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34021:26:39 # ./spec/migrations/20240510113339_finalize_backfill_epic_basic_fields_to_work_item_record_spec.rb:29
34121:26:39 8) QueueBackfillRemoteDevelopmentAgentConfigsProjectId schedules a new batched migration
34221:26:39 # Skipping because migration QueueBackfillRemoteDevelopmentAgentConfigsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34321:26:39 # ./spec/migrations/20240530122159_queue_backfill_remote_development_agent_configs_project_id_spec.rb:9
34421:26:39 9) RemoveProjectStatisticsPackagesSizeAndProjectIdIndex#up does nothing when not on gitlab.com
34521:26:39 # Skipping because migration RemoveProjectStatisticsPackagesSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34621:26:39 # ./spec/migrations/20240611121818_remove_project_statistics_packages_size_and_project_id_index_spec.rb:14
34721:26:39 10) RemoveProjectStatisticsPackagesSizeAndProjectIdIndex#up prepares async index removal when on gitlab.com
34821:26:39 # Skipping because migration RemoveProjectStatisticsPackagesSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34921:26:39 # ./spec/migrations/20240611121818_remove_project_statistics_packages_size_and_project_id_index_spec.rb:18
35021:26:39 11) RemoveProjectStatisticsPackagesSizeAndProjectIdIndex#down does nothing when not on gitlab.com
35121:26:39 # Skipping because migration RemoveProjectStatisticsPackagesSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35221:26:39 # ./spec/migrations/20240611121818_remove_project_statistics_packages_size_and_project_id_index_spec.rb:34
35321:26:39 12) RemoveProjectStatisticsPackagesSizeAndProjectIdIndex#down unprepares async index removal when on gitlab.com
35421:26:39 # Skipping because migration RemoveProjectStatisticsPackagesSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35521:26:39 # ./spec/migrations/20240611121818_remove_project_statistics_packages_size_and_project_id_index_spec.rb:38
35621:26:39 13) QueueBackfillVulnerabilityExternalIssueLinksProjectId schedules a new batched migration
35721:26:39 # Skipping because migration QueueBackfillVulnerabilityExternalIssueLinksProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35821:26:39 # ./spec/migrations/20240624135063_queue_backfill_vulnerability_external_issue_links_project_id_spec.rb:9
35921:26:39 14) QueueBackfillEvidencesProjectId schedules a new batched migration
36021:26:39 # Skipping because migration QueueBackfillEvidencesProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
36121:26:39 # ./spec/migrations/20240716133952_queue_backfill_evidences_project_id_spec.rb:10
36221:26:39 15) RemoveCrmContactsWidgetFromWorkItemTypes#up removes definitions for widget
36321:26:39 # Skipping because migration RemoveCrmContactsWidgetFromWorkItemTypes is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
36421:26:39 # ./spec/migrations/20240807143914_remove_crm_contacts_widget_from_work_item_types_spec.rb:16
36521:26:39 16) RemoveCrmContactsWidgetFromWorkItemTypes#down creates widget definition in all types
36621:26:39 # Skipping because migration RemoveCrmContactsWidgetFromWorkItemTypes is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
36721:26:39 # ./spec/migrations/20240807143914_remove_crm_contacts_widget_from_work_item_types_spec.rb:28
36821:26:39 17) RemoveCrmContactsWidgetFromWorkItemTypes#down logs a warning if the type is missing
36921:26:39 # Skipping because migration RemoveCrmContactsWidgetFromWorkItemTypes is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37021:26:39 # ./spec/migrations/20240807143914_remove_crm_contacts_widget_from_work_item_types_spec.rb:35
37121:26:39 18) RemoveCrmContactsWidgetFromWorkItemTypes#down when the widget already exists upserts the widget definitions and raises no error
37221:26:39 # Skipping because migration RemoveCrmContactsWidgetFromWorkItemTypes is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37321:26:39 # ./spec/migrations/20240807143914_remove_crm_contacts_widget_from_work_item_types_spec.rb:60
37421:26:39 19) RequeueBackfillPackagesDependenciesProjectId schedules a new batched migration
37521:26:39 # Skipping because migration RequeueBackfillPackagesDependenciesProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37621:26:39 # ./spec/migrations/20240906080833_requeue_backfill_packages_dependencies_project_id_spec.rb:9
37721:26:39 20) TruncateCiFinishedBuildChSyncEventsIfClickHouseNotConfigured when ClickHouse is not configured truncates p_ci_finished_build_ch_sync_events table
37821:26:39 # Skipping because migration TruncateCiFinishedBuildChSyncEventsIfClickHouseNotConfigured is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37921:26:39 # ./spec/migrations/db/post_migrate/20240902114825_truncate_ci_finished_build_ch_sync_events_if_click_house_not_configured_spec.rb:41
38021:26:39 21) TruncateCiFinishedBuildChSyncEventsIfClickHouseNotConfigured when ClickHouse is configured does not truncate p_ci_finished_build_ch_sync_events table
38121:26:39 # Skipping because migration TruncateCiFinishedBuildChSyncEventsIfClickHouseNotConfigured is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
38221:26:39 # ./spec/migrations/db/post_migrate/20240902114825_truncate_ci_finished_build_ch_sync_events_if_click_house_not_configured_spec.rb:52
38321:26:39Finished in 1 minute 32.43 seconds (files took 48.14 seconds to load)
38421:26:3924 examples, 0 failures, 21 pending
38521:26:39Randomized with seed 38608
38621:26:45[TEST PROF INFO] Time spent in factories: 00:00.159 (0.17% of total time)
38721:26:45RSpec exited with 0.
38821:26:45No examples to retry, congrats!
389 21:26:45 Running after_script 00:13
39021:26:46Running after script...
39121:26:46$ source scripts/utils.sh
39221:26:46$ log_disk_usage
39321:26:46*******************************************************
39421:26:46This runner currently has 74G free disk space.
39521:26:46*******************************************************
396 21:26:46 Disk usage detail 00:04
45221:26:50$ bundle exec gem list gitlab_quality-test_tooling
45321:26:53gitlab_quality-test_tooling (2.1.0)
45421:26:53$ section_start "failed-test-issues" "Report test failures" # collapsed multi-line command
455 21:26:53 Report test failures 00:00
45721:26:53$ section_start "flaky-test-issues" "Report test flakiness" # collapsed multi-line command
458 21:26:53 Report test flakiness 00:00
46021:26:53$ section_start "slow-test-issues" "Report test slowness" # collapsed multi-line command
461 21:26:53 Report test slowness 00:00
46321:26:53$ section_start "slow-test-merge-request-report-note" "Report test slowness in MR note" # collapsed multi-line command
464 21:26:53 Report test slowness in MR note 00:02
46721:26:55$ section_start "knapsack-report-issues" "Report test files close to timing out" # collapsed multi-line command
468 21:26:55 Report test files close to timing out 00:02
47121:26:57$ tooling/bin/push_job_metrics || true
47221:26:58[job-metrics] Pushing job metrics file for the CI/CD job.
47321:26:58[job-metrics] Pushed 4 CI job metric entries to InfluxDB.
474 21:26:58 Saving cache for successful job 00:01
47521:26:59Not uploading cache ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20 due to policy
476 21:26:59 Uploading artifacts for successful job 00:05
47721:27:00Uploading artifacts...
47821:27:00auto_explain/: found 3 matching artifact files and directories
47921:27:00coverage/: found 5 matching artifact files and directories
48021:27:00crystalball/: found 2 matching artifact files and directories
48121:27:00WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
48221:27:00knapsack/: found 4 matching artifact files and directories
48321:27:00rspec/: found 16 matching artifact files and directories
48421:27:00WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
48521:27:00log/*.log: found 13 matching artifact files and directories
48621:27:00WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8368446066/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
48721:27:00WARNING: Retrying... context=artifacts-uploader error=request redirected
48821:27:03Uploading artifacts as "archive" to coordinator... 201 Created id=8368446066 responseStatus=201 Created token=glcbt-66
48921:27:03Uploading artifacts...
49021:27:03rspec/rspec-*.xml: found 1 matching artifact files and directories
49121:27:03WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8368446066/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
49221:27:03WARNING: Retrying... context=artifacts-uploader error=request redirected
49321:27:04Uploading artifacts as "junit" to coordinator... 201 Created id=8368446066 responseStatus=201 Created token=glcbt-66
494 21:27:04 Cleaning up project directory and file based variables 00:01
49521:27:13Job succeeded