Skip to content
Snippets Groups Projects

rspec migration pg14 single-db-ci-connection 11/26

Passed Started by
Simon Tomlinson
@stomlinson
Log timestamps in UTC.
121:21:49Running with gitlab-runner 17.4.0~pre.110.g27400594 (27400594)
221:21:49 on blue-3.shared-gitlab-org.runners-manager.gitlab.com/default sUrYYgEG, system ID: s_35f98e2af465
321:21:49 feature flags: FF_NETWORK_PER_BUILD:true, FF_TIMESTAMPS:true
421:21:49Resolving secrets
5 21:21:49 Preparing the "docker+machine" executor 00:11
621:21:50Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
721:21:52Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1...
821:21:52Authenticating with credentials from job payload (GitLab Registry)
921:21:52Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
1021:21:52Using docker image sha256:82f132c22567f8ce17cc132c14b2f9aa3eaf9bb5424d91c2d966912433f0257d for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:c55e1364ee4327b244a9cfa1750f19feea14fc774eaf792b725967d146eb45f5 ...
1121:21:53WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1221:21:53WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1321:21:53Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12...
1421:21:53Authenticating with credentials from job payload (GitLab Registry)
1521:21:53Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
1621:21:53Using docker image sha256:5c5ba5b83d6c60cb0b225bd670b7a43be8c238cc72347d24af57e5027c3648f3 for registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:46aceab84c42d0e819c8e7940f2f98ce9e184785cd7b22d95872024a35f52407 ...
1721:21:54Starting service redis:6.2-alpine...
1821:21:54Pulling docker image redis:6.2-alpine ...
1921:21:55Using docker image sha256:4100b5bd17430263e85ad9d8ab851959b234acaaf378e093f1f98400f4998815 for redis:6.2-alpine with digest redis@sha256:eaba718fecd1196d88533de7ba49bf903ad33664a92debb24660a922ecd9cac8 ...
2021:21:55Waiting for services to be up and running (timeout 30 seconds)...
2121:22:00Authenticating with credentials from job payload (GitLab Registry)
2221:22:00Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
2321:22:00Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
24 21:22:00 Preparing environment 00:01
2521:22:00Running on runner-suryygeg-project-278964-concurrent-0 via runner-suryygeg-shared-gitlab-org-1731617050-2f2fcb76...
26 21:22:01 Getting source from Git repository 00:01
2721:22:02Skipping Git repository setup
2821:22:02Skipping Git checkout
2921:22:02Skipping Git submodules setup
30 21:22:02 Restoring cache 00:18
3121:22:02Checking cache for ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20...
3221:22:02Downloading cache from https://storage.googleapis.com/gitlab-com-runners-cache/project/278964/ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20 ETag="19021ff660774ac886a027bf8fc2c15e"
3321:22:15Successfully extracted cache
34 21:22:20 Downloading artifacts 00:51
3521:22:20Downloading artifacts for clone-gitlab-repo (8368443091)...
3621:22:26Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8368443091 responseStatus=200 OK token=glcbt-66
3721:22:26WARNING: Part of .git directory is on the list of files to extract
3821:22:26WARNING: This may introduce unexpected problems
3921:22:41Downloading artifacts for compile-test-assets (8368443337)...
4021:22:45Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8368443337 responseStatus=200 OK token=glcbt-66
4121:22:52Downloading artifacts for detect-tests (8368443460)...
4221:22:52Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8368443460 responseStatus=200 OK token=glcbt-66
4321:22:52Downloading artifacts for retrieve-tests-metadata (8368443480)...
4421:22:53Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8368443480 responseStatus=200 OK token=glcbt-66
4521:22:53Downloading artifacts for setup-test-env (8368443411)...
4621:22:58Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8368443411 responseStatus=200 OK token=glcbt-66
47 21:23:11 Executing "step_script" stage of the job script
4821:23:11Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
4921:23:12$ echo $FOSS_ONLY
5021:23:12$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
5121:23:12$ export GOPATH=$CI_PROJECT_DIR/.go
5221:23:12$ mkdir -p $GOPATH
5321:23:12$ source scripts/utils.sh
5421:23:12$ log_disk_usage "true"
5521:23:12*******************************************************
5621:23:12This runner currently has 31G free disk space.
5721:23:12*******************************************************
58 21:23:12 Disk usage detail 00:03
5921:23:12df -h
6021:23:12Filesystem Size Used Avail Use% Mounted on
6121:23:12overlay 46G 15G 31G 34% /
6221:23:12tmpfs 64M 0 64M 0% /dev
6321:23:12shm 256M 0 256M 0% /dev/shm
6421:23:12/dev/sda1 46G 15G 31G 34% /cache
6521:23:12tmpfs 3.9G 0 3.9G 0% /sys/devices/virtual/dmi/id
6621:23:12tmpfs 3.9G 0 3.9G 0% /proc/acpi
6721:23:12tmpfs 3.9G 0 3.9G 0% /proc/scsi
6821:23:12tmpfs 3.9G 0 3.9G 0% /sys/firmware
6921:23:12du -h -d 1
7021:23:127.4M ./workhorse
7121:23:12148K ./bin
7221:23:121.2M ./.gitlab
7321:23:12177M ./.git
7421:23:124.0K ./builds
7521:23:1228M ./lib
7621:23:128.0K ./.vscode
7721:23:12560K ./storybook
7821:23:1224K ./log
7921:23:121.8M ./data
8021:23:1211M ./qa
8121:23:123.2M ./.rubocop_todo
8221:23:12856M ./vendor
8321:23:121023M ./public
8421:23:1262M ./doc
8521:23:12484K ./danger
8621:23:1232K ./rspec
8721:23:12556K ./tooling
8821:23:12146M ./ee
8921:23:121.3M ./knapsack
9021:23:12300K ./patches
9121:23:124.3M ./changelogs
9221:23:1220K ./haml_lint
9321:23:1228K ./metrics_server
9421:23:12108K ./keeps
9521:23:1236K ./shared
9621:23:1244K ./generator_templates
9721:23:121.3M ./scripts
9821:23:12763M ./tmp
9921:23:12127M ./spec
10021:23:1220K ./file_hooks
10121:23:1232K ./crystalball
10221:23:1216K ./sidekiq_cluster
10321:23:1217M ./gems
10421:23:121.2M ./fixtures
10521:23:12964K ./rubocop
10621:23:124.0K ./.go
10721:23:1233M ./db
10821:23:1212K ./.github
10921:23:12129M ./locale
11021:23:1220M ./config
11121:23:1382M ./app
11221:23:1320K ./.lefthook
11321:23:133.5G .
11421:23:13$ source scripts/prepare_build.sh
115 21:23:13 Installing gems 00:20
14621:23:33Using two connections, single database config (config/database.yml.postgresql)
14721:23:33Geo DB won't be set up.
14821:23:33Embedding DB won't be set up.
149 21:23:33 Setting up DBs 00:58
16221:24:31$ source ./scripts/rspec_helpers.sh
16321:24:31$ run_timed_command "gem install knapsack --no-document"
16421:24:31$ gem install knapsack --no-document
16521:24:32Successfully installed knapsack-4.0.0
16621:24:321 gem installed
16721:24:32$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"
16821:24:31==> 'gem install knapsack --no-document' succeeded in 1 seconds.
169 21:24:32 Spawning Gitaly 00:05
17321:24:37$ export RSPEC_SKIPPED_TESTS_REPORT_PATH="rspec/skipped_tests-${CI_JOB_ID}.txt"
17421:24:37$ export RSPEC_RETRIED_TESTS_REPORT_PATH="rspec/retried_tests-${CI_JOB_ID}.txt"
17521:24:37$ tooling/bin/create_job_metrics_file || true
17621:24:40[job-metrics] Creating the job metrics file for the CI/CD job.
17721:24:40$ rspec_section rspec_parallelized_job "--fail-fast=${RSPEC_FAIL_FAST_THRESHOLD} --tag ~quarantine --tag ~zoekt --tag ~click_house"
178 21:24:40 RSpec 04:31
17921:24:40[21:24:40] Starting rspec_parallelized_job
18021:24:32RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
18121:24:40KNAPSACK_GENERATE_REPORT: true
18221:24:40FLAKY_RSPEC_GENERATE_REPORT: true
18321:24:40KNAPSACK_TEST_FILE_PATTERN: spec/{migrations}{,/**/}*_spec.rb
18421:24:40KNAPSACK_LOG_LEVEL: debug
18521:24:40KNAPSACK_REPORT_PATH: knapsack/rspec_migration_pg14_single-db-ci-connection_11_26_278964_report.json
18621:24:40FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
18721:24:40FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec_migration_pg14_single-db-ci-connection_11_26_278964_report.json
18821:24:40NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec_migration_pg14_single-db-ci-connection_11_26_278964_report.json
18921:24:40RSPEC_SKIPPED_TESTS_REPORT_PATH: rspec/skipped_tests-8368446062.txt
19021:24:40CRYSTALBALL:
19121:24:40RSPEC_TESTS_MAPPING_ENABLED:
19221:24:40RSPEC_TESTS_FILTER_FILE:
19321:24:40Shell set options (set -o) enabled:
19421:24:40braceexpand on
19521:24:40hashall on
19621:24:40interactive-comments on
19721:24:40pipefail on
19821:24:48Knapsack report generator started!
19921:24:40/builds/gitlab-org/gitlab/vendor/ruby/3.2.0/gems/io-event-1.6.5/lib/io/event/support.rb:27: warning: IO::Buffer is experimental and both the Ruby and C interface may change in the future!
20021:25:27DEPRECATION WARNING: Support for Rails versions < 7.1 is deprecated and will be removed from ViewComponent 4.0.0 (ViewComponent v4 will remove support for Rails versions < 7.1 no earlier than April 1, 2025) (called from <top (required)> at /builds/gitlab-org/gitlab/config/environment.rb:7)
20121:25:38warning: parser/current is loading parser/ruby32, which recognizes 3.2.6-compliant syntax, but you are running 3.2.5.
20221:25:38Please see https://github.com/whitequark/parser#compatibility-with-ruby-mri.
20321:25:42Run options: exclude {:quarantine=>true, :zoekt=>true, :click_house=>true}
20421:25:42# [RSpecRunTime] Starting RSpec timer...
20521:25:42[TEST PROF INFO] EventProf enabled (sql.active_record)
20621:25:42unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
20721:25:48Test environment set up in 1.017444406 seconds
20821:25:48# [RSpecRunTime] Starting example group spec/migrations/20240930125312_queue_backfill_ci_secure_file_states_project_id_spec.rb. Expected to take 33.03 seconds.
20921:25:48QueueBackfillCiSecureFileStatesProjectId
21021:25:58ci: == [advisory_lock_connection] object_id: 2227480, pg_backend_pid: 123
21121:25:58ci: == 20240930125311 QueueBackfillCiSecureFileStatesProjectId: migrating =========
21221:25:58ci: == 20240930125311 QueueBackfillCiSecureFileStatesProjectId: migrated (0.1796s)
21321:25:58ci: == [advisory_lock_connection] object_id: 2227480, pg_backend_pid: 123
21421:26:03 schedules a new batched migration
21521:26:26# [RSpecRunTime] Finishing example group spec/migrations/20240930125312_queue_backfill_ci_secure_file_states_project_id_spec.rb. It took 38.09 seconds. Expected to take 33.03 seconds.
21621:26:26# [RSpecRunTime] Starting example group spec/migrations/20240930123056_queue_backfill_pages_deployment_states_project_id_spec.rb. Expected to take 15.79 seconds.
21721:26:26QueueBackfillPagesDeploymentStatesProjectId
21821:26:36main: == [advisory_lock_connection] object_id: 7178620, pg_backend_pid: 136
21921:26:36main: == 20240930123056 QueueBackfillPagesDeploymentStatesProjectId: migrating ======
22021:26:37main: == 20240930123056 QueueBackfillPagesDeploymentStatesProjectId: migrated (0.0714s)
22121:26:37main: == [advisory_lock_connection] object_id: 7178620, pg_backend_pid: 136
22221:26:41 schedules a new batched migration
22321:27:04# [RSpecRunTime] Finishing example group spec/migrations/20240930123056_queue_backfill_pages_deployment_states_project_id_spec.rb. It took 37.34 seconds. Expected to take 15.79 seconds.
22421:27:04# [RSpecRunTime] RSpec elapsed time: 1 minute 21.47 seconds. Current RSS: ~1190M. Threads: 1. load average: 1.14 1.47 1.64 1/270 388
22521:27:04.
22621:27:04# [RSpecRunTime] Starting example group spec/migrations/20241014114624_queue_backfill_security_findings_project_id_spec.rb. Expected to take 10.59 seconds.
22721:27:04QueueBackfillSecurityFindingsProjectId
22821:27:10main: == [advisory_lock_connection] object_id: 11410500, pg_backend_pid: 147
22921:27:10main: == 20241014114624 QueueBackfillSecurityFindingsProjectId: migrating ===========
23021:27:10main: == 20241014114624 QueueBackfillSecurityFindingsProjectId: migrated (0.0114s) ==
23121:27:10main: == [advisory_lock_connection] object_id: 11410500, pg_backend_pid: 147
23221:27:15 does not schedules a new batched migration
23321:27:31# [RSpecRunTime] Finishing example group spec/migrations/20241014114624_queue_backfill_security_findings_project_id_spec.rb. It took 26.79 seconds. Expected to take 10.59 seconds.
23421:27:31# [RSpecRunTime] RSpec elapsed time: 1 minute 48.37 seconds. Current RSS: ~1189M. Threads: 1. load average: 1.15 1.45 1.62 1/267 389
23521:27:31.
23621:27:31# [RSpecRunTime] Starting example group spec/migrations/20231016173129_queue_delete_invalid_protected_branch_merge_access_levels_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20231016173129_queue_delete_invalid_protected_branch_merge_access_levels_spec.rb.
23721:27:31QueueDeleteInvalidProtectedBranchMergeAccessLevels
23821:27:31 schedules a new batched migration (PENDING: Skipping because migration QueueDeleteInvalidProtectedBranchMergeAccessLevels is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
23921:27:31# [RSpecRunTime] Finishing example group spec/migrations/20231016173129_queue_delete_invalid_protected_branch_merge_access_levels_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20231016173129_queue_delete_invalid_protected_branch_merge_access_levels_spec.rb.
24021:27:31# [RSpecRunTime] Starting example group spec/migrations/20240108072545_fix_invalid_records_ci_job_artifact_states_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240108072545_fix_invalid_records_ci_job_artifact_states_spec.rb.
24121:27:31FixInvalidRecordsCiJobArtifactStates
24221:27:31 when FKs exist
24321:27:31 does not remove records (PENDING: Skipping because migration FixInvalidRecordsCiJobArtifactStates is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
24421:27:31 with missing FKs
24521:27:31 removes orphan records (PENDING: Skipping because migration FixInvalidRecordsCiJobArtifactStates is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
24621:27:31 with invalid FKs
24721:27:31 removes orphan records (PENDING: Skipping because migration FixInvalidRecordsCiJobArtifactStates is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
24821:27:31# [RSpecRunTime] Finishing example group spec/migrations/20240108072545_fix_invalid_records_ci_job_artifact_states_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240108072545_fix_invalid_records_ci_job_artifact_states_spec.rb.
24921:27:31# [RSpecRunTime] Starting example group spec/migrations/20240305182005_queue_backfill_catalog_resource_version_sem_ver_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240305182005_queue_backfill_catalog_resource_version_sem_ver_spec.rb.
25021:27:31QueueBackfillCatalogResourceVersionSemVer
25121:27:31 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillCatalogResourceVersionSemVer is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
25221:27:31# [RSpecRunTime] Finishing example group spec/migrations/20240305182005_queue_backfill_catalog_resource_version_sem_ver_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240305182005_queue_backfill_catalog_resource_version_sem_ver_spec.rb.
25321:27:31# [RSpecRunTime] Starting example group spec/migrations/20240508085441_re_add_redirect_routes_path_index_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240508085441_re_add_redirect_routes_path_index_spec.rb.
25421:27:31ReAddRedirectRoutesPathIndex
25521:27:31 when the index already exist
25621:27:31 does not do anything (PENDING: Skipping because migration ReAddRedirectRoutesPathIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
25721:27:31 when the index does not exist
25821:27:31 creates the index (PENDING: Skipping because migration ReAddRedirectRoutesPathIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
25921:27:31# [RSpecRunTime] Finishing example group spec/migrations/20240508085441_re_add_redirect_routes_path_index_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240508085441_re_add_redirect_routes_path_index_spec.rb.
26021:27:31# [RSpecRunTime] Starting example group spec/migrations/20240530121656_queue_backfill_design_management_versions_namespace_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240530121656_queue_backfill_design_management_versions_namespace_id_spec.rb.
26121:27:31QueueBackfillDesignManagementVersionsNamespaceId
26221:27:31 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillDesignManagementVersionsNamespaceId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
26321:27:31# [RSpecRunTime] Finishing example group spec/migrations/20240530121656_queue_backfill_design_management_versions_namespace_id_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240530121656_queue_backfill_design_management_versions_namespace_id_spec.rb.
26421:27:31# [RSpecRunTime] Starting example group spec/migrations/20240611121101_remove_project_statistics_storage_size_and_project_id_index_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240611121101_remove_project_statistics_storage_size_and_project_id_index_spec.rb.
26521:27:31RemoveProjectStatisticsStorageSizeAndProjectIdIndex
26621:27:31 #up
26721:27:31 does nothing when not on gitlab.com (PENDING: Skipping because migration RemoveProjectStatisticsStorageSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
26821:27:31 prepares async index removal when on gitlab.com (PENDING: Skipping because migration RemoveProjectStatisticsStorageSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
26921:27:31 #down
27021:27:31 does nothing when not on gitlab.com (PENDING: Skipping because migration RemoveProjectStatisticsStorageSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
27121:27:31 unprepares async index removal when on gitlab.com (PENDING: Skipping because migration RemoveProjectStatisticsStorageSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
27221:27:31# [RSpecRunTime] Finishing example group spec/migrations/20240611121101_remove_project_statistics_storage_size_and_project_id_index_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240611121101_remove_project_statistics_storage_size_and_project_id_index_spec.rb.
27321:27:31# [RSpecRunTime] Starting example group spec/migrations/20240621120705_queue_backfill_packages_maven_metadata_project_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240621120705_queue_backfill_packages_maven_metadata_project_id_spec.rb.
27421:27:31QueueBackfillPackagesMavenMetadataProjectId
27521:27:31 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillPackagesMavenMetadataProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
27621:27:31# [RSpecRunTime] Finishing example group spec/migrations/20240621120705_queue_backfill_packages_maven_metadata_project_id_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240621120705_queue_backfill_packages_maven_metadata_project_id_spec.rb.
27721:27:31# [RSpecRunTime] Starting example group spec/migrations/20240715183917_sync_namespace_settings_seat_control_with_user_cap_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240715183917_sync_namespace_settings_seat_control_with_user_cap_spec.rb.
27821:27:31SyncNamespaceSettingsSeatControlWithUserCap
27921:27:31 sets the value of seat_control to 1 where new_user_signups_cap has a value (PENDING: Skipping because migration SyncNamespaceSettingsSeatControlWithUserCap is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
28021:27:31 does not change the value of seat_control where new_user_signups_cap is null (PENDING: Skipping because migration SyncNamespaceSettingsSeatControlWithUserCap is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
28121:27:31 sets the value of seat_control for multiple rows (PENDING: Skipping because migration SyncNamespaceSettingsSeatControlWithUserCap is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
28221:27:31# [RSpecRunTime] Finishing example group spec/migrations/20240715183917_sync_namespace_settings_seat_control_with_user_cap_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240715183917_sync_namespace_settings_seat_control_with_user_cap_spec.rb.
28321:27:31# [RSpecRunTime] Starting example group spec/migrations/20240806222106_add_dev_widget_to_tasks_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240806222106_add_dev_widget_to_tasks_spec.rb.
28421:27:31AddDevWidgetToTasks
28521:27:31 behaves like migration that adds a widget to a work item type
28621:27:31 #up
28721:27:31 adds widget to work item type (PENDING: Skipping because migration AddDevWidgetToTasks is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
28821:27:31 when type does not exist
28921:27:31 skips creating the new widget definition (PENDING: Skipping because migration AddDevWidgetToTasks is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29021:27:31 #down
29121:27:31 removes widget from work item type (PENDING: Skipping because migration AddDevWidgetToTasks is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29221:27:31# [RSpecRunTime] Finishing example group spec/migrations/20240806222106_add_dev_widget_to_tasks_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240806222106_add_dev_widget_to_tasks_spec.rb.
29321:27:31# [RSpecRunTime] Starting example group spec/migrations/20240902054331_sync_fk_referencing_p_ci_pipelines_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240902054331_sync_fk_referencing_p_ci_pipelines_spec.rb.
29421:27:31SyncFkReferencingPCiPipelines
29521:27:31 validates and renames the fks (PENDING: Skipping because migration SyncFkReferencingPCiPipelines is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29621:27:31# [RSpecRunTime] Finishing example group spec/migrations/20240902054331_sync_fk_referencing_p_ci_pipelines_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240902054331_sync_fk_referencing_p_ci_pipelines_spec.rb.
29721:27:31# [RSpecRunTime] Starting example group spec/migrations/db/post_migrate/20240826081110_backfill_null_project_ci_job_annotation_records_spec.rb. Missing expected duration from Knapsack report for spec/migrations/db/post_migrate/20240826081110_backfill_null_project_ci_job_annotation_records_spec.rb.
29821:27:31BackfillNullProjectCiJobAnnotationRecords
29921:27:31 #up
30021:27:31 backfills when annotations without project (PENDING: Skipping because migration BackfillNullProjectCiJobAnnotationRecords is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
30121:27:31# [RSpecRunTime] Finishing example group spec/migrations/db/post_migrate/20240826081110_backfill_null_project_ci_job_annotation_records_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/db/post_migrate/20240826081110_backfill_null_project_ci_job_annotation_records_spec.rb.
30221:27:33auto_explain log contains 840 entries for main, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-migration-pg14-single-db-ci-connection-11-26.343.main.ndjson.gz
30321:27:33took 2.671560521
30421:27:36auto_explain log contains 841 entries for ci, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-migration-pg14-single-db-ci-connection-11-26.343.ci.ndjson.gz
30521:27:36took 2.12002334
30621:27:36[TEST PROF INFO] EventProf results for sql.active_record
30721:27:36Total time: 00:58.397 of 01:42.557 (56.94%)
30821:27:36Total events: 46574
30921:27:36Top 5 slowest suites (by time):
31021:27:36QueueBackfill...tatesProjectId (./spec/migrations/20240930123056_queue_backfill_pages_deployment_states_project_id_spec.rb:6) – 00:22.110 (17206 / 1) of 00:37.442 (59.05%)
31121:27:36QueueBackfill...tatesProjectId (./spec/migrations/20240930125312_queue_backfill_ci_secure_file_states_project_id_spec.rb:6) – 00:21.240 (17088 / 1) of 00:38.088 (55.77%)
31221:27:36QueueBackfill...dingsProjectId (./spec/migrations/20241014114624_queue_backfill_security_findings_project_id_spec.rb:6) – 00:15.008 (12203 / 1) of 00:26.847 (55.9%)
31321:27:36SyncFkReferencingPCiPipelines (./spec/migrations/20240902054331_sync_fk_referencing_p_ci_pipelines_spec.rb:6) – 00:00.003 (7 / 1) of 00:00.016 (23.66%)
31421:27:36AddDevWidgetToTasks (./spec/migrations/20240806222106_add_dev_widget_to_tasks_spec.rb:6) – 00:00.003 (7 / 3) of 00:00.017 (21.94%)
31521:27:36Knapsack report was generated. Preview:
31621:27:36{
31721:27:36 "spec/migrations/20240930125312_queue_backfill_ci_secure_file_states_project_id_spec.rb": 15.823844606999955,
31821:27:36 "spec/migrations/20240930123056_queue_backfill_pages_deployment_states_project_id_spec.rb": 15.143395769000108,
31921:27:36 "spec/migrations/20241014114624_queue_backfill_security_findings_project_id_spec.rb": 11.008895275999748
32021:27:36}
32121:27:36Knapsack global time execution for tests: 41s
32221:27:36Pending: (Failures listed here are expected and do not affect your suite's status)
32321:27:36 1) QueueDeleteInvalidProtectedBranchMergeAccessLevels schedules a new batched migration
32421:27:36 # Skipping because migration QueueDeleteInvalidProtectedBranchMergeAccessLevels is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
32521:27:36 # ./spec/migrations/20231016173129_queue_delete_invalid_protected_branch_merge_access_levels_spec.rb:9
32621:27:36 2) FixInvalidRecordsCiJobArtifactStates when FKs exist does not remove records
32721:27:36 # Skipping because migration FixInvalidRecordsCiJobArtifactStates is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
32821:27:36 # ./spec/migrations/20240108072545_fix_invalid_records_ci_job_artifact_states_spec.rb:32
32921:27:36 3) FixInvalidRecordsCiJobArtifactStates with missing FKs removes orphan records
33021:27:36 # Skipping because migration FixInvalidRecordsCiJobArtifactStates is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
33121:27:36 # ./spec/migrations/20240108072545_fix_invalid_records_ci_job_artifact_states_spec.rb:56
33221:27:36 4) FixInvalidRecordsCiJobArtifactStates with missing FKs with invalid FKs removes orphan records
33321:27:36 # Skipping because migration FixInvalidRecordsCiJobArtifactStates is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
33421:27:36 # ./spec/migrations/20240108072545_fix_invalid_records_ci_job_artifact_states_spec.rb:79
33521:27:36 5) QueueBackfillCatalogResourceVersionSemVer schedules a new batched migration
33621:27:36 # Skipping because migration QueueBackfillCatalogResourceVersionSemVer is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
33721:27:36 # ./spec/migrations/20240305182005_queue_backfill_catalog_resource_version_sem_ver_spec.rb:9
33821:27:36 6) ReAddRedirectRoutesPathIndex when the index already exist does not do anything
33921:27:36 # Skipping because migration ReAddRedirectRoutesPathIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34021:27:36 # ./spec/migrations/20240508085441_re_add_redirect_routes_path_index_spec.rb:11
34121:27:36 7) ReAddRedirectRoutesPathIndex when the index does not exist creates the index
34221:27:36 # Skipping because migration ReAddRedirectRoutesPathIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34321:27:36 # ./spec/migrations/20240508085441_re_add_redirect_routes_path_index_spec.rb:19
34421:27:36 8) QueueBackfillDesignManagementVersionsNamespaceId schedules a new batched migration
34521:27:36 # Skipping because migration QueueBackfillDesignManagementVersionsNamespaceId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34621:27:36 # ./spec/migrations/20240530121656_queue_backfill_design_management_versions_namespace_id_spec.rb:10
34721:27:36 9) RemoveProjectStatisticsStorageSizeAndProjectIdIndex#up does nothing when not on gitlab.com
34821:27:36 # Skipping because migration RemoveProjectStatisticsStorageSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34921:27:36 # ./spec/migrations/20240611121101_remove_project_statistics_storage_size_and_project_id_index_spec.rb:16
35021:27:36 10) RemoveProjectStatisticsStorageSizeAndProjectIdIndex#up prepares async index removal when on gitlab.com
35121:27:36 # Skipping because migration RemoveProjectStatisticsStorageSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35221:27:36 # ./spec/migrations/20240611121101_remove_project_statistics_storage_size_and_project_id_index_spec.rb:20
35321:27:36 11) RemoveProjectStatisticsStorageSizeAndProjectIdIndex#down does nothing when not on gitlab.com
35421:27:36 # Skipping because migration RemoveProjectStatisticsStorageSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35521:27:36 # ./spec/migrations/20240611121101_remove_project_statistics_storage_size_and_project_id_index_spec.rb:36
35621:27:36 12) RemoveProjectStatisticsStorageSizeAndProjectIdIndex#down unprepares async index removal when on gitlab.com
35721:27:36 # Skipping because migration RemoveProjectStatisticsStorageSizeAndProjectIdIndex is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35821:27:36 # ./spec/migrations/20240611121101_remove_project_statistics_storage_size_and_project_id_index_spec.rb:40
35921:27:36 13) QueueBackfillPackagesMavenMetadataProjectId schedules a new batched migration
36021:27:36 # Skipping because migration QueueBackfillPackagesMavenMetadataProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
36121:27:36 # ./spec/migrations/20240621120705_queue_backfill_packages_maven_metadata_project_id_spec.rb:10
36221:27:36 14) SyncNamespaceSettingsSeatControlWithUserCap sets the value of seat_control to 1 where new_user_signups_cap has a value
36321:27:36 # Skipping because migration SyncNamespaceSettingsSeatControlWithUserCap is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
36421:27:36 # ./spec/migrations/20240715183917_sync_namespace_settings_seat_control_with_user_cap_spec.rb:10
36521:27:36 15) SyncNamespaceSettingsSeatControlWithUserCap does not change the value of seat_control where new_user_signups_cap is null
36621:27:36 # Skipping because migration SyncNamespaceSettingsSeatControlWithUserCap is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
36721:27:36 # ./spec/migrations/20240715183917_sync_namespace_settings_seat_control_with_user_cap_spec.rb:19
36821:27:36 16) SyncNamespaceSettingsSeatControlWithUserCap sets the value of seat_control for multiple rows
36921:27:36 # Skipping because migration SyncNamespaceSettingsSeatControlWithUserCap is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37021:27:36 # ./spec/migrations/20240715183917_sync_namespace_settings_seat_control_with_user_cap_spec.rb:28
37121:27:36 17) AddDevWidgetToTasks behaves like migration that adds a widget to a work item type #up adds widget to work item type
37221:27:36 # Skipping because migration AddDevWidgetToTasks is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37321:27:36 # ./spec/support/shared_examples/migrations/add_work_item_widget_shared_examples.rb:78
37421:27:36 18) AddDevWidgetToTasks behaves like migration that adds a widget to a work item type #up when type does not exist skips creating the new widget definition
37521:27:36 # Skipping because migration AddDevWidgetToTasks is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37621:27:36 # ./spec/support/shared_examples/migrations/add_work_item_widget_shared_examples.rb:94
37721:27:36 19) AddDevWidgetToTasks behaves like migration that adds a widget to a work item type #down removes widget from work item type
37821:27:36 # Skipping because migration AddDevWidgetToTasks is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37921:27:36 # ./spec/support/shared_examples/migrations/add_work_item_widget_shared_examples.rb:105
38021:27:36 20) SyncFkReferencingPCiPipelines validates and renames the fks
38121:27:36 # Skipping because migration SyncFkReferencingPCiPipelines is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
38221:27:36 # ./spec/migrations/20240902054331_sync_fk_referencing_p_ci_pipelines_spec.rb:15
38321:27:36 21) BackfillNullProjectCiJobAnnotationRecords#up backfills when annotations without project
38421:27:36 # Skipping because migration BackfillNullProjectCiJobAnnotationRecords is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
38521:27:36 # ./spec/migrations/db/post_migrate/20240826081110_backfill_null_project_ci_job_annotation_records_spec.rb:34
38621:27:36Finished in 1 minute 53.48 seconds (files took 58.67 seconds to load)
38721:27:3624 examples, 0 failures, 21 pending
38821:27:36Randomized with seed 1704
38921:27:42[TEST PROF INFO] Time spent in factories: 00:00.215 (0.19% of total time)
39021:27:42RSpec exited with 0.
39121:27:42No examples to retry, congrats!
392 21:27:42 Running after_script 00:11
39321:27:43Running after script...
39421:27:43$ source scripts/utils.sh
39521:27:43$ log_disk_usage
39621:27:43*******************************************************
39721:27:43This runner currently has 30G free disk space.
39821:27:43*******************************************************
399 21:27:43 Disk usage detail 00:03
45821:27:46$ bundle exec gem list gitlab_quality-test_tooling
45921:27:48gitlab_quality-test_tooling (2.1.0)
46021:27:48$ section_start "failed-test-issues" "Report test failures" # collapsed multi-line command
461 21:27:48 Report test failures 00:00
46321:27:48$ section_start "flaky-test-issues" "Report test flakiness" # collapsed multi-line command
464 21:27:48 Report test flakiness 00:00
46621:27:48$ section_start "slow-test-issues" "Report test slowness" # collapsed multi-line command
467 21:27:48 Report test slowness 00:00
46921:27:48$ section_start "slow-test-merge-request-report-note" "Report test slowness in MR note" # collapsed multi-line command
470 21:27:48 Report test slowness in MR note 00:02
47321:27:50$ section_start "knapsack-report-issues" "Report test files close to timing out" # collapsed multi-line command
474 21:27:50 Report test files close to timing out 00:02
47721:27:52$ tooling/bin/push_job_metrics || true
47821:27:53[job-metrics] Pushing job metrics file for the CI/CD job.
47921:27:53[job-metrics] Pushed 4 CI job metric entries to InfluxDB.
480 21:27:53 Saving cache for successful job 00:01
48121:27:54Not uploading cache ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20 due to policy
482 21:27:54 Uploading artifacts for successful job 00:05
48321:27:55Uploading artifacts...
48421:27:55auto_explain/: found 3 matching artifact files and directories
48521:27:55coverage/: found 5 matching artifact files and directories
48621:27:55crystalball/: found 2 matching artifact files and directories
48721:27:55WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
48821:27:55knapsack/: found 4 matching artifact files and directories
48921:27:55rspec/: found 16 matching artifact files and directories
49021:27:55WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
49121:27:55log/*.log: found 13 matching artifact files and directories
49221:27:55WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8368446062/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
49321:27:55WARNING: Retrying... context=artifacts-uploader error=request redirected
49421:27:57Uploading artifacts as "archive" to coordinator... 201 Created id=8368446062 responseStatus=201 Created token=glcbt-66
49521:27:58Uploading artifacts...
49621:27:58rspec/rspec-*.xml: found 1 matching artifact files and directories
49721:27:58WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8368446062/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
49821:27:58WARNING: Retrying... context=artifacts-uploader error=request redirected
49921:27:59Uploading artifacts as "junit" to coordinator... 201 Created id=8368446062 responseStatus=201 Created token=glcbt-66
500 21:27:59 Cleaning up project directory and file based variables 00:01
50121:28:08Job succeeded