Skip to content
Snippets Groups Projects

rspec migration pg14 single-db 21/26

Passed Started by
Simon Tomlinson
@stomlinson
Log timestamps in UTC.
122:06:50Running with gitlab-runner 17.4.0~pre.110.g27400594 (27400594)
222:06:50 on blue-4.private.runners-manager.gitlab.com/gitlab.com/gitlab-org tDjA3Sp3, system ID: s_96a8ae3d1050
322:06:50 feature flags: FF_NETWORK_PER_BUILD:true, FF_TIMESTAMPS:true
422:06:50Resolving secrets
5 22:06:50 Preparing the "docker+machine" executor 00:10
622:06:50Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
722:06:52Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1...
822:06:53Authenticating with credentials from job payload (GitLab Registry)
922:06:53Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
1022:06:53Using docker image sha256:82f132c22567f8ce17cc132c14b2f9aa3eaf9bb5424d91c2d966912433f0257d for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:c55e1364ee4327b244a9cfa1750f19feea14fc774eaf792b725967d146eb45f5 ...
1122:06:53WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1222:06:53WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1322:06:53Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12...
1422:06:53Authenticating with credentials from job payload (GitLab Registry)
1522:06:53Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
1622:06:54Using docker image sha256:5c5ba5b83d6c60cb0b225bd670b7a43be8c238cc72347d24af57e5027c3648f3 for registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:46aceab84c42d0e819c8e7940f2f98ce9e184785cd7b22d95872024a35f52407 ...
1722:06:54Starting service redis:6.2-alpine...
1822:06:54Pulling docker image redis:6.2-alpine ...
1922:06:55Using docker image sha256:4100b5bd17430263e85ad9d8ab851959b234acaaf378e093f1f98400f4998815 for redis:6.2-alpine with digest redis@sha256:eaba718fecd1196d88533de7ba49bf903ad33664a92debb24660a922ecd9cac8 ...
2022:06:55Waiting for services to be up and running (timeout 30 seconds)...
2122:07:00Authenticating with credentials from job payload (GitLab Registry)
2222:07:00Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
2322:07:00Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
24 22:07:00 Preparing environment 00:01
2522:07:01Running on runner-tdja3sp3-project-278964-concurrent-0 via runner-tdja3sp3-private-1731517319-1d5cdd20...
26 22:07:01 Getting source from Git repository 00:01
2722:07:02Skipping Git repository setup
2822:07:02Skipping Git checkout
2922:07:02Skipping Git submodules setup
30 22:07:02 Restoring cache 00:18
3122:07:02Checking cache for ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20...
3222:07:02Downloading cache from https://storage.googleapis.com/gitlab-com-runners-cache/project/278964/ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20 ETag="ba67364f761343c8f313528473af941a"
3322:07:15Successfully extracted cache
34 22:07:20 Downloading artifacts 00:46
3522:07:20Downloading artifacts for clone-gitlab-repo (8353286583)...
3622:07:26Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286583 responseStatus=200 OK token=glcbt-66
3722:07:26WARNING: Part of .git directory is on the list of files to extract
3822:07:26WARNING: This may introduce unexpected problems
3922:07:38Downloading artifacts for compile-test-assets (8353286630)...
4022:07:42Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286630 responseStatus=200 OK token=glcbt-66
4122:07:48Downloading artifacts for detect-tests (8353286649)...
4222:07:48Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286649 responseStatus=200 OK token=glcbt-66
4322:07:48Downloading artifacts for retrieve-tests-metadata (8353286664)...
4422:07:49Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286664 responseStatus=200 OK token=glcbt-66
4522:07:49Downloading artifacts for setup-test-env (8353286635)...
4622:07:53Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286635 responseStatus=200 OK token=glcbt-66
47 22:08:06 Executing "step_script" stage of the job script
4822:08:06Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
4922:08:06$ echo $FOSS_ONLY
5022:08:06$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
5122:08:06$ export GOPATH=$CI_PROJECT_DIR/.go
5222:08:06$ mkdir -p $GOPATH
5322:08:06$ source scripts/utils.sh
5422:08:06$ log_disk_usage "true"
5522:08:06*******************************************************
5622:08:06This runner currently has 73G free disk space.
5722:08:06*******************************************************
58 22:08:06 Disk usage detail 00:04
5922:08:06df -h
6022:08:06Filesystem Size Used Avail Use% Mounted on
6122:08:06overlay 95G 22G 73G 23% /
6222:08:06tmpfs 64M 0 64M 0% /dev
6322:08:06shm 64M 0 64M 0% /dev/shm
6422:08:06/dev/sda1 95G 22G 73G 23% /cache
6522:08:06tmpfs 3.9G 0 3.9G 0% /sys/devices/virtual/dmi/id
6622:08:06du -h -d 1
6722:08:067.4M ./workhorse
6822:08:06148K ./bin
6922:08:061.2M ./.gitlab
7022:08:06167M ./.git
7122:08:064.0K ./builds
7222:08:0628M ./lib
7322:08:068.0K ./.vscode
7422:08:06560K ./storybook
7522:08:0624K ./log
7622:08:061.8M ./data
7722:08:0611M ./qa
7822:08:063.2M ./.rubocop_todo
7922:08:06856M ./vendor
8022:08:061023M ./public
8122:08:0662M ./doc
8222:08:06484K ./danger
8322:08:0632K ./rspec
8422:08:06556K ./tooling
8522:08:06145M ./ee
8622:08:061.3M ./knapsack
8722:08:06300K ./patches
8822:08:064.3M ./changelogs
8922:08:0620K ./haml_lint
9022:08:0628K ./metrics_server
9122:08:06108K ./keeps
9222:08:0636K ./shared
9322:08:0644K ./generator_templates
9422:08:061.3M ./scripts
9522:08:06763M ./tmp
9622:08:07127M ./spec
9722:08:0720K ./file_hooks
9822:08:0732K ./crystalball
9922:08:0716K ./sidekiq_cluster
10022:08:0717M ./gems
10122:08:071.2M ./fixtures
10222:08:07964K ./rubocop
10322:08:074.0K ./.go
10422:08:0733M ./db
10522:08:0712K ./.github
10622:08:07129M ./locale
10722:08:0720M ./config
10822:08:0782M ./app
10922:08:0720K ./.lefthook
11022:08:073.5G .
11122:08:07$ source scripts/prepare_build.sh
112 22:08:07 Installing gems 00:19
14322:08:26Using two connections, single database config (config/database.yml.postgresql)
14422:08:26Disabling ci connection in config/database.yml
14522:08:26Geo DB won't be set up.
14622:08:26Embedding DB won't be set up.
147 22:08:26 Setting up DBs 00:55
17222:09:21$ source ./scripts/rspec_helpers.sh
17322:09:21$ run_timed_command "gem install knapsack --no-document"
17422:09:20$ gem install knapsack --no-document
17522:09:21Successfully installed knapsack-4.0.0
17622:09:211 gem installed
17722:09:21==> 'gem install knapsack --no-document' succeeded in 0 seconds.
17822:09:21$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"
179 22:09:21 Spawning Gitaly 00:05
18322:09:26$ export RSPEC_SKIPPED_TESTS_REPORT_PATH="rspec/skipped_tests-${CI_JOB_ID}.txt"
18422:09:26$ export RSPEC_RETRIED_TESTS_REPORT_PATH="rspec/retried_tests-${CI_JOB_ID}.txt"
18522:09:26$ tooling/bin/create_job_metrics_file || true
18622:09:29[job-metrics] Creating the job metrics file for the CI/CD job.
18722:09:29$ rspec_section rspec_parallelized_job "--fail-fast=${RSPEC_FAIL_FAST_THRESHOLD} --tag ~quarantine --tag ~zoekt --tag ~click_house"
188 22:09:29 RSpec 04:50
18922:09:29[22:09:29] Starting rspec_parallelized_job
19022:09:21RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
19122:09:29KNAPSACK_GENERATE_REPORT: true
19222:09:29FLAKY_RSPEC_GENERATE_REPORT: true
19322:09:29KNAPSACK_TEST_FILE_PATTERN: spec/{migrations}{,/**/}*_spec.rb
19422:09:29KNAPSACK_LOG_LEVEL: debug
19522:09:29KNAPSACK_REPORT_PATH: knapsack/rspec_migration_pg14_single-db_21_26_278964_report.json
19622:09:29FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
19722:09:29FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec_migration_pg14_single-db_21_26_278964_report.json
19822:09:29NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec_migration_pg14_single-db_21_26_278964_report.json
19922:09:29RSPEC_SKIPPED_TESTS_REPORT_PATH: rspec/skipped_tests-8353287178.txt
20022:09:29CRYSTALBALL:
20122:09:29RSPEC_TESTS_MAPPING_ENABLED:
20222:09:29RSPEC_TESTS_FILTER_FILE:
20322:09:29Shell set options (set -o) enabled:
20422:09:29braceexpand on
20522:09:29hashall on
20622:09:29interactive-comments on
20722:09:29pipefail on
20822:09:35Knapsack report generator started!
20922:09:29/builds/gitlab-org/gitlab/vendor/ruby/3.2.0/gems/io-event-1.6.5/lib/io/event/support.rb:27: warning: IO::Buffer is experimental and both the Ruby and C interface may change in the future!
21022:09:44 ██  ██  █████  ██████  ███  ██ ██ ███  ██  ██████ 
21122:09:44 ██  ██ ██   ██ ██   ██ ████  ██ ██ ████  ██ ██      
21222:09:44 ██  █  ██ ███████ ██████  ██ ██  ██ ██ ██ ██  ██ ██  ███ 
21322:09:44 ██ ███ ██ ██   ██ ██   ██ ██  ██ ██ ██ ██  ██ ██ ██  ██ 
21422:09:44  ███ ███  ██  ██ ██  ██ ██   ████ ██ ██   ████  ██████  
21522:09:44******************************************************************************
21622:09:44 Your database has a single connection, and single connections were
21722:09:44 deprecated in GitLab 15.9 https://docs.gitlab.com/ee/update/deprecations.html#single-database-connection-is-deprecated.
21822:09:44 In GitLab 17.0 and later, you must have the two main: and ci: sections in your database.yml.
21922:09:44 Please add a :ci section to your database, following these instructions:
22022:09:44 https://docs.gitlab.com/ee/install/installation.html#configure-gitlab-db-settings.
22122:09:44******************************************************************************
22222:10:13DEPRECATION WARNING: Support for Rails versions < 7.1 is deprecated and will be removed from ViewComponent 4.0.0 (ViewComponent v4 will remove support for Rails versions < 7.1 no earlier than April 1, 2025) (called from <top (required)> at /builds/gitlab-org/gitlab/config/environment.rb:7)
22322:10:25warning: parser/current is loading parser/ruby32, which recognizes 3.2.6-compliant syntax, but you are running 3.2.5.
22422:10:25Please see https://github.com/whitequark/parser#compatibility-with-ruby-mri.
22522:10:29Run options: exclude {:quarantine=>true, :zoekt=>true, :click_house=>true}
22622:10:29# [RSpecRunTime] Starting RSpec timer...
22722:10:29[TEST PROF INFO] EventProf enabled (sql.active_record)
22822:10:29unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
22922:10:36Test environment set up in 2.778760227 seconds
23022:10:36# [RSpecRunTime] Starting example group spec/migrations/20240916132826_queue_backfill_incident_management_oncall_rotations_project_id_spec.rb. Expected to take 25.74 seconds.
23122:10:36QueueBackfillIncidentManagementOncallRotationsProjectId
23222:10:51main: == [advisory_lock_connection] object_id: 2732180, pg_backend_pid: 124
23322:10:51main: == 20240916132826 QueueBackfillIncidentManagementOncallRotationsProjectId: migrating
23422:10:51main: == 20240916132826 QueueBackfillIncidentManagementOncallRotationsProjectId: migrated (0.0899s)
23522:10:51main: == [advisory_lock_connection] object_id: 2732180, pg_backend_pid: 124
23622:10:55 schedules a new batched migration
23722:11:20# [RSpecRunTime] Finishing example group spec/migrations/20240916132826_queue_backfill_incident_management_oncall_rotations_project_id_spec.rb. It took 43.58 seconds. Expected to take 25.74 seconds.
23822:11:20# [RSpecRunTime] Starting example group spec/migrations/20240916124325_queue_backfill_alert_management_alert_user_mentions_project_id_spec.rb. Expected to take 20.87 seconds.
23922:11:20QueueBackfillAlertManagementAlertUserMentionsProjectId
24022:11:34main: == [advisory_lock_connection] object_id: 8698640, pg_backend_pid: 132
24122:11:34main: == 20240916124325 QueueBackfillAlertManagementAlertUserMentionsProjectId: migrating
24222:11:34main: == 20240916124325 QueueBackfillAlertManagementAlertUserMentionsProjectId: migrated (0.0802s)
24322:11:34main: == [advisory_lock_connection] object_id: 8698640, pg_backend_pid: 132
24422:11:38 schedules a new batched migration
24522:12:02# [RSpecRunTime] Finishing example group spec/migrations/20240916124325_queue_backfill_alert_management_alert_user_mentions_project_id_spec.rb. It took 42.21 seconds. Expected to take 20.87 seconds.
24622:12:02# [RSpecRunTime] RSpec elapsed time: 1 minute 32.92 seconds. Current RSS: ~1229M. Threads: 1. load average: 0.99 0.81 0.57 1/284 387
24722:12:02.
24822:12:02# [RSpecRunTime] Starting example group spec/migrations/20241003061916_queue_recover_deleted_ml_model_version_packages_spec.rb. Expected to take 15.7 seconds.
24922:12:02QueueRecoverDeletedMlModelVersionPackages
25022:12:12main: == [advisory_lock_connection] object_id: 13819200, pg_backend_pid: 139
25122:12:12main: == 20241003061916 QueueRecoverDeletedMlModelVersionPackages: migrating ========
25222:12:12main: == 20241003061916 QueueRecoverDeletedMlModelVersionPackages: migrated (0.0839s)
25322:12:12main: == [advisory_lock_connection] object_id: 13819200, pg_backend_pid: 139
25422:12:16 schedules a new batched migration
25522:12:33# [RSpecRunTime] Finishing example group spec/migrations/20241003061916_queue_recover_deleted_ml_model_version_packages_spec.rb. It took 31.12 seconds. Expected to take 15.7 seconds.
25622:12:33# [RSpecRunTime] RSpec elapsed time: 2 minutes 4.28 seconds. Current RSS: ~1231M. Threads: 1. load average: 1.00 0.83 0.59 1/283 388
25722:12:33.
25822:12:33# [RSpecRunTime] Starting example group spec/migrations/20241107064635_queue_backfill_ci_runner_machines_partitioned_table_spec.rb. Expected to take 7.21 seconds.
25922:12:33QueueBackfillCiRunnerMachinesPartitionedTable
26022:12:35main: == [advisory_lock_connection] object_id: 16831240, pg_backend_pid: 146
26122:12:35main: == 20241107064635 QueueBackfillCiRunnerMachinesPartitionedTable: migrating ====
26222:12:35main: == 20241107064635 QueueBackfillCiRunnerMachinesPartitionedTable: migrated (0.0961s)
26322:12:35main: == [advisory_lock_connection] object_id: 16831240, pg_backend_pid: 146
26422:12:39 schedules a new batched migration
26522:12:44# [RSpecRunTime] Finishing example group spec/migrations/20241107064635_queue_backfill_ci_runner_machines_partitioned_table_spec.rb. It took 10.86 seconds. Expected to take 7.21 seconds.
26622:12:44# [RSpecRunTime] RSpec elapsed time: 2 minutes 15.19 seconds. Current RSS: ~1216M. Threads: 1. load average: 1.00 0.84 0.59 1/283 389
26722:12:44.
26822:12:44# [RSpecRunTime] Starting example group spec/migrations/20231103223224_backfill_zoekt_node_id_on_indexed_namespaces_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20231103223224_backfill_zoekt_node_id_on_indexed_namespaces_spec.rb.
26922:12:44BackfillZoektNodeIdOnIndexedNamespaces
27022:12:44 #up
27122:12:44 backfills zoekt_node_id with zoekt_shard_id (PENDING: Skipping because migration BackfillZoektNodeIdOnIndexedNamespaces is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
27222:12:44 when there is somehow more than one zoekt node
27322:12:44 uses the latest zoekt node (PENDING: Skipping because migration BackfillZoektNodeIdOnIndexedNamespaces is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
27422:12:44# [RSpecRunTime] Finishing example group spec/migrations/20231103223224_backfill_zoekt_node_id_on_indexed_namespaces_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20231103223224_backfill_zoekt_node_id_on_indexed_namespaces_spec.rb.
27522:12:44# [RSpecRunTime] Starting example group spec/migrations/20240118225727_queue_backfill_catalog_resource_versions_released_at_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240118225727_queue_backfill_catalog_resource_versions_released_at_spec.rb.
27622:12:44QueueBackfillCatalogResourceVersionsReleasedAt
27722:12:44 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillCatalogResourceVersionsReleasedAt is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
27822:12:44# [RSpecRunTime] Finishing example group spec/migrations/20240118225727_queue_backfill_catalog_resource_versions_released_at_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240118225727_queue_backfill_catalog_resource_versions_released_at_spec.rb.
27922:12:44# [RSpecRunTime] Starting example group spec/migrations/20240410004337_queue_backfill_deployment_approvals_project_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240410004337_queue_backfill_deployment_approvals_project_id_spec.rb.
28022:12:44QueueBackfillDeploymentApprovalsProjectId
28122:12:44 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillDeploymentApprovalsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
28222:12:44# [RSpecRunTime] Finishing example group spec/migrations/20240410004337_queue_backfill_deployment_approvals_project_id_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240410004337_queue_backfill_deployment_approvals_project_id_spec.rb.
28322:12:44# [RSpecRunTime] Starting example group spec/migrations/20240516160731_queue_backfill_default_branch_protection_settings_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240516160731_queue_backfill_default_branch_protection_settings_spec.rb.
28422:12:44QueueBackfillDefaultBranchProtectionSettings
28522:12:44 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillDefaultBranchProtectionSettings is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
28622:12:44# [RSpecRunTime] Finishing example group spec/migrations/20240516160731_queue_backfill_default_branch_protection_settings_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240516160731_queue_backfill_default_branch_protection_settings_spec.rb.
28722:12:44# [RSpecRunTime] Starting example group spec/migrations/20240604150537_queue_backfill_vulnerability_user_mentions_project_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240604150537_queue_backfill_vulnerability_user_mentions_project_id_spec.rb.
28822:12:44QueueBackfillVulnerabilityUserMentionsProjectId
28922:12:44 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillVulnerabilityUserMentionsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29022:12:44# [RSpecRunTime] Finishing example group spec/migrations/20240604150537_queue_backfill_vulnerability_user_mentions_project_id_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240604150537_queue_backfill_vulnerability_user_mentions_project_id_spec.rb.
29122:12:44# [RSpecRunTime] Starting example group spec/migrations/20240612075305_queue_backfill_sbom_occurrences_vulnerabilities_project_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240612075305_queue_backfill_sbom_occurrences_vulnerabilities_project_id_spec.rb.
29222:12:44QueueBackfillSbomOccurrencesVulnerabilitiesProjectId
29322:12:44 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillSbomOccurrencesVulnerabilitiesProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29422:12:44# [RSpecRunTime] Finishing example group spec/migrations/20240612075305_queue_backfill_sbom_occurrences_vulnerabilities_project_id_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240612075305_queue_backfill_sbom_occurrences_vulnerabilities_project_id_spec.rb.
29522:12:44# [RSpecRunTime] Starting example group spec/migrations/20240627231742_update_weight_widget_definitions_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240627231742_update_weight_widget_definitions_spec.rb.
29622:12:44UpdateWeightWidgetDefinitions
29722:12:44 updates existing weight definitions and adds a new one for epics (PENDING: Skipping because migration UpdateWeightWidgetDefinitions is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29822:12:44# [RSpecRunTime] Finishing example group spec/migrations/20240627231742_update_weight_widget_definitions_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240627231742_update_weight_widget_definitions_spec.rb.
29922:12:44# [RSpecRunTime] Starting example group spec/migrations/20240722104700_queue_recalculate_dora_deployment_frequency_score_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240722104700_queue_recalculate_dora_deployment_frequency_score_spec.rb.
30022:12:44QueueRecalculateDoraDeploymentFrequencyScore
30122:12:44 schedules a new batched migration (PENDING: Skipping because migration QueueRecalculateDoraDeploymentFrequencyScore is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
30222:12:44# [RSpecRunTime] Finishing example group spec/migrations/20240722104700_queue_recalculate_dora_deployment_frequency_score_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240722104700_queue_recalculate_dora_deployment_frequency_score_spec.rb.
30322:12:44# [RSpecRunTime] Starting example group spec/migrations/20240814151504_clean_time_tracking_widget_definitions_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240814151504_clean_time_tracking_widget_definitions_spec.rb.
30422:12:44CleanTimeTrackingWidgetDefinitions
30522:12:44 #up
30622:12:44 fixes all widget definition names if they had the wrong casing (PENDING: Skipping because migration CleanTimeTrackingWidgetDefinitions is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
30722:12:44 logs a warning if the type is missing (PENDING: Skipping because migration CleanTimeTrackingWidgetDefinitions is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
30822:12:44# [RSpecRunTime] Finishing example group spec/migrations/20240814151504_clean_time_tracking_widget_definitions_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/20240814151504_clean_time_tracking_widget_definitions_spec.rb.
30922:12:44# [RSpecRunTime] Starting example group spec/migrations/db/post_migrate/20231004091113_swap_columns_for_ci_sources_pipelines_pipeline_id_bigint_spec.rb. Missing expected duration from Knapsack report for spec/migrations/db/post_migrate/20231004091113_swap_columns_for_ci_sources_pipelines_pipeline_id_bigint_spec.rb.
31022:12:44SwapColumnsForCiSourcesPipelinesPipelineIdBigint
31122:12:44 behaves like swap conversion columns
31222:12:44 correctly swaps conversion columns (PENDING: Skipping because migration SwapColumnsForCiSourcesPipelinesPipelineIdBigint is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
31322:12:44 when indexes are missing
31422:12:44 behaves like swap conversion columns
31522:12:44 correctly swaps conversion columns (PENDING: Skipping because migration SwapColumnsForCiSourcesPipelinesPipelineIdBigint is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
31622:12:44# [RSpecRunTime] Finishing example group spec/migrations/db/post_migrate/20231004091113_swap_columns_for_ci_sources_pipelines_pipeline_id_bigint_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/db/post_migrate/20231004091113_swap_columns_for_ci_sources_pipelines_pipeline_id_bigint_spec.rb.
31722:12:44# [RSpecRunTime] Starting example group spec/migrations/migrate_custom_permissions_spec.rb. Missing expected duration from Knapsack report for spec/migrations/migrate_custom_permissions_spec.rb.
31822:12:44MigrateCustomPermissions
31922:12:44 correctly migrates up and down (PENDING: Skipping because migration MigrateCustomPermissions is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
32022:12:44# [RSpecRunTime] Finishing example group spec/migrations/migrate_custom_permissions_spec.rb. It took 0.02 second. Missing expected duration from Knapsack report for spec/migrations/migrate_custom_permissions_spec.rb.
32122:12:47auto_explain log contains 852 entries for main, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-migration-pg14-single-db-21-26.341.main.ndjson.gz
32222:12:47took 3.062888499
32322:12:47[TEST PROF INFO] EventProf results for sql.active_record
32422:12:47Total time: 01:04.894 of 02:08.304 (50.58%)
32522:12:47Total events: 47136
32622:12:47Top 5 slowest suites (by time):
32722:12:47QueueBackfill...tionsProjectId (./spec/migrations/20240916124325_queue_backfill_alert_management_alert_user_mentions_project_id_spec.rb:6) – 00:22.746 (15989 / 1) of 00:42.439 (53.6%)
32822:12:47QueueBackfill...tionsProjectId (./spec/migrations/20240916132826_queue_backfill_incident_management_oncall_rotations_project_id_spec.rb:6) – 00:22.681 (15771 / 1) of 00:43.575 (52.05%)
32922:12:47QueueRecoverD...ersionPackages (./spec/migrations/20241003061916_queue_recover_deleted_ml_model_version_packages_spec.rb:6) – 00:15.976 (11955 / 1) of 00:31.171 (51.25%)
33022:12:47QueueBackfill...rtitionedTable (./spec/migrations/20241107064635_queue_backfill_ci_runner_machines_partitioned_table_spec.rb:6) – 00:03.451 (3344 / 1) of 00:10.906 (31.65%)
33122:12:47BackfillZoekt...exedNamespaces (./spec/migrations/20231103223224_backfill_zoekt_node_id_on_indexed_namespaces_spec.rb:6) – 00:00.003 (7 / 2) of 00:00.021 (17.84%)
33222:12:47Knapsack report was generated. Preview:
33322:12:47{
33422:12:47 "spec/migrations/20240916132826_queue_backfill_incident_management_oncall_rotations_project_id_spec.rb": 20.14842849699926,
33522:12:47 "spec/migrations/20240916124325_queue_backfill_alert_management_alert_user_mentions_project_id_spec.rb": 18.816771412999515,
33622:12:47 "spec/migrations/20241003061916_queue_recover_deleted_ml_model_version_packages_spec.rb": 14.387343585000053,
33722:12:47 "spec/migrations/20241107064635_queue_backfill_ci_runner_machines_partitioned_table_spec.rb": 5.853926762996707
33822:12:47}
33922:12:47Knapsack global time execution for tests: 59s
34022:12:47Pending: (Failures listed here are expected and do not affect your suite's status)
34122:12:47 1) BackfillZoektNodeIdOnIndexedNamespaces#up backfills zoekt_node_id with zoekt_shard_id
34222:12:47 # Skipping because migration BackfillZoektNodeIdOnIndexedNamespaces is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34322:12:47 # ./spec/migrations/20231103223224_backfill_zoekt_node_id_on_indexed_namespaces_spec.rb:41
34422:12:47 2) BackfillZoektNodeIdOnIndexedNamespaces#up when there is somehow more than one zoekt node uses the latest zoekt node
34522:12:47 # Skipping because migration BackfillZoektNodeIdOnIndexedNamespaces is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34622:12:47 # ./spec/migrations/20231103223224_backfill_zoekt_node_id_on_indexed_namespaces_spec.rb:71
34722:12:47 3) QueueBackfillCatalogResourceVersionsReleasedAt schedules a new batched migration
34822:12:47 # Skipping because migration QueueBackfillCatalogResourceVersionsReleasedAt is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34922:12:47 # ./spec/migrations/20240118225727_queue_backfill_catalog_resource_versions_released_at_spec.rb:9
35022:12:47 4) QueueBackfillDeploymentApprovalsProjectId schedules a new batched migration
35122:12:47 # Skipping because migration QueueBackfillDeploymentApprovalsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35222:12:47 # ./spec/migrations/20240410004337_queue_backfill_deployment_approvals_project_id_spec.rb:10
35322:12:47 5) QueueBackfillDefaultBranchProtectionSettings schedules a new batched migration
35422:12:47 # Skipping because migration QueueBackfillDefaultBranchProtectionSettings is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35522:12:47 # ./spec/migrations/20240516160731_queue_backfill_default_branch_protection_settings_spec.rb:9
35622:12:47 6) QueueBackfillVulnerabilityUserMentionsProjectId schedules a new batched migration
35722:12:47 # Skipping because migration QueueBackfillVulnerabilityUserMentionsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35822:12:47 # ./spec/migrations/20240604150537_queue_backfill_vulnerability_user_mentions_project_id_spec.rb:10
35922:12:47 7) QueueBackfillSbomOccurrencesVulnerabilitiesProjectId schedules a new batched migration
36022:12:47 # Skipping because migration QueueBackfillSbomOccurrencesVulnerabilitiesProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
36122:12:47 # ./spec/migrations/20240612075305_queue_backfill_sbom_occurrences_vulnerabilities_project_id_spec.rb:9
36222:12:47 8) UpdateWeightWidgetDefinitions updates existing weight definitions and adds a new one for epics
36322:12:47 # Skipping because migration UpdateWeightWidgetDefinitions is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
36422:12:47 # ./spec/migrations/20240627231742_update_weight_widget_definitions_spec.rb:10
36522:12:47 9) QueueRecalculateDoraDeploymentFrequencyScore schedules a new batched migration
36622:12:47 # Skipping because migration QueueRecalculateDoraDeploymentFrequencyScore is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
36722:12:47 # ./spec/migrations/20240722104700_queue_recalculate_dora_deployment_frequency_score_spec.rb:9
36822:12:47 10) CleanTimeTrackingWidgetDefinitions#up fixes all widget definition names if they had the wrong casing
36922:12:47 # Skipping because migration CleanTimeTrackingWidgetDefinitions is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37022:12:47 # ./spec/migrations/20240814151504_clean_time_tracking_widget_definitions_spec.rb:13
37122:12:47 11) CleanTimeTrackingWidgetDefinitions#up logs a warning if the type is missing
37222:12:47 # Skipping because migration CleanTimeTrackingWidgetDefinitions is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37322:12:47 # ./spec/migrations/20240814151504_clean_time_tracking_widget_definitions_spec.rb:22
37422:12:47 12) SwapColumnsForCiSourcesPipelinesPipelineIdBigint behaves like swap conversion columns correctly swaps conversion columns
37522:12:47 # Skipping because migration SwapColumnsForCiSourcesPipelinesPipelineIdBigint is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37622:12:47 # ./spec/support/shared_examples/migrations/swap_conversion_columns_shared_examples.rb:26
37722:12:47 13) SwapColumnsForCiSourcesPipelinesPipelineIdBigint when indexes are missing behaves like swap conversion columns correctly swaps conversion columns
37822:12:47 # Skipping because migration SwapColumnsForCiSourcesPipelinesPipelineIdBigint is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37922:12:47 # ./spec/support/shared_examples/migrations/swap_conversion_columns_shared_examples.rb:26
38022:12:47 14) MigrateCustomPermissions correctly migrates up and down
38122:12:47 # Skipping because migration MigrateCustomPermissions is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
38222:12:47 # ./spec/migrations/migrate_custom_permissions_spec.rb:13
38322:12:47Finished in 2 minutes 18.5 seconds (files took 57.07 seconds to load)
38422:12:4718 examples, 0 failures, 14 pending
38522:12:47Randomized with seed 30053
38622:12:56[TEST PROF INFO] Time spent in factories: 00:00.209 (0.15% of total time)
38722:12:56RSpec exited with 0.
38822:12:56No examples to retry, congrats!
389 22:12:56 Running after_script 00:12
39022:12:57Running after script...
39122:12:57$ source scripts/utils.sh
39222:12:57$ log_disk_usage
39322:12:57*******************************************************
39422:12:57This runner currently has 73G free disk space.
39522:12:57*******************************************************
396 22:12:57 Disk usage detail 00:04
45222:13:01$ bundle exec gem list gitlab_quality-test_tooling
45322:13:03gitlab_quality-test_tooling (2.1.0)
45422:13:03$ section_start "failed-test-issues" "Report test failures" # collapsed multi-line command
455 22:13:03 Report test failures 00:00
45722:13:03$ section_start "flaky-test-issues" "Report test flakiness" # collapsed multi-line command
458 22:13:03 Report test flakiness 00:00
46022:13:03$ section_start "slow-test-issues" "Report test slowness" # collapsed multi-line command
461 22:13:03 Report test slowness 00:00
46322:13:03$ section_start "slow-test-merge-request-report-note" "Report test slowness in MR note" # collapsed multi-line command
464 22:13:03 Report test slowness in MR note 00:02
46722:13:05$ section_start "knapsack-report-issues" "Report test files close to timing out" # collapsed multi-line command
468 22:13:05 Report test files close to timing out 00:02
47122:13:07$ tooling/bin/push_job_metrics || true
47222:13:08[job-metrics] Pushing job metrics file for the CI/CD job.
47322:13:08[job-metrics] Pushed 4 CI job metric entries to InfluxDB.
474 22:13:08 Saving cache for successful job 00:01
47522:13:08Not uploading cache ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20 due to policy
476 22:13:09 Uploading artifacts for successful job 00:04
47722:13:09Uploading artifacts...
47822:13:09auto_explain/: found 2 matching artifact files and directories
47922:13:09coverage/: found 5 matching artifact files and directories
48022:13:09crystalball/: found 2 matching artifact files and directories
48122:13:09WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
48222:13:09knapsack/: found 4 matching artifact files and directories
48322:13:09rspec/: found 16 matching artifact files and directories
48422:13:09WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
48522:13:09log/*.log: found 13 matching artifact files and directories
48622:13:09WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8353287178/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
48722:13:09WARNING: Retrying... context=artifacts-uploader error=request redirected
48822:13:11Uploading artifacts as "archive" to coordinator... 201 Created id=8353287178 responseStatus=201 Created token=glcbt-66
48922:13:11Uploading artifacts...
49022:13:12rspec/rspec-*.xml: found 1 matching artifact files and directories
49122:13:12WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8353287178/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
49222:13:12WARNING: Retrying... context=artifacts-uploader error=request redirected
49322:13:13Uploading artifacts as "junit" to coordinator... 201 Created id=8353287178 responseStatus=201 Created token=glcbt-66
494 22:13:13 Cleaning up project directory and file based variables 00:01
49522:13:22Job succeeded