Skip to content
Snippets Groups Projects

rspec migration pg14 single-db-ci-connection 7/26

Passed Started by
Simon Tomlinson
@stomlinson
Log timestamps in UTC.
122:12:14Running with gitlab-runner 17.4.0~pre.110.g27400594 (27400594)
222:12:14 on blue-1.private.runners-manager.gitlab.com/gitlab.com/gitlab-org 1zzGUpzq, system ID: s_fc31da7ae46e
322:12:14 feature flags: FF_NETWORK_PER_BUILD:true, FF_TIMESTAMPS:true
422:12:14Resolving secrets
5 22:12:14 Preparing the "docker+machine" executor 01:27
622:12:14Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
722:12:18Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1...
822:12:18Authenticating with credentials from job payload (GitLab Registry)
922:12:18Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
1022:12:25Using docker image sha256:82f132c22567f8ce17cc132c14b2f9aa3eaf9bb5424d91c2d966912433f0257d for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:c55e1364ee4327b244a9cfa1750f19feea14fc774eaf792b725967d146eb45f5 ...
1122:12:29WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1222:12:29WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1322:12:29Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12...
1422:12:29Authenticating with credentials from job payload (GitLab Registry)
1522:12:29Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
1622:12:32Using docker image sha256:5c5ba5b83d6c60cb0b225bd670b7a43be8c238cc72347d24af57e5027c3648f3 for registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:46aceab84c42d0e819c8e7940f2f98ce9e184785cd7b22d95872024a35f52407 ...
1722:12:34Starting service redis:6.2-alpine...
1822:12:34Pulling docker image redis:6.2-alpine ...
1922:12:37Using docker image sha256:4100b5bd17430263e85ad9d8ab851959b234acaaf378e093f1f98400f4998815 for redis:6.2-alpine with digest redis@sha256:eaba718fecd1196d88533de7ba49bf903ad33664a92debb24660a922ecd9cac8 ...
2022:12:37Waiting for services to be up and running (timeout 30 seconds)...
2122:12:40Authenticating with credentials from job payload (GitLab Registry)
2222:12:40Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
2322:13:41Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
24 22:13:41 Preparing environment 00:01
2522:13:41Running on runner-1zzgupzq-project-13083-concurrent-0 via runner-1zzgupzq-private-1731535891-ab42d857...
26 22:13:42 Getting source from Git repository 00:00
2722:13:42Skipping Git repository setup
2822:13:42Skipping Git checkout
2922:13:42Skipping Git submodules setup
30 22:13:42 Restoring cache 00:17
3122:13:43Checking cache for ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-3...
3222:13:43Downloading cache from https://storage.googleapis.com/gitlab-com-runners-cache/project/13083/ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-3 ETag="2f01fc71854036e0b450342e02ca5726"
3322:13:54Successfully extracted cache
34 22:13:59 Downloading artifacts 00:40
3522:13:59Downloading artifacts for clone-gitlab-repo (8353300418)...
3622:14:03Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353300418 responseStatus=200 OK token=glcbt-66
3722:14:03WARNING: Part of .git directory is on the list of files to extract
3822:14:03WARNING: This may introduce unexpected problems
3922:14:13Downloading artifacts for compile-test-assets (8353300423)...
4022:14:17Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353300423 responseStatus=200 OK token=glcbt-66
4122:14:22Downloading artifacts for detect-tests (8353300433)...
4222:14:22Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353300433 responseStatus=200 OK token=glcbt-66
4322:14:22Downloading artifacts for retrieve-tests-metadata (8353300434)...
4422:14:23Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353300434 responseStatus=200 OK token=glcbt-66
4522:14:23Downloading artifacts for setup-test-env (8353300427)...
4622:14:28Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353300427 responseStatus=200 OK token=glcbt-66
47 22:14:39 Executing "step_script" stage of the job script
4822:14:39Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
4922:14:40$ echo $FOSS_ONLY
5022:14:40$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
5122:14:40$ export GOPATH=$CI_PROJECT_DIR/.go
5222:14:40$ mkdir -p $GOPATH
5322:14:40$ source scripts/utils.sh
5422:14:40$ log_disk_usage "true"
5522:14:40*******************************************************
5622:14:40This runner currently has 80G free disk space.
5722:14:40*******************************************************
58 22:14:40 Disk usage detail 00:00
5922:14:40df -h
6022:14:40Filesystem Size Used Avail Use% Mounted on
6122:14:40overlay 95G 15G 80G 16% /
6222:14:40tmpfs 64M 0 64M 0% /dev
6322:14:40shm 64M 0 64M 0% /dev/shm
6422:14:40/dev/sda1 95G 15G 80G 16% /cache
6522:14:40tmpfs 3.9G 0 3.9G 0% /sys/devices/virtual/dmi/id
6622:14:40du -h -d 1
6722:14:407.4M ./workhorse
6822:14:40148K ./bin
6922:14:401.2M ./.gitlab
7022:14:40121M ./.git
7122:14:404.0K ./builds
7222:14:4028M ./lib
7322:14:40560K ./storybook
7422:14:4024K ./log
7522:14:401.8M ./data
7622:14:407.1M ./qa
7722:14:403.2M ./.rubocop_todo
7822:14:41856M ./vendor
7922:14:41858M ./public
8022:14:4162M ./doc
8122:14:41484K ./danger
8222:14:4132K ./rspec
8322:14:41556K ./tooling
8422:14:411.3M ./knapsack
8522:14:41300K ./patches
8622:14:413.9M ./changelogs
8722:14:4120K ./haml_lint
8822:14:4128K ./metrics_server
8922:14:41108K ./keeps
9022:14:4136K ./shared
9122:14:4144K ./generator_templates
9222:14:411.3M ./scripts
9322:14:41641M ./tmp
9422:14:41127M ./spec
9522:14:4120K ./file_hooks
9622:14:4132K ./crystalball
9722:14:4116K ./sidekiq_cluster
9822:14:4117M ./gems
9922:14:411.2M ./fixtures
10022:14:41964K ./rubocop
10122:14:414.0K ./.go
10222:14:4133M ./db
10322:14:4112K ./.github
10422:14:41129M ./locale
10522:14:4120M ./config
10622:14:4182M ./app
10722:14:4120K ./.lefthook
10822:14:413.0G .
10922:14:41$ source scripts/prepare_build.sh
110 22:14:41 Installing gems 00:41
15122:15:22Using two connections, single database config (config/database.yml.postgresql)
15222:15:22Geo DB won't be set up.
15322:15:22Embedding DB won't be set up.
154 22:15:22 Setting up DBs 01:06
16722:16:28$ source ./scripts/rspec_helpers.sh
16822:16:28$ run_timed_command "gem install knapsack --no-document"
16922:16:27$ gem install knapsack --no-document
17022:16:28Successfully installed knapsack-4.0.0
17122:16:281 gem installed
17222:16:28==> 'gem install knapsack --no-document' succeeded in 0 seconds.
17322:16:28$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"
174 22:16:28 Spawning Gitaly 00:06
17822:16:34$ export RSPEC_SKIPPED_TESTS_REPORT_PATH="rspec/skipped_tests-${CI_JOB_ID}.txt"
17922:16:34$ export RSPEC_RETRIED_TESTS_REPORT_PATH="rspec/retried_tests-${CI_JOB_ID}.txt"
18022:16:34$ tooling/bin/create_job_metrics_file || true
18122:16:37[job-metrics] Feature disabled because CI_JOB_METRICS_ENABLED is not set to true.
18222:16:37$ rspec_section rspec_parallelized_job "--fail-fast=${RSPEC_FAIL_FAST_THRESHOLD} --tag ~quarantine --tag ~zoekt --tag ~click_house"
183 22:16:37 RSpec 05:30
18422:16:37[22:16:37] Starting rspec_parallelized_job
18522:16:28RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
18622:16:37KNAPSACK_GENERATE_REPORT: true
18722:16:37FLAKY_RSPEC_GENERATE_REPORT: true
18822:16:37KNAPSACK_TEST_FILE_PATTERN: spec/{migrations}{,/**/}*_spec.rb
18922:16:37KNAPSACK_LOG_LEVEL: debug
19022:16:37KNAPSACK_REPORT_PATH: knapsack/rspec_migration_pg14_single-db-ci-connection_7_26_13083_report.json
19122:16:37FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
19222:16:37FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec_migration_pg14_single-db-ci-connection_7_26_13083_report.json
19322:16:37NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec_migration_pg14_single-db-ci-connection_7_26_13083_report.json
19422:16:37RSPEC_SKIPPED_TESTS_REPORT_PATH: rspec/skipped_tests-8353301118.txt
19522:16:37CRYSTALBALL:
19622:16:37RSPEC_TESTS_MAPPING_ENABLED:
19722:16:37RSPEC_TESTS_FILTER_FILE:
19822:16:37Shell set options (set -o) enabled:
19922:16:37braceexpand on
20022:16:37hashall on
20122:16:37interactive-comments on
20222:16:37pipefail on
20322:16:43Knapsack report generator started!
20422:16:37/builds/gitlab-org/gitlab-foss/vendor/ruby/3.2.0/gems/io-event-1.6.5/lib/io/event/support.rb:27: warning: IO::Buffer is experimental and both the Ruby and C interface may change in the future!
20522:17:23DEPRECATION WARNING: Support for Rails versions < 7.1 is deprecated and will be removed from ViewComponent 4.0.0 (ViewComponent v4 will remove support for Rails versions < 7.1 no earlier than April 1, 2025) (called from <top (required)> at /builds/gitlab-org/gitlab-foss/config/environment.rb:7)
20622:17:30warning: parser/current is loading parser/ruby32, which recognizes 3.2.6-compliant syntax, but you are running 3.2.5.
20722:17:30Please see https://github.com/whitequark/parser#compatibility-with-ruby-mri.
20822:17:40/builds/gitlab-org/gitlab-foss/vendor/ruby/3.2.0/gems/io-event-1.6.5/lib/io/event/support.rb:27: warning: IO::Buffer is experimental and both the Ruby and C interface may change in the future!
20922:17:51DEPRECATION WARNING: Support for Rails versions < 7.1 is deprecated and will be removed from ViewComponent 4.0.0 (ViewComponent v4 will remove support for Rails versions < 7.1 no earlier than April 1, 2025) (called from <main> at /builds/gitlab-org/gitlab-foss/config/environment.rb:7)
21022:18:11Run options: exclude {:quarantine=>true, :zoekt=>true, :click_house=>true}
21122:18:11# [RSpecRunTime] Starting RSpec timer...
21222:18:11[TEST PROF INFO] EventProf enabled (sql.active_record)
21322:18:11unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
21422:18:20Test environment set up in 2.812959231 seconds
21522:18:20# [RSpecRunTime] Starting example group spec/migrations/20241007171237_requeue_backfill_p_ci_runner_machine_builds_project_id_spec.rb. Expected to take 37.89 seconds.
21622:18:20RequeueBackfillPCiRunnerMachineBuildsProjectId
21722:18:29ci: == [advisory_lock_connection] object_id: 1859600, pg_backend_pid: 147
21822:18:29ci: == 20241007171237 RequeueBackfillPCiRunnerMachineBuildsProjectId: migrating ===
21922:18:29ci: == 20241007171237 RequeueBackfillPCiRunnerMachineBuildsProjectId: migrated (0.0245s)
22022:18:29ci: == [advisory_lock_connection] object_id: 1859600, pg_backend_pid: 147
22122:18:34 does not schedule a new batched migration
22222:18:34 when executed on .com
22322:18:35ci: == [advisory_lock_connection] object_id: 2547020, pg_backend_pid: 155
22422:18:35ci: == 20241007171237 RequeueBackfillPCiRunnerMachineBuildsProjectId: migrating ===
22522:18:36ci: == 20241007171237 RequeueBackfillPCiRunnerMachineBuildsProjectId: migrated (0.1172s)
22622:18:36ci: == [advisory_lock_connection] object_id: 2547020, pg_backend_pid: 155
22722:18:41 schedules a new batched migration
22822:19:03# [RSpecRunTime] Finishing example group spec/migrations/20241007171237_requeue_backfill_p_ci_runner_machine_builds_project_id_spec.rb. It took 43.24 seconds. Expected to take 37.89 seconds.
22922:19:04# [RSpecRunTime] RSpec elapsed time: 52.84 seconds. Current RSS: ~913M. Threads: 1. load average: 1.11 1.13 0.64 1/260 412
23022:19:04.
23122:19:04# [RSpecRunTime] Starting example group spec/migrations/20241008030404_queue_backfill_events_personal_namespace_id_spec.rb. Expected to take 17.07 seconds.
23222:19:04QueueBackfillEventsPersonalNamespaceId
23322:19:12main: == [advisory_lock_connection] object_id: 6668640, pg_backend_pid: 168
23422:19:12main: == 20241008030404 QueueBackfillEventsPersonalNamespaceId: migrating ===========
23522:19:12main: == 20241008030404 QueueBackfillEventsPersonalNamespaceId: migrated (0.0701s) ==
23622:19:12main: == [advisory_lock_connection] object_id: 6668640, pg_backend_pid: 168
23722:19:17 schedules a new batched migration
23822:19:38# [RSpecRunTime] Finishing example group spec/migrations/20241008030404_queue_backfill_events_personal_namespace_id_spec.rb. It took 34.28 seconds. Expected to take 17.07 seconds.
23922:19:38# [RSpecRunTime] RSpec elapsed time: 1 minute 27.66 seconds. Current RSS: ~911M. Threads: 1. load average: 1.15 1.13 0.66 1/259 413
24022:19:38.
24122:19:38# [RSpecRunTime] Starting example group spec/migrations/20241015080747_queue_backfill_dependency_proxy_manifest_states_group_id_spec.rb. Expected to take 11.83 seconds.
24222:19:38QueueBackfillDependencyProxyManifestStatesGroupId
24322:19:43main: == [advisory_lock_connection] object_id: 10238580, pg_backend_pid: 179
24422:19:43main: == 20241015080747 QueueBackfillDependencyProxyManifestStatesGroupId: migrating
24522:19:43main: == 20241015080747 QueueBackfillDependencyProxyManifestStatesGroupId: migrated (0.0699s)
24622:19:43main: == [advisory_lock_connection] object_id: 10238580, pg_backend_pid: 179
24722:19:48 schedules a new batched migration
24822:20:03# [RSpecRunTime] Finishing example group spec/migrations/20241015080747_queue_backfill_dependency_proxy_manifest_states_group_id_spec.rb. It took 25.23 seconds. Expected to take 11.83 seconds.
24922:20:03# [RSpecRunTime] RSpec elapsed time: 1 minute 52.93 seconds. Current RSS: ~908M. Threads: 1. load average: 1.10 1.12 0.67 1/259 414
25022:20:03.
25122:20:03# [RSpecRunTime] Starting example group spec/migrations/20230929155123_migrate_disable_merge_trains_value_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20230929155123_migrate_disable_merge_trains_value_spec.rb.
25222:20:03MigrateDisableMergeTrainsValue
25322:20:03 #up
25422:20:03 migrates the flag value into the setting value (PENDING: Skipping because migration MigrateDisableMergeTrainsValue is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
25522:20:03 #down
25622:20:03 reverts the migration (PENDING: Skipping because migration MigrateDisableMergeTrainsValue is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
25722:20:03# [RSpecRunTime] Finishing example group spec/migrations/20230929155123_migrate_disable_merge_trains_value_spec.rb. It took . Missing expected duration from Knapsack report for spec/migrations/20230929155123_migrate_disable_merge_trains_value_spec.rb.
25822:20:03# [RSpecRunTime] Starting example group spec/migrations/20231218092401_queue_backfill_partition_id_ci_pipeline_chat_data_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20231218092401_queue_backfill_partition_id_ci_pipeline_chat_data_spec.rb.
25922:20:03QueueBackfillPartitionIdCiPipelineChatData
26022:20:04 #up
26122:20:04 with migration present
26222:20:04 when migration finished successfully
26322:20:04 does not raise exception (PENDING: Skipping because migration QueueBackfillPartitionIdCiPipelineChatData is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
26422:20:04 schedules background jobs for each batch of ci_pipeline_chat_data (PENDING: Skipping because migration QueueBackfillPartitionIdCiPipelineChatData is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
26522:20:04 #down
26622:20:04 deletes all batched migration records (PENDING: Skipping because migration QueueBackfillPartitionIdCiPipelineChatData is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
26722:20:04# [RSpecRunTime] Finishing example group spec/migrations/20231218092401_queue_backfill_partition_id_ci_pipeline_chat_data_spec.rb. It took . Missing expected duration from Knapsack report for spec/migrations/20231218092401_queue_backfill_partition_id_ci_pipeline_chat_data_spec.rb.
26822:20:04# [RSpecRunTime] Starting example group spec/migrations/20240223130548_queue_update_sbom_components_name_based_on_pep503_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240223130548_queue_update_sbom_components_name_based_on_pep503_spec.rb.
26922:20:04QueueUpdateSbomComponentsNameBasedOnPep503
27022:20:04 schedules a new batched migration (PENDING: Skipping because migration QueueUpdateSbomComponentsNameBasedOnPep503 is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
27122:20:04# [RSpecRunTime] Finishing example group spec/migrations/20240223130548_queue_update_sbom_components_name_based_on_pep503_spec.rb. It took . Missing expected duration from Knapsack report for spec/migrations/20240223130548_queue_update_sbom_components_name_based_on_pep503_spec.rb.
27222:20:04# [RSpecRunTime] Starting example group spec/migrations/20240502044605_remove_create_empty_embeddings_records_worker_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240502044605_remove_create_empty_embeddings_records_worker_spec.rb.
27322:20:04RemoveCreateEmptyEmbeddingsRecordsWorker
27422:20:04 when cron job exists
27522:20:04 deletes the cron job and enqueued jobs (PENDING: Skipping because migration RemoveCreateEmptyEmbeddingsRecordsWorker is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
27622:20:04 when cron job does not exist
27722:20:04 no-ops (PENDING: Skipping because migration RemoveCreateEmptyEmbeddingsRecordsWorker is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
27822:20:04# [RSpecRunTime] Finishing example group spec/migrations/20240502044605_remove_create_empty_embeddings_records_worker_spec.rb. It took . Missing expected duration from Knapsack report for spec/migrations/20240502044605_remove_create_empty_embeddings_records_worker_spec.rb.
27922:20:04# [RSpecRunTime] Starting example group spec/migrations/20240529112047_queue_backfill_wiki_page_slugs_project_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240529112047_queue_backfill_wiki_page_slugs_project_id_spec.rb.
28022:20:04QueueBackfillWikiPageSlugsProjectId
28122:20:04 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillWikiPageSlugsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
28222:20:04# [RSpecRunTime] Finishing example group spec/migrations/20240529112047_queue_backfill_wiki_page_slugs_project_id_spec.rb. It took . Missing expected duration from Knapsack report for spec/migrations/20240529112047_queue_backfill_wiki_page_slugs_project_id_spec.rb.
28322:20:04# [RSpecRunTime] Starting example group spec/migrations/20240607105705_queue_backfill_dast_site_validations_project_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240607105705_queue_backfill_dast_site_validations_project_id_spec.rb.
28422:20:04QueueBackfillDastSiteValidationsProjectId
28522:20:04 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillDastSiteValidationsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
28622:20:04# [RSpecRunTime] Finishing example group spec/migrations/20240607105705_queue_backfill_dast_site_validations_project_id_spec.rb. It took . Missing expected duration from Knapsack report for spec/migrations/20240607105705_queue_backfill_dast_site_validations_project_id_spec.rb.
28722:20:04# [RSpecRunTime] Starting example group spec/migrations/20240618123929_queue_backfill_epic_issues_namespace_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240618123929_queue_backfill_epic_issues_namespace_id_spec.rb.
28822:20:04QueueBackfillEpicIssuesNamespaceId
28922:20:04 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillEpicIssuesNamespaceId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29022:20:04# [RSpecRunTime] Finishing example group spec/migrations/20240618123929_queue_backfill_epic_issues_namespace_id_spec.rb. It took . Missing expected duration from Knapsack report for spec/migrations/20240618123929_queue_backfill_epic_issues_namespace_id_spec.rb.
29122:20:04# [RSpecRunTime] Starting example group spec/migrations/20240708130252_remove_idx_project_statistics_wiki_size_and_project_id_sync_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240708130252_remove_idx_project_statistics_wiki_size_and_project_id_sync_spec.rb.
29222:20:04RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync
29322:20:04 #up
29422:20:04 does nothing when not on gitlab.com (PENDING: Skipping because migration RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29522:20:04 removes the index when on gitlab.com (PENDING: Skipping because migration RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29622:20:04 #down
29722:20:04 does nothing when not on gitlab.com (PENDING: Skipping because migration RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29822:20:04 re-adds the index when on gitlab.com (PENDING: Skipping because migration RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
29922:20:04# [RSpecRunTime] Finishing example group spec/migrations/20240708130252_remove_idx_project_statistics_wiki_size_and_project_id_sync_spec.rb. It took . Missing expected duration from Knapsack report for spec/migrations/20240708130252_remove_idx_project_statistics_wiki_size_and_project_id_sync_spec.rb.
30022:20:04# [RSpecRunTime] Starting example group spec/migrations/20240801195253_queue_backfill_reserved_storage_bytes_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240801195253_queue_backfill_reserved_storage_bytes_spec.rb.
30122:20:04QueueBackfillReservedStorageBytes
30222:20:04 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillReservedStorageBytes is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
30322:20:04# [RSpecRunTime] Finishing example group spec/migrations/20240801195253_queue_backfill_reserved_storage_bytes_spec.rb. It took . Missing expected duration from Knapsack report for spec/migrations/20240801195253_queue_backfill_reserved_storage_bytes_spec.rb.
30422:20:04# [RSpecRunTime] Starting example group spec/migrations/20240829160537_queue_backfill_p_ci_runner_machine_builds_project_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/20240829160537_queue_backfill_p_ci_runner_machine_builds_project_id_spec.rb.
30522:20:04QueueBackfillPCiRunnerMachineBuildsProjectId
30622:20:04 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillPCiRunnerMachineBuildsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
30722:20:04 when executed on .com
30822:20:04 schedules a new batched migration (PENDING: Skipping because migration QueueBackfillPCiRunnerMachineBuildsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
30922:20:04# [RSpecRunTime] Finishing example group spec/migrations/20240829160537_queue_backfill_p_ci_runner_machine_builds_project_id_spec.rb. It took . Missing expected duration from Knapsack report for spec/migrations/20240829160537_queue_backfill_p_ci_runner_machine_builds_project_id_spec.rb.
31022:20:04# [RSpecRunTime] Starting example group spec/migrations/db/post_migrate/20240703134651_finalize_backfill_merge_request_review_llm_summaries_project_id_spec.rb. Missing expected duration from Knapsack report for spec/migrations/db/post_migrate/20240703134651_finalize_backfill_merge_request_review_llm_summaries_project_id_spec.rb.
31122:20:04FinalizeBackfillMergeRequestReviewLlmSummariesProjectId
31222:20:04 #up
31322:20:04 ensures the migration is completed for self-managed instances (PENDING: Skipping because migration FinalizeBackfillMergeRequestReviewLlmSummariesProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.)
31422:20:04# [RSpecRunTime] Finishing example group spec/migrations/db/post_migrate/20240703134651_finalize_backfill_merge_request_review_llm_summaries_project_id_spec.rb. It took . Missing expected duration from Knapsack report for spec/migrations/db/post_migrate/20240703134651_finalize_backfill_merge_request_review_llm_summaries_project_id_spec.rb.
31522:20:04[TEST PROF INFO] EventProf results for sql.active_record
31622:20:04Total time: 00:48.430 of 01:43.386 (46.84%)
31722:20:04Total events: 44893
31822:20:04Top 5 slowest suites (by time):
31922:20:04RequeueBackfi...uildsProjectId (./spec/migrations/20241007171237_requeue_backfill_p_ci_runner_machine_builds_project_id_spec.rb:6) – 00:20.394 (17919 / 2) of 00:43.778 (46.59%)
32022:20:04QueueBackfill...nalNamespaceId (./spec/migrations/20241008030404_queue_backfill_events_personal_namespace_id_spec.rb:6) – 00:16.692 (15381 / 1) of 00:34.319 (48.64%)
32122:20:04QueueBackfill...tStatesGroupId (./spec/migrations/20241015080747_queue_backfill_dependency_proxy_manifest_states_group_id_spec.rb:6) – 00:11.343 (11593 / 1) of 00:25.261 (44.9%)
32222:20:04Knapsack report was generated. Preview:
32322:20:04{
32422:20:04 "spec/migrations/20241007171237_requeue_backfill_p_ci_runner_machine_builds_project_id_spec.rb": 20.406619347000003,
32522:20:04 "spec/migrations/20241008030404_queue_backfill_events_personal_namespace_id_spec.rb": 12.905427648,
32622:20:04 "spec/migrations/20241015080747_queue_backfill_dependency_proxy_manifest_states_group_id_spec.rb": 9.537342792000004
32722:20:04}
32822:20:04Knapsack global time execution for tests: 42s
32922:20:04Pending: (Failures listed here are expected and do not affect your suite's status)
33022:20:04 1) MigrateDisableMergeTrainsValue#up migrates the flag value into the setting value
33122:20:04 # Skipping because migration MigrateDisableMergeTrainsValue is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
33222:20:04 # ./spec/migrations/20230929155123_migrate_disable_merge_trains_value_spec.rb:61
33322:20:04 2) MigrateDisableMergeTrainsValue#down reverts the migration
33422:20:04 # Skipping because migration MigrateDisableMergeTrainsValue is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
33522:20:04 # ./spec/migrations/20230929155123_migrate_disable_merge_trains_value_spec.rb:72
33622:20:04 3) QueueBackfillPartitionIdCiPipelineChatData#up with migration present when migration finished successfully does not raise exception
33722:20:04 # Skipping because migration QueueBackfillPartitionIdCiPipelineChatData is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
33822:20:04 # ./spec/migrations/20231218092401_queue_backfill_partition_id_ci_pipeline_chat_data_spec.rb:29
33922:20:04 4) QueueBackfillPartitionIdCiPipelineChatData#up with migration present when migration finished successfully schedules background jobs for each batch of ci_pipeline_chat_data
34022:20:04 # Skipping because migration QueueBackfillPartitionIdCiPipelineChatData is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34122:20:04 # ./spec/migrations/20231218092401_queue_backfill_partition_id_ci_pipeline_chat_data_spec.rb:33
34222:20:04 5) QueueBackfillPartitionIdCiPipelineChatData#down deletes all batched migration records
34322:20:04 # Skipping because migration QueueBackfillPartitionIdCiPipelineChatData is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34422:20:04 # ./spec/migrations/20231218092401_queue_backfill_partition_id_ci_pipeline_chat_data_spec.rb:49
34522:20:04 6) QueueUpdateSbomComponentsNameBasedOnPep503 schedules a new batched migration
34622:20:04 # Skipping because migration QueueUpdateSbomComponentsNameBasedOnPep503 is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
34722:20:04 # ./spec/migrations/20240223130548_queue_update_sbom_components_name_based_on_pep503_spec.rb:10
34822:20:04 7) RemoveCreateEmptyEmbeddingsRecordsWorker when cron job exists deletes the cron job and enqueued jobs
34922:20:04 # Skipping because migration RemoveCreateEmptyEmbeddingsRecordsWorker is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35022:20:04 # ./spec/migrations/20240502044605_remove_create_empty_embeddings_records_worker_spec.rb:43
35122:20:04 8) RemoveCreateEmptyEmbeddingsRecordsWorker when cron job does not exist no-ops
35222:20:04 # Skipping because migration RemoveCreateEmptyEmbeddingsRecordsWorker is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35322:20:04 # ./spec/migrations/20240502044605_remove_create_empty_embeddings_records_worker_spec.rb:54
35422:20:04 9) QueueBackfillWikiPageSlugsProjectId schedules a new batched migration
35522:20:04 # Skipping because migration QueueBackfillWikiPageSlugsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35622:20:04 # ./spec/migrations/20240529112047_queue_backfill_wiki_page_slugs_project_id_spec.rb:9
35722:20:04 10) QueueBackfillDastSiteValidationsProjectId schedules a new batched migration
35822:20:04 # Skipping because migration QueueBackfillDastSiteValidationsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
35922:20:04 # ./spec/migrations/20240607105705_queue_backfill_dast_site_validations_project_id_spec.rb:9
36022:20:04 11) QueueBackfillEpicIssuesNamespaceId schedules a new batched migration
36122:20:04 # Skipping because migration QueueBackfillEpicIssuesNamespaceId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
36222:20:04 # ./spec/migrations/20240618123929_queue_backfill_epic_issues_namespace_id_spec.rb:9
36322:20:04 12) RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync#up does nothing when not on gitlab.com
36422:20:04 # Skipping because migration RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
36522:20:04 # ./spec/migrations/20240708130252_remove_idx_project_statistics_wiki_size_and_project_id_sync_spec.rb:13
36622:20:04 13) RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync#up removes the index when on gitlab.com
36722:20:04 # Skipping because migration RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
36822:20:04 # ./spec/migrations/20240708130252_remove_idx_project_statistics_wiki_size_and_project_id_sync_spec.rb:19
36922:20:04 14) RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync#down does nothing when not on gitlab.com
37022:20:04 # Skipping because migration RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37122:20:04 # ./spec/migrations/20240708130252_remove_idx_project_statistics_wiki_size_and_project_id_sync_spec.rb:27
37222:20:04 15) RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync#down re-adds the index when on gitlab.com
37322:20:04 # Skipping because migration RemoveIdxProjectStatisticsWikiSizeAndProjectIdSync is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37422:20:04 # ./spec/migrations/20240708130252_remove_idx_project_statistics_wiki_size_and_project_id_sync_spec.rb:33
37522:20:04 16) QueueBackfillReservedStorageBytes schedules a new batched migration
37622:20:04 # Skipping because migration QueueBackfillReservedStorageBytes is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
37722:20:04 # ./spec/migrations/20240801195253_queue_backfill_reserved_storage_bytes_spec.rb:9
37822:20:04 17) QueueBackfillPCiRunnerMachineBuildsProjectId schedules a new batched migration
37922:20:04 # Skipping because migration QueueBackfillPCiRunnerMachineBuildsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
38022:20:04 # ./spec/migrations/20240829160537_queue_backfill_p_ci_runner_machine_builds_project_id_spec.rb:10
38122:20:04 18) QueueBackfillPCiRunnerMachineBuildsProjectId when executed on .com schedules a new batched migration
38222:20:04 # Skipping because migration QueueBackfillPCiRunnerMachineBuildsProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
38322:20:04 # ./spec/migrations/20240829160537_queue_backfill_p_ci_runner_machine_builds_project_id_spec.rb:35
38422:20:04 19) FinalizeBackfillMergeRequestReviewLlmSummariesProjectId#up ensures the migration is completed for self-managed instances
38522:20:04 # Skipping because migration FinalizeBackfillMergeRequestReviewLlmSummariesProjectId is outside the test window. Run with `RUN_ALL_MIGRATION_TESTS=1 bundle exec rspec <spec> if you need to run this spec.
38622:20:04 # ./spec/migrations/db/post_migrate/20240703134651_finalize_backfill_merge_request_review_llm_summaries_project_id_spec.rb:8
38722:20:04Finished in 1 minute 53 seconds (files took 1 minute 31.22 seconds to load)
38822:20:0423 examples, 0 failures, 19 pending
38922:20:04Randomized with seed 1468
39022:20:09RSpec exited with 0.
39122:20:09No examples to retry, congrats!
392 22:20:09 Running after_script 00:05
39322:20:11Running after script...
39422:20:11$ source scripts/utils.sh
39522:20:11$ log_disk_usage
39622:20:11*******************************************************
39722:20:11This runner currently has 79G free disk space.
39822:20:11*******************************************************
399 22:20:11 Disk usage detail 00:00
45222:20:11$ bundle exec gem list gitlab_quality-test_tooling
45322:20:12gitlab_quality-test_tooling (2.1.0)
45422:20:12$ section_start "failed-test-issues" "Report test failures" # collapsed multi-line command
455 22:20:12 Report test failures 00:00
45722:20:12$ section_start "flaky-test-issues" "Report test flakiness" # collapsed multi-line command
458 22:20:12 Report test flakiness 00:00
46022:20:12$ section_start "slow-test-issues" "Report test slowness" # collapsed multi-line command
461 22:20:12 Report test slowness 00:00
46322:20:12$ section_start "slow-test-merge-request-report-note" "Report test slowness in MR note" # collapsed multi-line command
464 22:20:12 Report test slowness in MR note 00:00
46622:20:12$ section_start "knapsack-report-issues" "Report test files close to timing out" # collapsed multi-line command
467 22:20:12 Report test files close to timing out 00:00
46922:20:12$ tooling/bin/push_job_metrics || true
47022:20:14[job-metrics] Feature disabled because CI_JOB_METRICS_ENABLED is not set to true.
471 22:20:14 Saving cache for successful job 00:01
47222:20:15Not uploading cache ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-3 due to policy
473 22:20:15 Uploading artifacts for successful job 00:06
47422:20:16Uploading artifacts...
47522:20:16WARNING: auto_explain/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab-foss)
47622:20:16coverage/: found 5 matching artifact files and directories
47722:20:16crystalball/: found 2 matching artifact files and directories
47822:20:16WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab-foss)
47922:20:16knapsack/: found 4 matching artifact files and directories
48022:20:16rspec/: found 16 matching artifact files and directories
48122:20:16WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab-foss)
48222:20:16log/*.log: found 13 matching artifact files and directories
48322:20:16WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8353301118/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
48422:20:16WARNING: Retrying... context=artifacts-uploader error=request redirected
48522:20:19Uploading artifacts as "archive" to coordinator... 201 Created id=8353301118 responseStatus=201 Created token=glcbt-66
48622:20:19Uploading artifacts...
48722:20:19rspec/rspec-*.xml: found 1 matching artifact files and directories
48822:20:19WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8353301118/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
48922:20:19WARNING: Retrying... context=artifacts-uploader error=request redirected
49022:20:20Uploading artifacts as "junit" to coordinator... 201 Created id=8353301118 responseStatus=201 Created token=glcbt-66
491 22:20:21 Cleaning up project directory and file based variables 00:00
49222:20:28Job succeeded