Skip to content
Snippets Groups Projects

rspec background_migration pg14 single-db 9/17

Passed Started by
Simon Tomlinson
@stomlinson
Log timestamps in UTC.
122:06:52Running with gitlab-runner 17.4.0~pre.110.g27400594 (27400594)
222:06:52 on blue-4.private.runners-manager.gitlab.com/gitlab.com/gitlab-org tDjA3Sp3, system ID: s_96a8ae3d1050
322:06:52 feature flags: FF_NETWORK_PER_BUILD:true, FF_TIMESTAMPS:true
422:06:52Resolving secrets
5 22:06:52 Preparing the "docker+machine" executor 00:07
622:06:52Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
722:06:54Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1...
822:06:54Authenticating with credentials from job payload (GitLab Registry)
922:06:54Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
1022:06:55Using docker image sha256:82f132c22567f8ce17cc132c14b2f9aa3eaf9bb5424d91c2d966912433f0257d for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:c55e1364ee4327b244a9cfa1750f19feea14fc774eaf792b725967d146eb45f5 ...
1122:06:55WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1222:06:55WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1322:06:55Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12...
1422:06:55Authenticating with credentials from job payload (GitLab Registry)
1522:06:55Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
1622:06:55Using docker image sha256:5c5ba5b83d6c60cb0b225bd670b7a43be8c238cc72347d24af57e5027c3648f3 for registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:46aceab84c42d0e819c8e7940f2f98ce9e184785cd7b22d95872024a35f52407 ...
1722:06:56Starting service redis:6.2-alpine...
1822:06:56Pulling docker image redis:6.2-alpine ...
1922:06:57Using docker image sha256:4100b5bd17430263e85ad9d8ab851959b234acaaf378e093f1f98400f4998815 for redis:6.2-alpine with digest redis@sha256:eaba718fecd1196d88533de7ba49bf903ad33664a92debb24660a922ecd9cac8 ...
2022:06:57Waiting for services to be up and running (timeout 30 seconds)...
2122:06:58Authenticating with credentials from job payload (GitLab Registry)
2222:06:58Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
2322:06:59Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
24 22:06:59 Preparing environment 00:00
2522:06:59Running on runner-tdja3sp3-project-278964-concurrent-0 via runner-tdja3sp3-private-1731529835-2b0dd623...
26 22:06:59 Getting source from Git repository 00:01
2722:07:00Skipping Git repository setup
2822:07:00Skipping Git checkout
2922:07:00Skipping Git submodules setup
30 22:07:00 Restoring cache 00:18
3122:07:00Checking cache for ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20...
3222:07:00Downloading cache from https://storage.googleapis.com/gitlab-com-runners-cache/project/278964/ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20 ETag="ba67364f761343c8f313528473af941a"
3322:07:13Successfully extracted cache
34 22:07:18 Downloading artifacts 00:45
3522:07:18Downloading artifacts for clone-gitlab-repo (8353286583)...
3622:07:23Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286583 responseStatus=200 OK token=glcbt-66
3722:07:24WARNING: Part of .git directory is on the list of files to extract
3822:07:24WARNING: This may introduce unexpected problems
3922:07:36Downloading artifacts for compile-test-assets (8353286630)...
4022:07:39Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286630 responseStatus=200 OK token=glcbt-66
4122:07:45Downloading artifacts for detect-tests (8353286649)...
4222:07:46Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286649 responseStatus=200 OK token=glcbt-66
4322:07:46Downloading artifacts for retrieve-tests-metadata (8353286664)...
4422:07:46Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286664 responseStatus=200 OK token=glcbt-66
4522:07:46Downloading artifacts for setup-test-env (8353286635)...
4622:07:51Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286635 responseStatus=200 OK token=glcbt-66
47 22:08:03 Executing "step_script" stage of the job script
4822:08:03Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
4922:08:03$ echo $FOSS_ONLY
5022:08:03$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
5122:08:03$ export GOPATH=$CI_PROJECT_DIR/.go
5222:08:03$ mkdir -p $GOPATH
5322:08:03$ source scripts/utils.sh
5422:08:03$ log_disk_usage "true"
5522:08:03*******************************************************
5622:08:03This runner currently has 73G free disk space.
5722:08:03*******************************************************
58 22:08:03 Disk usage detail 00:05
5922:08:03df -h
6022:08:03Filesystem Size Used Avail Use% Mounted on
6122:08:03overlay 95G 22G 73G 23% /
6222:08:03tmpfs 64M 0 64M 0% /dev
6322:08:03shm 64M 0 64M 0% /dev/shm
6422:08:03/dev/sda1 95G 22G 73G 23% /cache
6522:08:03tmpfs 3.9G 0 3.9G 0% /sys/devices/virtual/dmi/id
6622:08:03du -h -d 1
6722:08:037.4M ./workhorse
6822:08:03148K ./bin
6922:08:031.2M ./.gitlab
7022:08:03167M ./.git
7122:08:034.0K ./builds
7222:08:0328M ./lib
7322:08:038.0K ./.vscode
7422:08:03560K ./storybook
7522:08:0324K ./log
7622:08:031.8M ./data
7722:08:0311M ./qa
7822:08:033.2M ./.rubocop_todo
7922:08:04856M ./vendor
8022:08:041023M ./public
8122:08:0462M ./doc
8222:08:04484K ./danger
8322:08:0432K ./rspec
8422:08:04556K ./tooling
8522:08:04145M ./ee
8622:08:041.3M ./knapsack
8722:08:04300K ./patches
8822:08:044.3M ./changelogs
8922:08:0420K ./haml_lint
9022:08:0428K ./metrics_server
9122:08:04108K ./keeps
9222:08:0436K ./shared
9322:08:0444K ./generator_templates
9422:08:041.3M ./scripts
9522:08:04763M ./tmp
9622:08:04127M ./spec
9722:08:0420K ./file_hooks
9822:08:0432K ./crystalball
9922:08:0416K ./sidekiq_cluster
10022:08:0417M ./gems
10122:08:041.2M ./fixtures
10222:08:04964K ./rubocop
10322:08:044.0K ./.go
10422:08:0433M ./db
10522:08:0412K ./.github
10622:08:04129M ./locale
10722:08:0420M ./config
10822:08:0482M ./app
10922:08:0420K ./.lefthook
11022:08:043.5G .
11122:08:04$ source scripts/prepare_build.sh
112 22:08:04 Installing gems 00:16
14322:08:20Using two connections, single database config (config/database.yml.postgresql)
14422:08:20Disabling ci connection in config/database.yml
14522:08:20Geo DB won't be set up.
14622:08:20Embedding DB won't be set up.
147 22:08:20 Setting up DBs 00:49
17222:09:09$ source ./scripts/rspec_helpers.sh
17322:09:09$ run_timed_command "gem install knapsack --no-document"
17422:09:08$ gem install knapsack --no-document
17522:09:09Successfully installed knapsack-4.0.0
17622:09:091 gem installed
17722:09:09==> 'gem install knapsack --no-document' succeeded in 0 seconds.
17822:09:09$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"
179 22:09:09 Spawning Gitaly 00:05
18322:09:14$ export RSPEC_SKIPPED_TESTS_REPORT_PATH="rspec/skipped_tests-${CI_JOB_ID}.txt"
18422:09:14$ export RSPEC_RETRIED_TESTS_REPORT_PATH="rspec/retried_tests-${CI_JOB_ID}.txt"
18522:09:14$ tooling/bin/create_job_metrics_file || true
18622:09:16[job-metrics] Creating the job metrics file for the CI/CD job.
18722:09:16$ rspec_section rspec_parallelized_job "--fail-fast=${RSPEC_FAIL_FAST_THRESHOLD} --tag ~quarantine --tag ~zoekt --tag ~click_house"
188 22:09:16 RSpec 25:17
18922:09:16[22:09:16] Starting rspec_parallelized_job
19022:09:09RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
19122:09:16KNAPSACK_GENERATE_REPORT: true
19222:09:16FLAKY_RSPEC_GENERATE_REPORT: true
19322:09:16KNAPSACK_TEST_FILE_PATTERN: spec/{lib/gitlab/background_migration,lib/ee/gitlab/background_migration}{,/**/}*_spec.rb
19422:09:16KNAPSACK_LOG_LEVEL: debug
19522:09:16KNAPSACK_REPORT_PATH: knapsack/rspec_background_migration_pg14_single-db_9_17_278964_report.json
19622:09:16FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
19722:09:16FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec_background_migration_pg14_single-db_9_17_278964_report.json
19822:09:16NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec_background_migration_pg14_single-db_9_17_278964_report.json
19922:09:16RSPEC_SKIPPED_TESTS_REPORT_PATH: rspec/skipped_tests-8353287221.txt
20022:09:16CRYSTALBALL:
20122:09:16RSPEC_TESTS_MAPPING_ENABLED:
20222:09:16RSPEC_TESTS_FILTER_FILE:
20322:09:16Shell set options (set -o) enabled:
20422:09:16braceexpand on
20522:09:16hashall on
20622:09:16interactive-comments on
20722:09:16pipefail on
20822:09:22Knapsack report generator started!
20922:09:16/builds/gitlab-org/gitlab/vendor/ruby/3.2.0/gems/io-event-1.6.5/lib/io/event/support.rb:27: warning: IO::Buffer is experimental and both the Ruby and C interface may change in the future!
21022:09:31 ██  ██  █████  ██████  ███  ██ ██ ███  ██  ██████ 
21122:09:31 ██  ██ ██   ██ ██   ██ ████  ██ ██ ████  ██ ██      
21222:09:31 ██  █  ██ ███████ ██████  ██ ██  ██ ██ ██ ██  ██ ██  ███ 
21322:09:31 ██ ███ ██ ██   ██ ██   ██ ██  ██ ██ ██ ██  ██ ██ ██  ██ 
21422:09:31  ███ ███  ██  ██ ██  ██ ██   ████ ██ ██   ████  ██████  
21522:09:31******************************************************************************
21622:09:31 Your database has a single connection, and single connections were
21722:09:31 deprecated in GitLab 15.9 https://docs.gitlab.com/ee/update/deprecations.html#single-database-connection-is-deprecated.
21822:09:31 In GitLab 17.0 and later, you must have the two main: and ci: sections in your database.yml.
21922:09:31 Please add a :ci section to your database, following these instructions:
22022:09:31 https://docs.gitlab.com/ee/install/installation.html#configure-gitlab-db-settings.
22122:09:31******************************************************************************
22222:09:58DEPRECATION WARNING: Support for Rails versions < 7.1 is deprecated and will be removed from ViewComponent 4.0.0 (ViewComponent v4 will remove support for Rails versions < 7.1 no earlier than April 1, 2025) (called from <top (required)> at /builds/gitlab-org/gitlab/config/environment.rb:7)
22322:10:09warning: parser/current is loading parser/ruby32, which recognizes 3.2.6-compliant syntax, but you are running 3.2.5.
22422:10:09Please see https://github.com/whitequark/parser#compatibility-with-ruby-mri.
22522:10:12Run options: exclude {:quarantine=>true, :zoekt=>true, :click_house=>true}
22622:10:12# [RSpecRunTime] Starting RSpec timer...
22722:10:12[TEST PROF INFO] EventProf enabled (sql.active_record)
22822:10:12unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
22922:10:19Test environment set up in 2.71514317 seconds
23022:10:19# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/convert_credit_card_validation_data_to_hashes_spec.rb. Expected to take 2 minutes 28.36 seconds.
23122:10:19Gitlab::BackgroundMigration::ConvertCreditCardValidationDataToHashes
23222:12:01 #perform
23322:12:24 updates values to hash for records in the specified batch
23422:12:24 with NULL columns
23522:12:46 does not update values for records in the specified batch
23622:13:12INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
23722:13:12INFO: analyzing "public.ci_pipeline_variables"
23822:13:12INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
23922:13:15INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
24022:13:15INFO: analyzing "public.ci_pipeline_variables"
24122:13:15INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
24222:13:20INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
24322:13:20INFO: analyzing "public.ci_job_artifacts"
24422:13:20INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
24522:13:23INFO: analyzing "public.p_ci_stages" inheritance tree
24622:13:23INFO: analyzing "public.ci_stages"
24722:13:23INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
24822:14:25INFO: analyzing "public.p_ci_pipelines" inheritance tree
24922:14:25INFO: analyzing "public.ci_pipelines"
25022:14:25INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
25122:14:58# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/convert_credit_card_validation_data_to_hashes_spec.rb. It took 4 minutes 38.58 seconds. Expected to take 2 minutes 28.36 seconds.
25222:14:58# [RSpecRunTime] RSpec elapsed time: 4 minutes 45.44 seconds. Current RSS: ~1234M. Threads: 1. load average: 1.07 1.08 1.03 1/260 387
25322:14:58.
25422:14:58# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/batched_migration_job_spec.rb. Expected to take 1 minute 57.35 seconds.
25522:14:58Gitlab::BackgroundMigration::BatchedMigrationJob
25622:14:58 .generic_instance
25722:15:02 defines generic instance with only some of the attributes set
25822:15:02# [RSpecRunTime] RSpec elapsed time: 4 minutes 50.16 seconds. Current RSS: ~1224M. Threads: 1. load average: 1.06 1.08 1.03 1/260 388
25922:15:02.
26022:15:02 .job_arguments
26122:15:06 defines methods
26222:15:06 when no job arguments are defined
26322:15:10 job_arguments_count is 0
26422:15:10# [RSpecRunTime] RSpec elapsed time: 4 minutes 57.51 seconds. Current RSS: ~1213M. Threads: 1. load average: 1.06 1.08 1.03 1/260 389
26522:15:10.
26622:15:10 .operation_name
26722:15:13 defines method
26822:15:13 when `operation_name` is not defined
26922:15:17 raises an exception
27022:15:17# [RSpecRunTime] RSpec elapsed time: 5 minutes 5.04 seconds. Current RSS: ~1210M. Threads: 1. load average: 1.05 1.07 1.03 1/260 390
27122:15:17.
27222:15:17 .scope_to
27322:15:17 when additional scoping is defined
27422:15:21 applies additional scope to the provided relation
27522:15:21# [RSpecRunTime] RSpec elapsed time: 5 minutes 8.73 seconds. Current RSS: ~1211M. Threads: 1. load average: 1.05 1.07 1.03 1/260 391
27622:15:21.
27722:15:21 when there is no additional scoping defined
27822:15:24 returns provided relation as is
27922:15:25# [RSpecRunTime] RSpec elapsed time: 5 minutes 12.43 seconds. Current RSS: ~1212M. Threads: 1. load average: 1.05 1.07 1.03 1/260 392
28022:15:25.
28122:15:25 .feature_category
28222:15:25 when jobs does not have feature_category attribute set
28322:15:28 returns :database as default
28422:15:28# [RSpecRunTime] RSpec elapsed time: 5 minutes 16.22 seconds. Current RSS: ~1211M. Threads: 1. load average: 1.04 1.07 1.03 1/260 393
28522:15:28.
28622:15:28 when jobs have feature_category attribute set
28722:15:32 returns the provided value
28822:15:32# [RSpecRunTime] RSpec elapsed time: 5 minutes 20.01 seconds. Current RSS: ~1211M. Threads: 1. load average: 1.04 1.07 1.03 1/260 394
28922:15:32.
29022:15:32 descendants
29122:15:36 have the same method signature for #perform
29222:15:39 do not use .batching_scope
29322:15:39# [RSpecRunTime] RSpec elapsed time: 5 minutes 27.34 seconds. Current RSS: ~1214M. Threads: 1. load average: 0.95 1.05 1.02 1/260 395
29422:15:39.
29522:15:39 #perform
29622:15:43 raises an error if not overridden
29722:15:43 when the subclass uses sub-batching
29822:15:47 calls the operation for each sub-batch
29922:15:50 instruments the batch operation
30022:15:54 pauses after each sub-batch
30122:15:54 with additional scoping
30222:15:58 respects #filter_batch
30322:15:58# [RSpecRunTime] RSpec elapsed time: 5 minutes 45.47 seconds. Current RSS: ~1212M. Threads: 1. load average: 1.05 1.06 1.03 1/260 396
30422:15:58.
30522:15:58 when using a sub batch exception for timeouts
30622:16:02 raises the expected error type
30722:16:02# [RSpecRunTime] RSpec elapsed time: 5 minutes 49.55 seconds. Current RSS: ~1214M. Threads: 1. load average: 1.12 1.08 1.03 1/260 397
30822:16:02.
30922:16:02 when batching_arguments are given
31022:16:05 forwards them for batching
31122:16:06# [RSpecRunTime] RSpec elapsed time: 5 minutes 53.43 seconds. Current RSS: ~1214M. Threads: 1. load average: 1.20 1.10 1.04 1/260 398
31222:16:06.
31322:16:06 when the subclass uses distinct each batch
31422:16:09 calls the operation for each distinct batch
31522:16:13 stores the affected rows
31622:16:13 when used in combination with scope_to
31722:16:17 raises an error
31822:16:17# [RSpecRunTime] RSpec elapsed time: 6 minutes 5.13 seconds. Current RSS: ~1218M. Threads: 1. load average: 1.16 1.09 1.04 1/260 399
31922:16:17.
32022:16:22# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/batched_migration_job_spec.rb. It took 1 minute 24.41 seconds. Expected to take 1 minute 57.35 seconds.
32122:16:22# [RSpecRunTime] RSpec elapsed time: 6 minutes 10.08 seconds. Current RSS: ~1211M. Threads: 1. load average: 1.15 1.09 1.04 1/260 400
32222:16:22.
32322:16:22# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/delete_invalid_protected_branch_push_access_levels_spec.rb. Expected to take 1 minute 40.77 seconds.
32422:16:22Gitlab::BackgroundMigration::DeleteInvalidProtectedBranchPushAccessLevels
32522:17:52 when there are push access levels
32622:18:03 deletes push access levels with groups that do not have project_group_links to the project
32722:18:03# [RSpecRunTime] RSpec elapsed time: 7 minutes 50.79 seconds. Current RSS: ~1233M. Threads: 1. load average: 1.20 1.13 1.06 1/260 401
32822:18:03.
32922:18:07INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
33022:18:07INFO: analyzing "public.ci_pipeline_variables"
33122:18:07INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
33222:18:09INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
33322:18:09INFO: analyzing "public.ci_pipeline_variables"
33422:18:09INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
33522:18:14INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
33622:18:14INFO: analyzing "public.ci_job_artifacts"
33722:18:14INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
33822:18:18INFO: analyzing "public.p_ci_stages" inheritance tree
33922:18:18INFO: analyzing "public.ci_stages"
34022:18:18INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
34122:19:20INFO: analyzing "public.p_ci_pipelines" inheritance tree
34222:19:20INFO: analyzing "public.ci_pipelines"
34322:19:20INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
34422:19:55# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/delete_invalid_protected_branch_push_access_levels_spec.rb. It took 3 minutes 32.86 seconds. Expected to take 1 minute 40.77 seconds.
34522:19:55# [RSpecRunTime] RSpec elapsed time: 9 minutes 42.99 seconds. Current RSS: ~1244M. Threads: 1. load average: 1.07 1.09 1.05 1/261 403
34622:19:55.
34722:19:55# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_user_achievements_namespace_id_spec.rb. Expected to take 1 minute 17.85 seconds.
34822:19:55Gitlab::BackgroundMigration::BackfillUserAchievementsNamespaceId
34922:21:01 constructs a valid query
35022:21:09 performs without error
35122:21:47INFO: analyzing "public.p_ci_pipelines" inheritance tree
35222:21:47INFO: analyzing "public.ci_pipelines"
35322:21:47INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
35422:22:22# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_user_achievements_namespace_id_spec.rb. It took 2 minutes 26.54 seconds. Expected to take 1 minute 17.85 seconds.
35522:22:22# [RSpecRunTime] RSpec elapsed time: 12 minutes 9.58 seconds. Current RSS: ~1241M. Threads: 1. load average: 1.09 1.10 1.05 1/261 404
35622:22:22.
35722:22:22# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_operations_feature_flags_issues_project_id_spec.rb. Expected to take 1 minute 15.05 seconds.
35822:22:22Gitlab::BackgroundMigration::BackfillOperationsFeatureFlagsIssuesProjectId
35922:23:28 performs without error
36022:23:36 constructs a valid query
36122:24:15INFO: analyzing "public.p_ci_pipelines" inheritance tree
36222:24:15INFO: analyzing "public.ci_pipelines"
36322:24:15INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
36422:24:48# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_operations_feature_flags_issues_project_id_spec.rb. It took 2 minutes 25.98 seconds. Expected to take 1 minute 15.05 seconds.
36522:24:48# [RSpecRunTime] RSpec elapsed time: 14 minutes 35.63 seconds. Current RSS: ~1235M. Threads: 1. load average: 0.98 1.04 1.04 1/261 405
36622:24:48.
36722:24:48# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_dast_profiles_tags_project_id_spec.rb. Expected to take 1 minute 11.88 seconds.
36822:24:48Gitlab::BackgroundMigration::BackfillDastProfilesTagsProjectId
36922:25:50 constructs a valid query
37022:25:57 performs without error
37122:26:35INFO: analyzing "public.p_ci_pipelines" inheritance tree
37222:26:35INFO: analyzing "public.ci_pipelines"
37322:26:35INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
37422:27:08# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_dast_profiles_tags_project_id_spec.rb. It took 2 minutes 20.47 seconds. Expected to take 1 minute 11.88 seconds.
37522:27:08# [RSpecRunTime] RSpec elapsed time: 16 minutes 56.15 seconds. Current RSS: ~1237M. Threads: 1. load average: 0.95 1.03 1.03 1/260 406
37622:27:08.
37722:27:08# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/migrate_links_for_vulnerability_findings_spec.rb. Expected to take 1 minute 5.66 seconds.
37822:27:08Gitlab::BackgroundMigration::MigrateLinksForVulnerabilityFindings
37922:27:09 with links equals to an array of nil element
38022:27:14 does not create any link
38122:27:14# [RSpecRunTime] RSpec elapsed time: 17 minutes 1.46 seconds. Current RSS: ~1228M. Threads: 1. load average: 0.96 1.03 1.03 1/260 407
38222:27:14.
38322:27:14 without the presence of links key
38422:27:18 does not create any link
38522:27:18# [RSpecRunTime] RSpec elapsed time: 17 minutes 5.76 seconds. Current RSS: ~1228M. Threads: 1. load average: 1.04 1.05 1.03 1/260 408
38622:27:18.
38722:27:18 with links equals to a string
38822:27:23 does not create any link
38922:27:23# [RSpecRunTime] RSpec elapsed time: 17 minutes 11.02 seconds. Current RSS: ~1226M. Threads: 1. load average: 1.04 1.05 1.03 1/260 409
39022:27:23.
39122:27:23 when Gitlab::Json throws exception JSON::ParserError
39222:27:28 does not log this error nor create new records
39322:27:28# [RSpecRunTime] RSpec elapsed time: 17 minutes 15.54 seconds. Current RSS: ~1218M. Threads: 1. load average: 0.95 1.03 1.03 1/260 410
39422:27:28.
39522:27:28 with links equals to an array of duplicated elements
39622:27:32 creates one new link
39722:27:32# [RSpecRunTime] RSpec elapsed time: 17 minutes 20.03 seconds. Current RSS: ~1215M. Threads: 1. load average: 0.96 1.03 1.03 1/260 411
39822:27:32.
39922:27:32 when link name is too long
40022:27:37 skips creation of link and logs error
40122:27:37# [RSpecRunTime] RSpec elapsed time: 17 minutes 24.52 seconds. Current RSS: ~1218M. Threads: 1. load average: 1.04 1.05 1.03 1/260 412
40222:27:37.
40322:27:37 with some elements which do not contain the key url
40422:27:41 creates links only to valid elements
40522:27:41# [RSpecRunTime] RSpec elapsed time: 17 minutes 28.77 seconds. Current RSS: ~1218M. Threads: 1. load average: 1.04 1.04 1.03 1/260 413
40622:27:41.
40722:27:41 with existing links within raw_metadata
40822:27:45 creates new link for each finding
40922:27:45# [RSpecRunTime] RSpec elapsed time: 17 minutes 33.27 seconds. Current RSS: ~1220M. Threads: 1. load average: 1.04 1.04 1.03 1/260 414
41022:27:45.
41122:27:45 with existing link records
41222:27:50 does not create new link
41322:27:54 does not raise ActiveRecord::RecordNotUnique
41422:27:54# [RSpecRunTime] RSpec elapsed time: 17 minutes 41.91 seconds. Current RSS: ~1218M. Threads: 1. load average: 1.03 1.04 1.03 1/261 415
41522:27:54.
41622:27:54 when link url is too long
41722:27:58 skips creation of link and logs error
41822:27:58# [RSpecRunTime] RSpec elapsed time: 17 minutes 46.31 seconds. Current RSS: ~1220M. Threads: 1. load average: 1.43 1.12 1.06 1/261 416
41922:27:58.
42022:28:04# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/migrate_links_for_vulnerability_findings_spec.rb. It took 55.28 seconds. Expected to take 1 minute 5.66 seconds.
42122:28:04# [RSpecRunTime] RSpec elapsed time: 17 minutes 51.47 seconds. Current RSS: ~1213M. Threads: 1. load average: 1.39 1.12 1.06 1/261 417
42222:28:04.
42322:28:04# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_ci_builds_runner_session_project_id_spec.rb. Expected to take 51.65 seconds.
42422:28:04Gitlab::BackgroundMigration::BackfillCiBuildsRunnerSessionProjectId
42522:28:22 constructs a valid query
42622:28:25 performs without error
42722:28:50# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_ci_builds_runner_session_project_id_spec.rb. It took 46.06 seconds. Expected to take 51.65 seconds.
42822:28:50# [RSpecRunTime] RSpec elapsed time: 18 minutes 37.6 seconds. Current RSS: ~1243M. Threads: 1. load average: 1.27 1.12 1.06 1/261 418
42922:28:50.
43022:28:50# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_sharding_key_id_on_ci_runners_spec.rb. Expected to take 49.71 seconds.
43122:28:50Gitlab::BackgroundMigration::BackfillShardingKeyIdOnCiRunners
43222:29:00 #perform
43322:29:04 backfills sharding_key_id
43422:29:04 when a project runner is shared with other projects
43522:29:08 backfills sharding_key_id with the id of the owner project
43622:29:08 when the project has a different owner project
43722:29:12 backfills sharding_key_id with the id of the owner project
43822:29:12# [RSpecRunTime] RSpec elapsed time: 18 minutes 59.88 seconds. Current RSS: ~1225M. Threads: 1. load average: 1.27 1.13 1.06 1/261 419
43922:29:12.
44022:29:32# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_sharding_key_id_on_ci_runners_spec.rb. It took 42.31 seconds. Expected to take 49.71 seconds.
44122:29:32# [RSpecRunTime] RSpec elapsed time: 19 minutes 20.03 seconds. Current RSS: ~1239M. Threads: 1. load average: 1.19 1.12 1.06 1/261 420
44222:29:32.
44322:29:32# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_upstream_pipeline_partition_id_on_p_ci_builds_spec.rb. Expected to take 34.23 seconds.
44422:29:32Gitlab::BackgroundMigration::BackfillUpstreamPipelinePartitionIdOnPCiBuilds
44522:29:59 #perform
44622:30:03 backfills upstream_pipeline_partition_id
44722:30:03# [RSpecRunTime] RSpec elapsed time: 19 minutes 51.25 seconds. Current RSS: ~1241M. Threads: 1. load average: 1.20 1.12 1.06 1/261 421
44822:30:03.
44922:30:07INFO: analyzing "public.p_ci_pipelines" inheritance tree
45022:30:07INFO: "ci_pipelines": scanned 1 of 1 pages, containing 0 live rows and 4 dead rows; 0 rows in sample, 0 estimated total rows
45122:30:07INFO: analyzing "public.ci_pipelines"
45222:30:07INFO: "ci_pipelines": scanned 1 of 1 pages, containing 0 live rows and 4 dead rows; 0 rows in sample, 0 estimated total rows
45322:30:40# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_upstream_pipeline_partition_id_on_p_ci_builds_spec.rb. It took 1 minute 8.1 seconds. Expected to take 34.23 seconds.
45422:30:40# [RSpecRunTime] RSpec elapsed time: 20 minutes 28.18 seconds. Current RSS: ~1240M. Threads: 1. load average: 1.22 1.14 1.07 1/261 422
45522:30:40.
45622:30:40# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_approval_project_rules_protected_branches_project_id_spec.rb. Expected to take 26.01 seconds.
45722:30:40Gitlab::BackgroundMigration::BackfillApprovalProjectRulesProtectedBranchesProjectId
45822:30:59 performs without error
45922:31:03 constructs a valid query
46022:31:28# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_approval_project_rules_protected_branches_project_id_spec.rb. It took 47.78 seconds. Expected to take 26.01 seconds.
46122:31:28# [RSpecRunTime] RSpec elapsed time: 21 minutes 16.03 seconds. Current RSS: ~1238M. Threads: 1. load average: 1.10 1.12 1.07 1/262 423
46222:31:28.
46322:31:28# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/delete_orphans_approval_project_rules2_spec.rb. Expected to take 23.96 seconds.
46422:31:28Gitlab::BackgroundMigration::DeleteOrphansApprovalProjectRules2
46522:31:34 #perform
46622:31:38 delete only approval rules without association with the security project and report_type equals to 4
46722:31:38 with rule sources
46822:31:43 deletes referenced sources
46922:31:47 does not delete unreferenced sources
47022:31:47# [RSpecRunTime] RSpec elapsed time: 21 minutes 34.55 seconds. Current RSS: ~1219M. Threads: 1. load average: 1.36 1.17 1.09 1/262 424
47122:31:47.
47222:31:59# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/delete_orphans_approval_project_rules2_spec.rb. It took 31.17 seconds. Expected to take 23.96 seconds.
47322:31:59# [RSpecRunTime] RSpec elapsed time: 21 minutes 47.29 seconds. Current RSS: ~1223M. Threads: 1. load average: 1.30 1.17 1.09 1/262 425
47422:31:59.
47522:31:59# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_deploy_tokens_sharding_key_spec.rb. Expected to take 10.17 seconds.
47622:31:59Gitlab::BackgroundMigration::BackfillDeployTokensShardingKey
47722:32:07 backfills the missing project_id or namespace_id
47822:32:17# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_deploy_tokens_sharding_key_spec.rb. It took 17.8 seconds. Expected to take 10.17 seconds.
47922:32:17# [RSpecRunTime] RSpec elapsed time: 22 minutes 5.14 seconds. Current RSS: ~1224M. Threads: 1. load average: 1.15 1.14 1.08 1/262 426
48022:32:17.
48122:32:17# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/populate_detumbled_email_in_emails_spec.rb. Expected to take 8.96 seconds.
48222:32:17Gitlab::BackgroundMigration::PopulateDetumbledEmailInEmails
48322:32:21 #perform
48422:32:25 successfully sets the detumbled_email
48522:32:25# [RSpecRunTime] RSpec elapsed time: 22 minutes 12.62 seconds. Current RSS: ~1234M. Threads: 1. load average: 1.14 1.14 1.08 1/262 427
48622:32:25.
48722:32:34# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/populate_detumbled_email_in_emails_spec.rb. It took 16.77 seconds. Expected to take 8.96 seconds.
48822:32:34# [RSpecRunTime] RSpec elapsed time: 22 minutes 21.95 seconds. Current RSS: ~1228M. Threads: 1. load average: 1.04 1.12 1.07 1/262 428
48922:32:34.
49022:32:34# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/alter_webhook_deleted_audit_event_spec.rb. Expected to take 6.16 seconds.
49122:32:34Gitlab::BackgroundMigration::AlterWebhookDeletedAuditEvent
49222:32:35 #perform
49322:32:39 alters target details column
49422:32:39# [RSpecRunTime] RSpec elapsed time: 22 minutes 26.49 seconds. Current RSS: ~1236M. Threads: 1. load average: 1.04 1.11 1.07 1/262 429
49522:32:39.
49622:32:43# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/alter_webhook_deleted_audit_event_spec.rb. It took 9.4 seconds. Expected to take 6.16 seconds.
49722:32:44# [RSpecRunTime] RSpec elapsed time: 22 minutes 31.4 seconds. Current RSS: ~1224M. Threads: 1. load average: 0.95 1.10 1.07 1/262 430
49822:32:44.
49922:33:11auto_explain log contains 1186 entries for main, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-background-migration-pg14-single-db-9-17.341.main.ndjson.gz
50022:33:11took 27.34052774
50122:33:11[TEST PROF INFO] EventProf results for sql.active_record
50222:33:11Total time: 12:14.288 of 22:24.576 (54.61%)
50322:33:11Total events: 536324
50422:33:11Top 5 slowest suites (by time):
50522:33:11Gitlab::Backg...onDataToHashes (./spec/lib/gitlab/background_migration/convert_credit_card_validation_data_to_hashes_spec.rb:5) – 02:35.528 (113660 / 2) of 04:38.803 (55.78%)
50622:33:11Gitlab::Backg...shAccessLevels (./spec/lib/gitlab/background_migration/delete_invalid_protected_branch_push_access_levels_spec.rb:5) – 02:12.834 (93776 / 1) of 03:32.909 (62.39%)
50722:33:11Gitlab::Backg...ntsNamespaceId (./spec/lib/gitlab/background_migration/backfill_user_achievements_namespace_id_spec.rb:5) – 01:24.982 (54444 / 2) of 02:26.604 (57.97%)
50822:33:11Gitlab::Backg...ssuesProjectId (./spec/lib/gitlab/background_migration/backfill_operations_feature_flags_issues_project_id_spec.rb:5) – 01:24.886 (54060 / 2) of 02:26.033 (58.13%)
50922:33:11Gitlab::Backg...sTagsProjectId (./spec/lib/gitlab/background_migration/backfill_dast_profiles_tags_project_id_spec.rb:5) – 01:22.786 (54332 / 2) of 02:20.518 (58.92%)
51022:33:11Knapsack report was generated. Preview:
51122:33:11{
51222:33:11 "spec/lib/gitlab/background_migration/convert_credit_card_validation_data_to_hashes_spec.rb": 148.17547266099973,
51322:33:11 "spec/lib/gitlab/background_migration/batched_migration_job_spec.rb": 79.52542456699939,
51422:33:11 "spec/lib/gitlab/background_migration/delete_invalid_protected_branch_push_access_levels_spec.rb": 100.72514323700034,
51522:33:11 "spec/lib/gitlab/background_migration/backfill_user_achievements_namespace_id_spec.rb": 73.71297272100037,
51622:33:11 "spec/lib/gitlab/background_migration/backfill_operations_feature_flags_issues_project_id_spec.rb": 74.51944709500003,
51722:33:11 "spec/lib/gitlab/background_migration/backfill_dast_profiles_tags_project_id_spec.rb": 69.53351018900048,
51822:33:11 "spec/lib/gitlab/background_migration/migrate_links_for_vulnerability_findings_spec.rb": 50.18331041500005,
51922:33:11 "spec/lib/gitlab/background_migration/backfill_ci_builds_runner_session_project_id_spec.rb": 21.769099643999652,
52022:33:11 "spec/lib/gitlab/background_migration/backfill_sharding_key_id_on_ci_runners_spec.rb": 22.225827090000166,
52122:33:11 "spec/lib/gitlab/background_migration/backfill_upstream_pipeline_partition_id_on_p_ci_builds_spec.rb": 31.243643550999877,
52222:33:11 "spec/lib/gitlab/background_migration/backfill_approval_project_rules_protected_branches_project_id_spec.rb": 22.371843547000026,
52322:33:11 "spec/lib/gitlab/background_migration/delete_orphans_approval_project_rules2_spec.rb": 18.496724556000117,
52422:33:11 "spec/lib/gitlab/background_migration/backfill_deploy_tokens_sharding_key_spec.rb": 8.100884387000406,
52522:33:11 "spec/lib/gitlab/background_migration/populate_detumbled_email_in_emails_spec.rb": 7.496973004999745,
52622:33:11 "spec/lib/gitlab/background_migration/alter_webhook_deleted_audit_event_spec.rb": 4.551809395999953
52722:33:11}
52822:33:11Knapsack global time execution for tests: 12m 12s
52922:33:11Finished in 22 minutes 59 seconds (files took 53.2 seconds to load)
53022:33:1155 examples, 0 failures
53122:33:11Randomized with seed 49006
53222:33:19[TEST PROF INFO] Time spent in factories: 00:00.296 (0.02% of total time)
53322:33:20RSpec exited with 0.
53422:33:20No examples to retry, congrats!
535 22:33:20 Running after_script 00:12
53622:33:21Running after script...
53722:33:21$ source scripts/utils.sh
53822:33:21$ log_disk_usage
53922:33:21*******************************************************
54022:33:21This runner currently has 72G free disk space.
54122:33:21*******************************************************
542 22:33:21 Disk usage detail 00:05
59822:33:26$ bundle exec gem list gitlab_quality-test_tooling
59922:33:28gitlab_quality-test_tooling (2.1.0)
60022:33:28$ section_start "failed-test-issues" "Report test failures" # collapsed multi-line command
601 22:33:28 Report test failures 00:00
60322:33:28$ section_start "flaky-test-issues" "Report test flakiness" # collapsed multi-line command
604 22:33:28 Report test flakiness 00:00
60622:33:28$ section_start "slow-test-issues" "Report test slowness" # collapsed multi-line command
607 22:33:28 Report test slowness 00:00
60922:33:28$ section_start "slow-test-merge-request-report-note" "Report test slowness in MR note" # collapsed multi-line command
610 22:33:28 Report test slowness in MR note 00:01
61322:33:29$ section_start "knapsack-report-issues" "Report test files close to timing out" # collapsed multi-line command
614 22:33:29 Report test files close to timing out 00:02
61722:33:31$ tooling/bin/push_job_metrics || true
61822:33:32[job-metrics] Pushing job metrics file for the CI/CD job.
61922:33:32[job-metrics] Pushed 4 CI job metric entries to InfluxDB.
620 22:33:32 Saving cache for successful job 00:01
62122:33:33Not uploading cache ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20 due to policy
622 22:33:33 Uploading artifacts for successful job 00:05
62322:33:34Uploading artifacts...
62422:33:34auto_explain/: found 2 matching artifact files and directories
62522:33:34coverage/: found 5 matching artifact files and directories
62622:33:34crystalball/: found 2 matching artifact files and directories
62722:33:34WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
62822:33:34knapsack/: found 4 matching artifact files and directories
62922:33:34rspec/: found 16 matching artifact files and directories
63022:33:34WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
63122:33:34log/*.log: found 13 matching artifact files and directories
63222:33:34WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8353287221/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
63322:33:34WARNING: Retrying... context=artifacts-uploader error=request redirected
63422:33:36Uploading artifacts as "archive" to coordinator... 201 Created id=8353287221 responseStatus=201 Created token=glcbt-66
63522:33:36Uploading artifacts...
63622:33:36rspec/rspec-*.xml: found 1 matching artifact files and directories
63722:33:36WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8353287221/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
63822:33:36WARNING: Retrying... context=artifacts-uploader error=request redirected
63922:33:38Uploading artifacts as "junit" to coordinator... 201 Created id=8353287221 responseStatus=201 Created token=glcbt-66
640 22:33:38 Cleaning up project directory and file based variables 00:00
64122:33:46Job succeeded