Skip to content
Snippets Groups Projects

rspec-ee background_migration pg14 single-db 2/3

Passed Started by
Simon Tomlinson
@stomlinson
Log timestamps in UTC.
122:08:52Running with gitlab-runner 17.4.0~pre.110.g27400594 (27400594)
222:08:52 on blue-1.private.runners-manager.gitlab.com/gitlab.com/gitlab-org 1zzGUpzq, system ID: s_fc31da7ae46e
322:08:52 feature flags: FF_NETWORK_PER_BUILD:true, FF_TIMESTAMPS:true
422:08:52Resolving secrets
5 22:08:52 Preparing the "docker+machine" executor 01:35
622:08:52Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
722:08:55Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1...
822:08:55Authenticating with credentials from job payload (GitLab Registry)
922:08:55Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
1022:08:55Using docker image sha256:82f132c22567f8ce17cc132c14b2f9aa3eaf9bb5424d91c2d966912433f0257d for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:c55e1364ee4327b244a9cfa1750f19feea14fc774eaf792b725967d146eb45f5 ...
1122:08:55WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1222:08:55WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1322:08:55Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12...
1422:08:55Authenticating with credentials from job payload (GitLab Registry)
1522:08:55Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
1622:08:55Using docker image sha256:5c5ba5b83d6c60cb0b225bd670b7a43be8c238cc72347d24af57e5027c3648f3 for registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:46aceab84c42d0e819c8e7940f2f98ce9e184785cd7b22d95872024a35f52407 ...
1722:08:56Starting service redis:6.2-alpine...
1822:08:56Pulling docker image redis:6.2-alpine ...
1922:08:56Using docker image sha256:4100b5bd17430263e85ad9d8ab851959b234acaaf378e093f1f98400f4998815 for redis:6.2-alpine with digest redis@sha256:eaba718fecd1196d88533de7ba49bf903ad33664a92debb24660a922ecd9cac8 ...
2022:08:57WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.8 is already created. Ignoring.
2122:08:57WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.8 is already created. Ignoring.
2222:08:57Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.8...
2322:08:57Authenticating with credentials from job payload (GitLab Registry)
2422:08:57Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.8 ...
2522:08:59Using docker image sha256:df819140e3df737cdc7b8d6fb73ce804b05058c790e025b5f52840956feb1734 for registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.8 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:7bdf349fc3dd9da64bc6581d44c0e906bffd38977ddbd2668ba34adb5dedfe38 ...
2622:09:00Starting service elasticsearch:7.17.6...
2722:09:00Pulling docker image elasticsearch:7.17.6 ...
2822:09:10Using docker image sha256:5fad10241ffd65d817ed0ddfaf6e87eee1f7dc2a7db33db1047835560ea71fda for elasticsearch:7.17.6 with digest elasticsearch@sha256:6c128de5d01c0c130a806022d6bd99b3e4c27a9af5bfc33b6b81861ae117d028 ...
2922:09:14Starting service registry.gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/model-gateway:v1.18.0...
3022:09:14Authenticating with credentials from job payload (GitLab Registry)
3122:09:14Pulling docker image registry.gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/model-gateway:v1.18.0 ...
3222:09:45Using docker image sha256:eb97d149d5b7fa6f8d1c3551036054839115ce4ae8b1896d5b4cc1563b098719 for registry.gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/model-gateway:v1.18.0 with digest registry.gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/model-gateway@sha256:d8fb36abcbce56db6ebaaff6504a26ff7345d5f463f273b9f993e0cf65c85818 ...
3322:09:48Starting service ghcr.io/berriai/litellm:main-latest...
3422:09:48Pulling docker image ghcr.io/berriai/litellm:main-latest ...
3522:10:19Using docker image sha256:006af10d9c70ad67274d5937788e42ce2cddb97f5496178c013ed1eac59ab6ae for ghcr.io/berriai/litellm:main-latest with digest ghcr.io/berriai/litellm@sha256:e7a60e9428c4946ae4b6036206bcf98b2cdb8b74e54f75793b51592d1fc005cd ...
3622:10:21Waiting for services to be up and running (timeout 30 seconds)...
3722:10:27Authenticating with credentials from job payload (GitLab Registry)
3822:10:27Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
3922:10:27Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
40 22:10:27 Preparing environment 00:00
4122:10:27Running on runner-1zzgupzq-project-278964-concurrent-0 via runner-1zzgupzq-private-1731531012-b3cb9e92...
42 22:10:27 Getting source from Git repository 00:01
4322:10:28Skipping Git repository setup
4422:10:28Skipping Git checkout
4522:10:28Skipping Git submodules setup
46 22:10:28 Restoring cache 00:18
4722:10:29Checking cache for ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20...
4822:10:29Downloading cache from https://storage.googleapis.com/gitlab-com-runners-cache/project/278964/ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20 ETag="ba67364f761343c8f313528473af941a"
4922:10:42Successfully extracted cache
50 22:10:46 Downloading artifacts 00:50
5122:10:47Downloading artifacts for clone-gitlab-repo (8353286583)...
5222:10:53Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286583 responseStatus=200 OK token=glcbt-66
5322:10:53WARNING: Part of .git directory is on the list of files to extract
5422:10:53WARNING: This may introduce unexpected problems
5522:11:08Downloading artifacts for compile-test-assets (8353286630)...
5622:11:11Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286630 responseStatus=200 OK token=glcbt-66
5722:11:17Downloading artifacts for detect-tests (8353286649)...
5822:11:18Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286649 responseStatus=200 OK token=glcbt-66
5922:11:18Downloading artifacts for retrieve-tests-metadata (8353286664)...
6022:11:18Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286664 responseStatus=200 OK token=glcbt-66
6122:11:18Downloading artifacts for setup-test-env (8353286635)...
6222:11:25Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286635 responseStatus=200 OK token=glcbt-66
63 22:11:36 Executing "step_script" stage of the job script
6422:11:36Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
6522:11:37$ echo $FOSS_ONLY
6622:11:37$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
6722:11:37$ export GOPATH=$CI_PROJECT_DIR/.go
6822:11:37$ mkdir -p $GOPATH
6922:11:37$ source scripts/utils.sh
7022:11:37$ log_disk_usage "true"
7122:11:37*******************************************************
7222:11:37This runner currently has 75G free disk space.
7322:11:37*******************************************************
74 22:11:37 Disk usage detail 00:28
7522:11:37df -h
7622:11:37Filesystem Size Used Avail Use% Mounted on
7722:11:37overlay 95G 20G 75G 22% /
7822:11:37tmpfs 64M 0 64M 0% /dev
7922:11:37shm 64M 0 64M 0% /dev/shm
8022:11:37/dev/sda1 95G 20G 75G 22% /cache
8122:11:37tmpfs 3.9G 0 3.9G 0% /sys/devices/virtual/dmi/id
8222:11:37du -h -d 1
8322:11:377.4M ./workhorse
8422:11:37148K ./bin
8522:11:371.2M ./.gitlab
8622:11:37167M ./.git
8722:11:374.0K ./builds
8822:11:3828M ./lib
8922:11:388.0K ./.vscode
9022:11:38560K ./storybook
9122:11:3824K ./log
9222:11:381.8M ./data
9322:11:3811M ./qa
9422:11:383.2M ./.rubocop_todo
9522:11:44856M ./vendor
9622:11:441023M ./public
9722:11:4462M ./doc
9822:11:44484K ./danger
9922:11:4432K ./rspec
10022:11:44556K ./tooling
10122:11:45145M ./ee
10222:11:451.3M ./knapsack
10322:11:45300K ./patches
10422:11:454.3M ./changelogs
10522:11:4520K ./haml_lint
10622:11:4528K ./metrics_server
10722:11:45108K ./keeps
10822:11:4536K ./shared
10922:11:4544K ./generator_templates
11022:11:451.3M ./scripts
11122:11:45763M ./tmp
11222:11:45127M ./spec
11322:11:4520K ./file_hooks
11422:11:4532K ./crystalball
11522:11:4516K ./sidekiq_cluster
11622:11:4517M ./gems
11722:11:451.2M ./fixtures
11822:11:45964K ./rubocop
11922:11:454.0K ./.go
12022:11:4533M ./db
12122:11:4512K ./.github
12222:11:45129M ./locale
12322:11:4520M ./config
12422:11:4682M ./app
12522:11:4620K ./.lefthook
12622:11:463.5G .
12722:11:46$ source scripts/prepare_build.sh
128 22:11:46 Installing gems 00:20
15922:12:06Using two connections, single database config (config/database.yml.postgresql)
16022:12:06Disabling ci connection in config/database.yml
16122:12:06Geo DB will be set up.
16222:12:06Embedding DB will be set up.
163 22:12:06 Setting up DBs 02:01
19622:14:07$ source ./scripts/rspec_helpers.sh
19722:14:07$ run_timed_command "gem install knapsack --no-document"
19822:14:07$ gem install knapsack --no-document
19922:14:09Successfully installed knapsack-4.0.0
20022:14:091 gem installed
20122:14:07==> 'gem install knapsack --no-document' succeeded in 2 seconds.
20222:14:09$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"
203 22:14:09 Spawning Gitaly 00:10
20722:14:19$ export RSPEC_SKIPPED_TESTS_REPORT_PATH="rspec/skipped_tests-${CI_JOB_ID}.txt"
20822:14:19$ export RSPEC_RETRIED_TESTS_REPORT_PATH="rspec/retried_tests-${CI_JOB_ID}.txt"
20922:14:19$ tooling/bin/create_job_metrics_file || true
21022:14:24[job-metrics] Creating the job metrics file for the CI/CD job.
21122:14:24$ rspec_section rspec_parallelized_job "--fail-fast=${RSPEC_FAIL_FAST_THRESHOLD} --tag ~quarantine --tag ~zoekt --tag ~click_house"
212 22:14:24 RSpec 23:11
21322:14:24[22:14:24] Starting rspec_parallelized_job
21422:14:09RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
21522:14:24KNAPSACK_GENERATE_REPORT: true
21622:14:24FLAKY_RSPEC_GENERATE_REPORT: true
21722:14:24KNAPSACK_TEST_FILE_PATTERN: {ee/}spec/{lib/gitlab/background_migration,lib/ee/gitlab/background_migration}{,/**/}*_spec.rb
21822:14:24KNAPSACK_LOG_LEVEL: debug
21922:14:24KNAPSACK_REPORT_PATH: knapsack/rspec-ee_background_migration_pg14_single-db_2_3_278964_report.json
22022:14:24FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
22122:14:24FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec-ee_background_migration_pg14_single-db_2_3_278964_report.json
22222:14:24NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec-ee_background_migration_pg14_single-db_2_3_278964_report.json
22322:14:24RSPEC_SKIPPED_TESTS_REPORT_PATH: rspec/skipped_tests-8353288381.txt
22422:14:24CRYSTALBALL:
22522:14:24RSPEC_TESTS_MAPPING_ENABLED:
22622:14:24RSPEC_TESTS_FILTER_FILE:
22722:14:24Shell set options (set -o) enabled:
22822:14:24braceexpand on
22922:14:24hashall on
23022:14:24interactive-comments on
23122:14:24pipefail on
23222:14:36Knapsack report generator started!
23322:14:24/builds/gitlab-org/gitlab/vendor/ruby/3.2.0/gems/io-event-1.6.5/lib/io/event/support.rb:27: warning: IO::Buffer is experimental and both the Ruby and C interface may change in the future!
23422:15:03 ██  ██  █████  ██████  ███  ██ ██ ███  ██  ██████ 
23522:15:03 ██  ██ ██   ██ ██   ██ ████  ██ ██ ████  ██ ██      
23622:15:03 ██  █  ██ ███████ ██████  ██ ██  ██ ██ ██ ██  ██ ██  ███ 
23722:15:03 ██ ███ ██ ██   ██ ██   ██ ██  ██ ██ ██ ██  ██ ██ ██  ██ 
23822:15:03  ███ ███  ██  ██ ██  ██ ██   ████ ██ ██   ████  ██████  
23922:15:03******************************************************************************
24022:15:03 Your database has a single connection, and single connections were
24122:15:03 deprecated in GitLab 15.9 https://docs.gitlab.com/ee/update/deprecations.html#single-database-connection-is-deprecated.
24222:15:03 In GitLab 17.0 and later, you must have the two main: and ci: sections in your database.yml.
24322:15:03 Please add a :ci section to your database, following these instructions:
24422:15:03 https://docs.gitlab.com/ee/install/installation.html#configure-gitlab-db-settings.
24522:15:03******************************************************************************
24622:16:34DEPRECATION WARNING: Support for Rails versions < 7.1 is deprecated and will be removed from ViewComponent 4.0.0 (ViewComponent v4 will remove support for Rails versions < 7.1 no earlier than April 1, 2025) (called from <top (required)> at /builds/gitlab-org/gitlab/config/environment.rb:7)
24722:16:49warning: parser/current is loading parser/ruby32, which recognizes 3.2.6-compliant syntax, but you are running 3.2.5.
24822:16:49Please see https://github.com/whitequark/parser#compatibility-with-ruby-mri.
24922:17:11/builds/gitlab-org/gitlab/vendor/ruby/3.2.0/gems/io-event-1.6.5/lib/io/event/support.rb:27: warning: IO::Buffer is experimental and both the Ruby and C interface may change in the future!
25022:17:23 ██  ██  █████  ██████  ███  ██ ██ ███  ██  ██████ 
25122:17:23 ██  ██ ██   ██ ██   ██ ████  ██ ██ ████  ██ ██      
25222:17:23 ██  █  ██ ███████ ██████  ██ ██  ██ ██ ██ ██  ██ ██  ███ 
25322:17:23 ██ ███ ██ ██   ██ ██   ██ ██  ██ ██ ██ ██  ██ ██ ██  ██ 
25422:17:23  ███ ███  ██  ██ ██  ██ ██   ████ ██ ██   ████  ██████  
25522:17:23******************************************************************************
25622:17:23 Your database has a single connection, and single connections were
25722:17:23 deprecated in GitLab 15.9 https://docs.gitlab.com/ee/update/deprecations.html#single-database-connection-is-deprecated.
25822:17:23 In GitLab 17.0 and later, you must have the two main: and ci: sections in your database.yml.
25922:17:23 Please add a :ci section to your database, following these instructions:
26022:17:23 https://docs.gitlab.com/ee/install/installation.html#configure-gitlab-db-settings.
26122:17:23******************************************************************************
26222:17:34DEPRECATION WARNING: Support for Rails versions < 7.1 is deprecated and will be removed from ViewComponent 4.0.0 (ViewComponent v4 will remove support for Rails versions < 7.1 no earlier than April 1, 2025) (called from <main> at /builds/gitlab-org/gitlab/config/environment.rb:7)
26322:18:02Run options: exclude {:quarantine=>true, :zoekt=>true, :click_house=>true}
26422:18:02# [RSpecRunTime] Starting RSpec timer...
26522:18:02[TEST PROF INFO] EventProf enabled (sql.active_record)
26622:18:02unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
26722:18:11Test environment set up in 4.108101521 seconds
26822:18:12# [RSpecRunTime] Starting example group ee/spec/lib/ee/gitlab/background_migration/delete_orphaned_transferred_project_approval_rules_spec.rb. Expected to take 2 minutes 41.9 seconds.
26922:18:12Gitlab::BackgroundMigration::DeleteOrphanedTransferredProjectApprovalRules
27022:20:39 #perform
27122:21:10 delete only outdated approval project rules where report_type equals to 4 and 2
27222:21:38 enqueues a worker to sync the affected project
27322:22:12INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
27422:22:12INFO: analyzing "public.ci_pipeline_variables"
27522:22:12INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
27622:22:15INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
27722:22:15INFO: analyzing "public.ci_pipeline_variables"
27822:22:15INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
27922:22:23INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
28022:22:23INFO: analyzing "public.ci_job_artifacts"
28122:22:23INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
28222:22:27INFO: analyzing "public.p_ci_stages" inheritance tree
28322:22:27INFO: analyzing "public.ci_stages"
28422:22:27INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
28522:23:51INFO: analyzing "public.p_ci_pipelines" inheritance tree
28622:23:51INFO: analyzing "public.ci_pipelines"
28722:23:51INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
28822:24:32# [RSpecRunTime] Finishing example group ee/spec/lib/ee/gitlab/background_migration/delete_orphaned_transferred_project_approval_rules_spec.rb. It took 6 minutes 19.79 seconds. Expected to take 2 minutes 41.9 seconds.
28922:24:32# [RSpecRunTime] RSpec elapsed time: 6 minutes 29.59 seconds. Current RSS: ~1243M. Threads: 1. load average: 0.97 1.29 1.45 1/415 413
29022:24:32.
29122:24:32# [RSpecRunTime] Starting example group ee/spec/lib/ee/gitlab/background_migration/create_compliance_standards_adherence_spec.rb. Expected to take 2 minutes 29.59 seconds.
29222:24:32Gitlab::BackgroundMigration::CreateComplianceStandardsAdherence
29322:26:18 when not GitLab.com
29422:26:35 creates standards adherence for existing projects in a group
29522:26:36# [RSpecRunTime] RSpec elapsed time: 8 minutes 33.27 seconds. Current RSS: ~1246M. Threads: 1. load average: 1.14 1.25 1.41 1/415 414
29622:26:36.
29722:26:36 when GitLab.com
29822:26:52 creates standards adherence for existing ultimate projects in a group
29922:26:52# [RSpecRunTime] RSpec elapsed time: 8 minutes 50.1 seconds. Current RSS: ~1238M. Threads: 1. load average: 1.11 1.24 1.41 1/415 415
30022:26:52.
30122:27:19INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
30222:27:19INFO: analyzing "public.ci_pipeline_variables"
30322:27:19INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
30422:27:21INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
30522:27:21INFO: analyzing "public.ci_pipeline_variables"
30622:27:21INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
30722:27:26INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
30822:27:26INFO: analyzing "public.ci_job_artifacts"
30922:27:26INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
31022:27:29INFO: analyzing "public.p_ci_stages" inheritance tree
31122:27:29INFO: analyzing "public.ci_stages"
31222:27:29INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
31322:28:32INFO: analyzing "public.p_ci_pipelines" inheritance tree
31422:28:32INFO: analyzing "public.ci_pipelines"
31522:28:32INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
31622:29:07# [RSpecRunTime] Finishing example group ee/spec/lib/ee/gitlab/background_migration/create_compliance_standards_adherence_spec.rb. It took 4 minutes 35.06 seconds. Expected to take 2 minutes 29.59 seconds.
31722:29:07# [RSpecRunTime] RSpec elapsed time: 11 minutes 5.11 seconds. Current RSS: ~1256M. Threads: 1. load average: 0.99 1.14 1.34 1/416 416
31822:29:07.
31922:29:07# [RSpecRunTime] Starting example group ee/spec/lib/ee/gitlab/background_migration/migrate_vulnerabilities_feedback_to_vulnerabilities_state_transition_spec.rb. Expected to take 1 minute 59.97 seconds.
32022:29:07Gitlab::BackgroundMigration::MigrateVulnerabilitiesFeedbackToVulnerabilitiesStateTransition
32122:29:08 #perform
32222:29:08 when a Finding has no Vulnerability
32322:29:13 creates a Vulnerability from the Vulnerabilities::Finding
32422:29:18 creates a Vulnerabilities::StateTransition from the Vulnerabilities::Feedback
32522:29:18 when there was a problem saving the Vulnerability
32622:29:22 doesn't create a Vulnerability record
32722:29:27 logs an error
32822:29:27# [RSpecRunTime] RSpec elapsed time: 11 minutes 24.3 seconds. Current RSS: ~1251M. Threads: 2. load average: 0.99 1.13 1.33 1/417 418
32922:29:27.
33022:29:27 when there's only a Security::Finding
33122:29:32 creates a Vulnerability from the Security::Finding
33222:29:38 creates a Vulnerabilities::StateTransition from the Vulnerabilities::Feedback
33322:29:38 when creating any associated record fails
33422:29:43 doesn't create a Vulnerability record
33522:29:47 logs an error
33622:29:47# [RSpecRunTime] RSpec elapsed time: 11 minutes 45.12 seconds. Current RSS: ~1245M. Threads: 2. load average: 1.00 1.12 1.33 1/417 419
33722:29:47.
33822:29:47 behaves like a migration updating migrated_to_state_transition column
33922:29:52 updates the migrated_to_state_transition column
34022:29:53# [RSpecRunTime] RSpec elapsed time: 11 minutes 50.26 seconds. Current RSS: ~1246M. Threads: 2. load average: 1.00 1.12 1.32 1/417 420
34122:29:53.
34222:29:53 when a Vulnerability is dismissed
34322:29:57 creates a valid Vulnerabilities::StateTransition record for a dismissed Vulnerability
34422:29:57 when the StateTransition is invalid
34522:30:01 doesn't create a StateTransition
34622:30:06 logs an error
34722:30:06# [RSpecRunTime] RSpec elapsed time: 12 minutes 3.35 seconds. Current RSS: ~1237M. Threads: 2. load average: 1.08 1.13 1.32 1/417 421
34822:30:06.
34922:30:06 when a Vulnerability is dismissed with a comment
35022:30:10 retains the comment
35122:30:10 behaves like a migration updating migrated_to_state_transition column
35222:30:14 updates the migrated_to_state_transition column
35322:30:14# [RSpecRunTime] RSpec elapsed time: 12 minutes 12.2 seconds. Current RSS: ~1245M. Threads: 2. load average: 0.99 1.11 1.31 1/417 422
35422:30:14.
35522:30:14 when a Vulnerability is dismissed with too long comment
35622:30:19 retains strips HTML tags and truncates the comment
35722:30:19 behaves like a migration updating migrated_to_state_transition column
35822:30:23 updates the migrated_to_state_transition column
35922:30:23# [RSpecRunTime] RSpec elapsed time: 12 minutes 21.06 seconds. Current RSS: ~1245M. Threads: 2. load average: 0.99 1.10 1.31 1/417 423
36022:30:23.
36122:30:23 when a Vulnerability is dismissed with a dismissal reason
36222:30:28 retains the dismissal_reason
36322:30:28 behaves like a migration updating migrated_to_state_transition column
36422:30:32 updates the migrated_to_state_transition column
36522:30:32# [RSpecRunTime] RSpec elapsed time: 12 minutes 29.77 seconds. Current RSS: ~1243M. Threads: 2. load average: 1.07 1.12 1.31 1/417 424
36622:30:32.
36722:30:39# [RSpecRunTime] Finishing example group ee/spec/lib/ee/gitlab/background_migration/migrate_vulnerabilities_feedback_to_vulnerabilities_state_transition_spec.rb. It took 1 minute 31.27 seconds. Expected to take 1 minute 59.97 seconds.
36822:30:39# [RSpecRunTime] RSpec elapsed time: 12 minutes 36.43 seconds. Current RSS: ~1239M. Threads: 2. load average: 1.06 1.11 1.31 1/417 425
36922:30:39.
37022:30:39# [RSpecRunTime] Starting example group ee/spec/lib/ee/gitlab/background_migration/fix_corrupted_scanner_ids_of_vulnerability_reads_spec.rb. Expected to take 1 minute 11.21 seconds.
37122:30:39Gitlab::BackgroundMigration::FixCorruptedScannerIdsOfVulnerabilityReads
37222:31:35 corrects the scanner_id for the corrupted vulnerability_reads
37322:31:35 when there are records that fall outside of the migration bounds
37422:31:42 does not update those records
37522:31:42# [RSpecRunTime] RSpec elapsed time: 13 minutes 39.92 seconds. Current RSS: ~1252M. Threads: 2. load average: 1.38 1.20 1.33 1/418 426
37622:31:42.
37722:32:17INFO: analyzing "public.p_ci_pipelines" inheritance tree
37822:32:17INFO: "ci_pipelines": scanned 1 of 1 pages, containing 0 live rows and 5 dead rows; 0 rows in sample, 0 estimated total rows
37922:32:17INFO: analyzing "public.ci_pipelines"
38022:32:17INFO: "ci_pipelines": scanned 1 of 1 pages, containing 0 live rows and 5 dead rows; 0 rows in sample, 0 estimated total rows
38122:32:51# [RSpecRunTime] Finishing example group ee/spec/lib/ee/gitlab/background_migration/fix_corrupted_scanner_ids_of_vulnerability_reads_spec.rb. It took 2 minutes 12.56 seconds. Expected to take 1 minute 11.21 seconds.
38222:32:51# [RSpecRunTime] RSpec elapsed time: 14 minutes 49.04 seconds. Current RSS: ~1263M. Threads: 2. load average: 1.04 1.14 1.29 1/418 427
38322:32:51.
38422:32:51# [RSpecRunTime] Starting example group ee/spec/lib/gitlab/background_migration/create_missing_external_links_for_vulnerabilities_spec.rb. Expected to take 54.82 seconds.
38522:32:51Gitlab::BackgroundMigration::CreateMissingExternalLinksForVulnerabilities
38622:32:52 JiraIssuesFinder
38722:32:56 makes a call to the correct jira url
38822:33:01 returns payload with is_last as true if we are on the last page
38922:33:05 returns an empty payload if response is empty
39022:33:05 when calls to jira instance fail
39122:33:09 raises error if the call fails MAX_RETRIES times
39222:33:09# [RSpecRunTime] RSpec elapsed time: 15 minutes 7.2 seconds. Current RSS: ~1262M. Threads: 2. load average: 1.19 1.16 1.30 1/418 428
39322:33:09.
39422:33:09 #perform
39522:33:09 when there are missing external links
39622:33:14 creates missing external issue links
39722:33:14# [RSpecRunTime] RSpec elapsed time: 15 minutes 12.0 seconds. Current RSS: ~1270M. Threads: 2. load average: 1.10 1.14 1.29 1/418 429
39822:33:14.
39922:33:14 when there are no missing external links
40022:33:19 does not create any external issue links
40122:33:19# [RSpecRunTime] RSpec elapsed time: 15 minutes 16.64 seconds. Current RSS: ~1268M. Threads: 2. load average: 1.17 1.16 1.29 1/418 430
40222:33:19.
40322:33:19 JiraIntegration
40422:33:19 #valid?
40522:33:19 with valid jira integration and valid jira data
40622:33:23 returns true
40722:33:23# [RSpecRunTime] RSpec elapsed time: 15 minutes 21.16 seconds. Current RSS: ~1270M. Threads: 2. load average: 1.17 1.16 1.29 1/418 431
40822:33:23.
40922:33:23 with valid jira integration but invalid jira data
41022:33:28 returns false
41122:33:28# [RSpecRunTime] RSpec elapsed time: 15 minutes 25.69 seconds. Current RSS: ~1273M. Threads: 2. load average: 1.15 1.15 1.29 1/418 432
41222:33:28.
41322:33:28 with invalid jira integration
41422:33:32 returns false
41522:33:32# [RSpecRunTime] RSpec elapsed time: 15 minutes 30.14 seconds. Current RSS: ~1271M. Threads: 2. load average: 1.14 1.15 1.29 1/418 433
41622:33:32.
41722:33:39# [RSpecRunTime] Finishing example group ee/spec/lib/gitlab/background_migration/create_missing_external_links_for_vulnerabilities_spec.rb. It took 47.8 seconds. Expected to take 54.82 seconds.
41822:33:39# [RSpecRunTime] RSpec elapsed time: 15 minutes 36.88 seconds. Current RSS: ~1263M. Threads: 2. load average: 1.12 1.14 1.29 1/418 434
41922:33:39.
42022:33:39# [RSpecRunTime] Starting example group ee/spec/lib/ee/gitlab/background_migration/migrate_approver_to_approval_rules_in_batch_spec.rb. Expected to take 13.34 seconds.
42122:33:39Gitlab::BackgroundMigration::MigrateApproverToApprovalRulesInBatch
42222:33:40 when there is no more MigrateApproverToApprovalRules jobs
42322:33:51 migrates individual target
42422:33:51# [RSpecRunTime] RSpec elapsed time: 15 minutes 48.41 seconds. Current RSS: ~1320M. Threads: 4. load average: 1.10 1.14 1.28 1/431 517
42522:33:51.
42622:33:57# [RSpecRunTime] Finishing example group ee/spec/lib/ee/gitlab/background_migration/migrate_approver_to_approval_rules_in_batch_spec.rb. It took 17.85 seconds. Expected to take 13.34 seconds.
42722:33:57# [RSpecRunTime] RSpec elapsed time: 15 minutes 54.78 seconds. Current RSS: ~1246M. Threads: 4. load average: 1.09 1.14 1.28 1/431 518
42822:33:57.
42922:33:57# [RSpecRunTime] Starting example group ee/spec/lib/ee/gitlab/background_migration/fix_project_settings_has_vulnerabilities_spec.rb. Expected to take 7.2 seconds.
43022:33:57Gitlab::BackgroundMigration::FixProjectSettingsHasVulnerabilities
43122:34:02 updates project_settings#has_vulnerabilities for vulnerable projects
43222:34:08# [RSpecRunTime] Finishing example group ee/spec/lib/ee/gitlab/background_migration/fix_project_settings_has_vulnerabilities_spec.rb. It took 11.24 seconds. Expected to take 7.2 seconds.
43322:34:08# [RSpecRunTime] RSpec elapsed time: 16 minutes 6.07 seconds. Current RSS: ~1249M. Threads: 4. load average: 1.08 1.13 1.28 1/431 519
43422:34:08.
43522:34:08# [RSpecRunTime] Starting example group ee/spec/lib/ee/gitlab/background_migration/make_security_policy_bots_private_spec.rb. Expected to take 6.4 seconds.
43622:34:08Gitlab::BackgroundMigration::MakeSecurityPolicyBotsPrivate
43722:34:09 #perform
43822:34:13 updates the private_profile field for security policy bots
43922:34:13# [RSpecRunTime] RSpec elapsed time: 16 minutes 10.82 seconds. Current RSS: ~1263M. Threads: 4. load average: 1.07 1.13 1.28 1/431 520
44022:34:13.
44122:34:19# [RSpecRunTime] Finishing example group ee/spec/lib/ee/gitlab/background_migration/make_security_policy_bots_private_spec.rb. It took 11.03 seconds. Expected to take 6.4 seconds.
44222:34:19# [RSpecRunTime] RSpec elapsed time: 16 minutes 17.16 seconds. Current RSS: ~1245M. Threads: 4. load average: 1.06 1.13 1.27 1/430 521
44322:34:19.
44422:34:38auto_explain log contains 1220 entries for main, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-ee-background-migration-pg14-single-db-2-3.346.main.ndjson.gz
44522:34:38took 18.929031768
44622:34:38[TEST PROF INFO] EventProf results for sql.active_record
44722:34:38Total time: 08:21.123 of 16:07.370 (51.8%)
44822:34:38Total events: 341077
44922:34:38Top 5 slowest suites (by time):
45022:34:38Gitlab::Backg...tApprovalRules (./ee/spec/lib/ee/gitlab/background_migration/delete_orphaned_transferred_project_approval_rules_spec.rb:5) – 03:26.210 (114138 / 2) of 06:20.203 (54.24%)
45122:34:38Gitlab::Backg...dardsAdherence (./ee/spec/lib/ee/gitlab/background_migration/create_compliance_standards_adherence_spec.rb:5) – 02:42.003 (113693 / 2) of 04:35.112 (58.89%)
45222:34:38Gitlab::Backg...erabilityReads (./ee/spec/lib/ee/gitlab/background_migration/fix_corrupted_scanner_ids_of_vulnerability_reads_spec.rb:5) – 01:16.084 (51436 / 2) of 02:12.604 (57.38%)
45322:34:38Gitlab::Backg...tateTransition (./ee/spec/lib/ee/gitlab/background_migration/migrate_vulnerabilities_feedback_to_vulnerabilities_state_transition_spec.rb:9) – 00:30.360 (33073 / 18) of 01:31.317 (33.25%)
45422:34:38Gitlab::Backg...ulnerabilities (./ee/spec/lib/gitlab/background_migration/create_missing_external_links_for_vulnerabilities_spec.rb:7) – 00:15.379 (17309 / 9) of 00:47.845 (32.14%)
45522:34:38Knapsack report was generated. Preview:
45622:34:38{
45722:34:38 "ee/spec/lib/ee/gitlab/background_migration/delete_orphaned_transferred_project_approval_rules_spec.rb": 206.3466072149995,
45822:34:38 "ee/spec/lib/ee/gitlab/background_migration/create_compliance_standards_adherence_spec.rb": 140.1231203110001,
45922:34:38 "ee/spec/lib/ee/gitlab/background_migration/migrate_vulnerabilities_feedback_to_vulnerabilities_state_transition_spec.rb": 84.68276962400068,
46022:34:38 "ee/spec/lib/ee/gitlab/background_migration/fix_corrupted_scanner_ids_of_vulnerability_reads_spec.rb": 63.51791646699985,
46122:34:38 "ee/spec/lib/gitlab/background_migration/create_missing_external_links_for_vulnerabilities_spec.rb": 41.12616742699993,
46222:34:38 "ee/spec/lib/ee/gitlab/background_migration/migrate_approver_to_approval_rules_in_batch_spec.rb": 11.546913792999476,
46322:34:38 "ee/spec/lib/ee/gitlab/background_migration/fix_project_settings_has_vulnerabilities_spec.rb": 5.060414982000111,
46422:34:38 "ee/spec/lib/ee/gitlab/background_migration/make_security_policy_bots_private_spec.rb": 4.757468357999642
46522:34:38}
46622:34:38Knapsack global time execution for tests: 09m 17s
46722:34:39Finished in 16 minutes 36 seconds (files took 3 minutes 34.6 seconds to load)
46822:34:3936 examples, 0 failures
46922:34:39Randomized with seed 28353
47022:34:45[TEST PROF INFO] Time spent in factories: 00:08.137 (0.76% of total time)
47122:34:46RSpec exited with 0.
47222:34:46No examples to retry, congrats!
473 22:34:47 Running after_script 00:39
47422:34:48Running after script...
47522:34:48$ source scripts/utils.sh
47622:34:48$ log_disk_usage
47722:34:48*******************************************************
47822:34:48This runner currently has 74G free disk space.
47922:34:48*******************************************************
480 22:34:48 Disk usage detail 00:28
53622:35:16$ bundle exec gem list gitlab_quality-test_tooling
53722:35:19gitlab_quality-test_tooling (2.1.0)
53822:35:19$ section_start "failed-test-issues" "Report test failures" # collapsed multi-line command
539 22:35:19 Report test failures 00:00
54122:35:19$ section_start "flaky-test-issues" "Report test flakiness" # collapsed multi-line command
542 22:35:19 Report test flakiness 00:00
54422:35:19$ section_start "slow-test-issues" "Report test slowness" # collapsed multi-line command
545 22:35:19 Report test slowness 00:00
54722:35:19$ section_start "slow-test-merge-request-report-note" "Report test slowness in MR note" # collapsed multi-line command
548 22:35:19 Report test slowness in MR note 00:03
55122:35:22$ section_start "knapsack-report-issues" "Report test files close to timing out" # collapsed multi-line command
552 22:35:22 Report test files close to timing out 00:02
55522:35:24$ tooling/bin/push_job_metrics || true
55622:35:26[job-metrics] Pushing job metrics file for the CI/CD job.
55722:35:26[job-metrics] Pushed 4 CI job metric entries to InfluxDB.
558 22:35:26 Saving cache for successful job 00:01
55922:35:27Not uploading cache ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20 due to policy
560 22:35:27 Uploading artifacts for successful job 00:08
56122:35:30Uploading artifacts...
56222:35:30auto_explain/: found 2 matching artifact files and directories
56322:35:30coverage/: found 5 matching artifact files and directories
56422:35:30crystalball/: found 2 matching artifact files and directories
56522:35:30WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
56622:35:30knapsack/: found 4 matching artifact files and directories
56722:35:30rspec/: found 16 matching artifact files and directories
56822:35:30WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
56922:35:30log/*.log: found 13 matching artifact files and directories
57022:35:30WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8353288381/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
57122:35:30WARNING: Retrying... context=artifacts-uploader error=request redirected
57222:35:33Uploading artifacts as "archive" to coordinator... 201 Created id=8353288381 responseStatus=201 Created token=glcbt-66
57322:35:33Uploading artifacts...
57422:35:33rspec/rspec-*.xml: found 1 matching artifact files and directories
57522:35:33WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8353288381/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
57622:35:33WARNING: Retrying... context=artifacts-uploader error=request redirected
57722:35:35Uploading artifacts as "junit" to coordinator... 201 Created id=8353288381 responseStatus=201 Created token=glcbt-66
578 22:35:35 Cleaning up project directory and file based variables 00:01
57922:35:48Job succeeded