Skip to content
Snippets Groups Projects

rspec background_migration pg14 single-db 14/17

Passed Started by
Simon Tomlinson
@stomlinson
Log timestamps in UTC.
122:06:53Running with gitlab-runner 17.4.0~pre.110.g27400594 (27400594)
222:06:53 on blue-2.private.runners-manager.gitlab.com/gitlab.com/gitlab-org QvBVRoXM, system ID: s_49b872f8ccf6
322:06:53 feature flags: FF_NETWORK_PER_BUILD:true, FF_TIMESTAMPS:true
422:06:53Resolving secrets
5 22:06:53 Preparing the "docker+machine" executor 00:10
622:06:53Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
722:06:55Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1...
822:06:56Authenticating with credentials from job payload (GitLab Registry)
922:06:56Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
1022:06:56Using docker image sha256:82f132c22567f8ce17cc132c14b2f9aa3eaf9bb5424d91c2d966912433f0257d for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:c55e1364ee4327b244a9cfa1750f19feea14fc774eaf792b725967d146eb45f5 ...
1122:06:57WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1222:06:57WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1322:06:57Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12...
1422:06:57Authenticating with credentials from job payload (GitLab Registry)
1522:06:57Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
1622:06:57Using docker image sha256:5c5ba5b83d6c60cb0b225bd670b7a43be8c238cc72347d24af57e5027c3648f3 for registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:46aceab84c42d0e819c8e7940f2f98ce9e184785cd7b22d95872024a35f52407 ...
1722:06:58Starting service redis:6.2-alpine...
1822:06:58Pulling docker image redis:6.2-alpine ...
1922:06:59Using docker image sha256:4100b5bd17430263e85ad9d8ab851959b234acaaf378e093f1f98400f4998815 for redis:6.2-alpine with digest redis@sha256:eaba718fecd1196d88533de7ba49bf903ad33664a92debb24660a922ecd9cac8 ...
2022:06:59Waiting for services to be up and running (timeout 30 seconds)...
2122:07:03Authenticating with credentials from job payload (GitLab Registry)
2222:07:03Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
2322:07:03Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
24 22:07:03 Preparing environment 00:01
2522:07:03Running on runner-qvbvroxm-project-278964-concurrent-0 via runner-qvbvroxm-private-1731529166-8ed98eee...
26 22:07:04 Getting source from Git repository 00:00
2722:07:04Skipping Git repository setup
2822:07:04Skipping Git checkout
2922:07:04Skipping Git submodules setup
30 22:07:04 Restoring cache 00:18
3122:07:05Checking cache for ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20...
3222:07:05cache.zip is up to date
3322:07:16Successfully extracted cache
34 22:07:22 Downloading artifacts 00:45
3522:07:23Downloading artifacts for clone-gitlab-repo (8353286583)...
3622:07:27Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286583 responseStatus=200 OK token=glcbt-66
3722:07:28WARNING: Part of .git directory is on the list of files to extract
3822:07:28WARNING: This may introduce unexpected problems
3922:07:40Downloading artifacts for compile-test-assets (8353286630)...
4022:07:43Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286630 responseStatus=200 OK token=glcbt-66
4122:07:49Downloading artifacts for detect-tests (8353286649)...
4222:07:50Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286649 responseStatus=200 OK token=glcbt-66
4322:07:50Downloading artifacts for retrieve-tests-metadata (8353286664)...
4422:07:50Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286664 responseStatus=200 OK token=glcbt-66
4522:07:50Downloading artifacts for setup-test-env (8353286635)...
4622:07:55Downloading artifacts from coordinator... ok host=storage.googleapis.com id=8353286635 responseStatus=200 OK token=glcbt-66
47 22:08:07 Executing "step_script" stage of the job script
4822:08:07Using docker image sha256:e83f017c5ffd177beb4bc3b4bfabde989d741e04fef90cd764896cf9b670552f for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14:rubygems-3.5-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.5-golang-1.23-rust-1.73-node-20.12-postgresql-14@sha256:770feb0a974e36f8b83d22a3cb18310d0cfeae11e02f6195b1577c73ce26b398 ...
4922:08:08$ echo $FOSS_ONLY
5022:08:08$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
5122:08:08$ export GOPATH=$CI_PROJECT_DIR/.go
5222:08:08$ mkdir -p $GOPATH
5322:08:08$ source scripts/utils.sh
5422:08:08$ log_disk_usage "true"
5522:08:08*******************************************************
5622:08:08This runner currently has 77G free disk space.
5722:08:08*******************************************************
58 22:08:08 Disk usage detail 00:05
5922:08:08df -h
6022:08:08Filesystem Size Used Avail Use% Mounted on
6122:08:08overlay 95G 19G 77G 20% /
6222:08:08tmpfs 64M 0 64M 0% /dev
6322:08:08shm 64M 0 64M 0% /dev/shm
6422:08:08/dev/sda1 95G 19G 77G 20% /cache
6522:08:08tmpfs 3.9G 0 3.9G 0% /sys/devices/virtual/dmi/id
6622:08:08du -h -d 1
6722:08:087.4M ./workhorse
6822:08:08148K ./bin
6922:08:081.2M ./.gitlab
7022:08:08167M ./.git
7122:08:084.0K ./builds
7222:08:0828M ./lib
7322:08:088.0K ./.vscode
7422:08:08560K ./storybook
7522:08:0824K ./log
7622:08:081.8M ./data
7722:08:0811M ./qa
7822:08:083.2M ./.rubocop_todo
7922:08:08856M ./vendor
8022:08:081023M ./public
8122:08:0862M ./doc
8222:08:08484K ./danger
8322:08:0832K ./rspec
8422:08:08556K ./tooling
8522:08:08145M ./ee
8622:08:081.3M ./knapsack
8722:08:08300K ./patches
8822:08:084.3M ./changelogs
8922:08:0820K ./haml_lint
9022:08:0828K ./metrics_server
9122:08:08108K ./keeps
9222:08:0836K ./shared
9322:08:0844K ./generator_templates
9422:08:081.3M ./scripts
9522:08:08763M ./tmp
9622:08:08127M ./spec
9722:08:0820K ./file_hooks
9822:08:0832K ./crystalball
9922:08:0816K ./sidekiq_cluster
10022:08:0817M ./gems
10122:08:081.2M ./fixtures
10222:08:08964K ./rubocop
10322:08:084.0K ./.go
10422:08:0833M ./db
10522:08:0812K ./.github
10622:08:08129M ./locale
10722:08:0820M ./config
10822:08:0882M ./app
10922:08:0820K ./.lefthook
11022:08:083.5G .
11122:08:08$ source scripts/prepare_build.sh
112 22:08:08 Installing gems 00:22
14322:08:30Using two connections, single database config (config/database.yml.postgresql)
14422:08:30Disabling ci connection in config/database.yml
14522:08:30Geo DB won't be set up.
14622:08:30Embedding DB won't be set up.
147 22:08:30 Setting up DBs 00:51
17222:09:21$ source ./scripts/rspec_helpers.sh
17322:09:21$ run_timed_command "gem install knapsack --no-document"
17422:09:21$ gem install knapsack --no-document
17522:09:22Successfully installed knapsack-4.0.0
17622:09:221 gem installed
17722:09:21==> 'gem install knapsack --no-document' succeeded in 1 seconds.
17822:09:22$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"
179 22:09:22 Spawning Gitaly 00:04
18322:09:26$ export RSPEC_SKIPPED_TESTS_REPORT_PATH="rspec/skipped_tests-${CI_JOB_ID}.txt"
18422:09:26$ export RSPEC_RETRIED_TESTS_REPORT_PATH="rspec/retried_tests-${CI_JOB_ID}.txt"
18522:09:26$ tooling/bin/create_job_metrics_file || true
18622:09:28[job-metrics] Creating the job metrics file for the CI/CD job.
18722:09:28$ rspec_section rspec_parallelized_job "--fail-fast=${RSPEC_FAIL_FAST_THRESHOLD} --tag ~quarantine --tag ~zoekt --tag ~click_house"
188 22:09:28 RSpec 25:38
18922:09:28[22:09:28] Starting rspec_parallelized_job
19022:09:22RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
19122:09:29KNAPSACK_GENERATE_REPORT: true
19222:09:29FLAKY_RSPEC_GENERATE_REPORT: true
19322:09:29KNAPSACK_TEST_FILE_PATTERN: spec/{lib/gitlab/background_migration,lib/ee/gitlab/background_migration}{,/**/}*_spec.rb
19422:09:29KNAPSACK_LOG_LEVEL: debug
19522:09:29KNAPSACK_REPORT_PATH: knapsack/rspec_background_migration_pg14_single-db_14_17_278964_report.json
19622:09:29FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
19722:09:29FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec_background_migration_pg14_single-db_14_17_278964_report.json
19822:09:29NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec_background_migration_pg14_single-db_14_17_278964_report.json
19922:09:29RSPEC_SKIPPED_TESTS_REPORT_PATH: rspec/skipped_tests-8353287241.txt
20022:09:29CRYSTALBALL:
20122:09:29RSPEC_TESTS_MAPPING_ENABLED:
20222:09:29RSPEC_TESTS_FILTER_FILE:
20322:09:29Shell set options (set -o) enabled:
20422:09:29braceexpand on
20522:09:29hashall on
20622:09:29interactive-comments on
20722:09:29pipefail on
20822:09:35Knapsack report generator started!
20922:09:29/builds/gitlab-org/gitlab/vendor/ruby/3.2.0/gems/io-event-1.6.5/lib/io/event/support.rb:27: warning: IO::Buffer is experimental and both the Ruby and C interface may change in the future!
21022:09:43 ██  ██  █████  ██████  ███  ██ ██ ███  ██  ██████ 
21122:09:43 ██  ██ ██   ██ ██   ██ ████  ██ ██ ████  ██ ██      
21222:09:43 ██  █  ██ ███████ ██████  ██ ██  ██ ██ ██ ██  ██ ██  ███ 
21322:09:43 ██ ███ ██ ██   ██ ██   ██ ██  ██ ██ ██ ██  ██ ██ ██  ██ 
21422:09:43  ███ ███  ██  ██ ██  ██ ██   ████ ██ ██   ████  ██████  
21522:09:43******************************************************************************
21622:09:43 Your database has a single connection, and single connections were
21722:09:43 deprecated in GitLab 15.9 https://docs.gitlab.com/ee/update/deprecations.html#single-database-connection-is-deprecated.
21822:09:43 In GitLab 17.0 and later, you must have the two main: and ci: sections in your database.yml.
21922:09:43 Please add a :ci section to your database, following these instructions:
22022:09:43 https://docs.gitlab.com/ee/install/installation.html#configure-gitlab-db-settings.
22122:09:43******************************************************************************
22222:10:12DEPRECATION WARNING: Support for Rails versions < 7.1 is deprecated and will be removed from ViewComponent 4.0.0 (ViewComponent v4 will remove support for Rails versions < 7.1 no earlier than April 1, 2025) (called from <top (required)> at /builds/gitlab-org/gitlab/config/environment.rb:7)
22322:10:23warning: parser/current is loading parser/ruby32, which recognizes 3.2.6-compliant syntax, but you are running 3.2.5.
22422:10:23Please see https://github.com/whitequark/parser#compatibility-with-ruby-mri.
22522:10:27Run options: exclude {:quarantine=>true, :zoekt=>true, :click_house=>true}
22622:10:27# [RSpecRunTime] Starting RSpec timer...
22722:10:27[TEST PROF INFO] EventProf enabled (sql.active_record)
22822:10:27unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
22922:10:31Test environment set up in 0.870714784 seconds
23022:10:32# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/set_legacy_open_source_license_available_for_non_public_projects_spec.rb. Expected to take 2 minutes 16.5 seconds.
23122:10:32Gitlab::BackgroundMigration::SetLegacyOpenSourceLicenseAvailableForNonPublicProjects
23222:12:29 sets `legacy_open_source_license_available` attribute to false for non-public projects
23322:12:53INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
23422:12:53INFO: analyzing "public.ci_pipeline_variables"
23522:12:53INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
23622:12:55INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
23722:12:55INFO: analyzing "public.ci_pipeline_variables"
23822:12:55INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
23922:12:59INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
24022:12:59INFO: analyzing "public.ci_job_artifacts"
24122:12:59INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
24222:13:03INFO: analyzing "public.p_ci_stages" inheritance tree
24322:13:03INFO: analyzing "public.ci_stages"
24422:13:03INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
24522:13:58INFO: analyzing "public.p_ci_pipelines" inheritance tree
24622:13:58INFO: analyzing "public.ci_pipelines"
24722:13:58INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
24822:14:29# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/set_legacy_open_source_license_available_for_non_public_projects_spec.rb. It took 3 minutes 56.76 seconds. Expected to take 2 minutes 16.5 seconds.
24922:14:29# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/resolve_vulnerabilities_for_removed_analyzers_spec.rb. Expected to take 2 minutes 6.03 seconds.
25022:14:29Gitlab::BackgroundMigration::ResolveVulnerabilitiesForRemovedAnalyzers
25122:14:32 #perform
25222:14:32 for vulnerability resolution
25322:14:38 resolves vulnerabilities and vulnerability_reads for removed scanners
25422:14:44 does not resolve vulnerabilities or vulnerability_reads for active scanners
25522:14:44 when the sub_batch size is 1
25622:14:49 does not raise an exception
25722:14:49# [RSpecRunTime] RSpec elapsed time: 4 minutes 22.57 seconds. Current RSS: ~1248M. Threads: 1. load average: 1.06 1.17 1.40 1/280 390
25822:14:49.
25922:14:49 for vulnerability state transitions
26022:14:55 creates vulnerability state transitions for the resolved vulnerabilities
26122:14:55# [RSpecRunTime] RSpec elapsed time: 4 minutes 28.17 seconds. Current RSS: ~1249M. Threads: 1. load average: 0.97 1.15 1.39 1/280 391
26222:14:55.
26322:14:55 for system notes
26422:15:00 creates system notes for the resolved vulnerabilities
26522:15:06 creates system note metadata for the resolved vulnerabilities
26622:15:06# [RSpecRunTime] RSpec elapsed time: 4 minutes 39.28 seconds. Current RSS: ~1262M. Threads: 1. load average: 0.97 1.14 1.38 1/280 392
26722:15:06.
26822:15:06 for vulnerability_read dismissal_reason
26922:15:12 nullifies the dismissal_reason of vulnerability_reads for removed scanners
27022:15:17 does not alter the dismissal_reason of vulnerability_reads for active scanners
27122:15:17# [RSpecRunTime] RSpec elapsed time: 4 minutes 50.47 seconds. Current RSS: ~1262M. Threads: 1. load average: 0.97 1.14 1.38 1/280 393
27222:15:17.
27322:15:17 for vulnerability_statistics
27422:15:17 when there are no vulnerability_statistics records
27522:15:24 does not create a vulnerability_statistics record
27622:15:24# [RSpecRunTime] RSpec elapsed time: 4 minutes 57.11 seconds. Current RSS: ~1260M. Threads: 1. load average: 0.98 1.14 1.38 1/280 394
27722:15:24.
27822:15:24 when there are vulnerability_statistics records
27922:15:29 subtracts the number of resolved vulnerabilities from the total number of vulnerabilities
28022:15:35 subtracts the num of resolved vulnerabilities from the num of vulnerabilities for the severity level
28122:15:40 adjusts the letter_grade to reflect the current vulnerabilities
28222:15:40 and the vulnerabilities to remove all belong to the same project
28322:15:47 updates the vulnerability_statistics table in a single operation
28422:15:47# [RSpecRunTime] RSpec elapsed time: 5 minutes 19.87 seconds. Current RSS: ~1248M. Threads: 1. load average: 0.99 1.12 1.36 1/280 395
28522:15:47.
28622:15:47 and the vulnerabilities to remove all belong to different projects
28722:15:54 updates the vulnerability_statistics table in a separate operation for each project
28822:15:54# [RSpecRunTime] RSpec elapsed time: 5 minutes 27.13 seconds. Current RSS: ~1249M. Threads: 1. load average: 0.99 1.12 1.36 1/280 396
28922:15:54.
29022:15:54 for vulnerability_feedback
29122:15:59 deletes dismissed vulnerability_feedback for removed scanners
29222:15:59# [RSpecRunTime] RSpec elapsed time: 5 minutes 32.68 seconds. Current RSS: ~1260M. Threads: 1. load average: 0.99 1.12 1.36 1/280 397
29322:15:59.
29422:16:09# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/resolve_vulnerabilities_for_removed_analyzers_spec.rb. It took 1 minute 40.6 seconds. Expected to take 2 minutes 6.03 seconds.
29522:16:09# [RSpecRunTime] RSpec elapsed time: 5 minutes 42.54 seconds. Current RSS: ~1256M. Threads: 1. load average: 0.99 1.11 1.35 1/280 398
29622:16:09.
29722:16:09# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_catalog_resource_versions_released_at_spec.rb. Expected to take 1 minute 41.34 seconds.
29822:16:09Gitlab::BackgroundMigration::BackfillCatalogResourceVersionsReleasedAt
29922:17:37 updates catalog_resource_versions.released_at with the corresponding value from releases.released_at
30022:17:42INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
30122:17:42INFO: analyzing "public.ci_job_artifacts"
30222:17:42INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
30322:17:46INFO: analyzing "public.p_ci_stages" inheritance tree
30422:17:46INFO: analyzing "public.ci_stages"
30522:17:46INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
30622:18:43INFO: analyzing "public.p_ci_pipelines" inheritance tree
30722:18:43INFO: analyzing "public.ci_pipelines"
30822:18:43INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
30922:19:15# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_catalog_resource_versions_released_at_spec.rb. It took 3 minutes 6.02 seconds. Expected to take 1 minute 41.34 seconds.
31022:19:15# [RSpecRunTime] RSpec elapsed time: 8 minutes 48.6 seconds. Current RSS: ~1282M. Threads: 1. load average: 1.10 1.09 1.30 1/280 399
31122:19:15.
31222:19:15# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_epic_issues_into_work_item_parent_links_spec.rb. Expected to take 1 minute 26.67 seconds.
31322:19:15Gitlab::BackgroundMigration::BackfillEpicIssuesIntoWorkItemParentLinks
31422:19:54 when epic_issues table is used to go through all records
31522:19:54 when no group id is provided
31622:19:59 backfills all records
31722:20:05 upserts records if any of them already exist
31822:20:05# [RSpecRunTime] RSpec elapsed time: 9 minutes 38.32 seconds. Current RSS: ~1243M. Threads: 1. load average: 1.01 1.08 1.28 1/280 400
31922:20:05.
32022:20:05 when a group id is provided
32122:20:11 raises an error
32222:20:11# [RSpecRunTime] RSpec elapsed time: 9 minutes 43.97 seconds. Current RSS: ~1236M. Threads: 1. load average: 1.01 1.07 1.28 1/280 401
32322:20:11.
32422:20:11 when epics table is used to go through all records
32522:20:11 when a group id is provided
32622:20:17 backfills records only for the specified group
32722:20:17# [RSpecRunTime] RSpec elapsed time: 9 minutes 49.87 seconds. Current RSS: ~1236M. Threads: 1. load average: 1.01 1.07 1.28 1/280 402
32822:20:17.
32922:20:17 when no group_id is provided
33022:20:22 raises an error
33122:20:22# [RSpecRunTime] RSpec elapsed time: 9 minutes 55.49 seconds. Current RSS: ~1237M. Threads: 1. load average: 1.00 1.07 1.27 1/280 403
33222:20:22.
33322:20:22 when batch column is not iid
33422:20:28 raises an error
33522:20:28# [RSpecRunTime] RSpec elapsed time: 10 minutes 1.13 seconds. Current RSS: ~1237M. Threads: 1. load average: 1.00 1.07 1.27 1/280 404
33622:20:28.
33722:20:46INFO: analyzing "public.p_ci_pipelines" inheritance tree
33822:20:46INFO: analyzing "public.ci_pipelines"
33922:20:46INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
34022:21:16# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_epic_issues_into_work_item_parent_links_spec.rb. It took 2 minutes 0.75 second. Expected to take 1 minute 26.67 seconds.
34122:21:16# [RSpecRunTime] RSpec elapsed time: 10 minutes 49.4 seconds. Current RSS: ~1263M. Threads: 1. load average: 1.02 1.06 1.26 1/281 405
34222:21:16.
34322:21:16# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_agent_activity_events_agent_project_id_spec.rb. Expected to take 1 minute 14.07 seconds.
34422:21:16Gitlab::BackgroundMigration::BackfillAgentActivityEventsAgentProjectId
34522:22:14 performs without error
34622:22:21 constructs a valid query
34722:22:56INFO: analyzing "public.p_ci_pipelines" inheritance tree
34822:22:56INFO: analyzing "public.ci_pipelines"
34922:22:56INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
35022:23:27# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_agent_activity_events_agent_project_id_spec.rb. It took 2 minutes 10.63 seconds. Expected to take 1 minute 14.07 seconds.
35122:23:27# [RSpecRunTime] RSpec elapsed time: 13 minutes 0.08 second. Current RSS: ~1272M. Threads: 1. load average: 1.11 1.12 1.25 1/281 406
35222:23:27.
35322:23:27# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_issue_links_namespace_id_spec.rb. Expected to take 1 minute 9.48 seconds.
35422:23:27Gitlab::BackgroundMigration::BackfillIssueLinksNamespaceId
35522:24:25 constructs a valid query
35622:24:32 performs without error
35722:25:05INFO: analyzing "public.p_ci_pipelines" inheritance tree
35822:25:05INFO: analyzing "public.ci_pipelines"
35922:25:05INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
36022:25:36# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_issue_links_namespace_id_spec.rb. It took 2 minutes 9.61 seconds. Expected to take 1 minute 9.48 seconds.
36122:25:36# [RSpecRunTime] RSpec elapsed time: 15 minutes 9.74 seconds. Current RSS: ~1273M. Threads: 1. load average: 1.14 1.17 1.26 1/280 407
36222:25:36.
36322:25:36# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_catalog_resource_version_sem_ver_spec.rb. Expected to take 58.84 seconds.
36422:25:36Gitlab::BackgroundMigration::BackfillCatalogResourceVersionSemVer
36522:26:29 updates the semver columns with the expected values
36622:27:00INFO: analyzing "public.p_ci_pipelines" inheritance tree
36722:27:00INFO: analyzing "public.ci_pipelines"
36822:27:00INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
36922:27:31# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_catalog_resource_version_sem_ver_spec.rb. It took 1 minute 54.08 seconds. Expected to take 58.84 seconds.
37022:27:31# [RSpecRunTime] RSpec elapsed time: 17 minutes 3.88 seconds. Current RSS: ~1273M. Threads: 1. load average: 0.90 1.08 1.22 1/280 408
37122:27:31.
37222:27:31# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_protected_tag_create_access_levels_project_id_spec.rb. Expected to take 57.32 seconds.
37322:27:31Gitlab::BackgroundMigration::BackfillProtectedTagCreateAccessLevelsProjectId
37422:28:17 performs without error
37522:28:22 constructs a valid query
37622:28:46INFO: analyzing "public.p_ci_pipelines" inheritance tree
37722:28:46INFO: analyzing "public.ci_pipelines"
37822:28:46INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
37922:29:17# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_protected_tag_create_access_levels_project_id_spec.rb. It took 1 minute 46.02 seconds. Expected to take 57.32 seconds.
38022:29:17# [RSpecRunTime] RSpec elapsed time: 18 minutes 49.95 seconds. Current RSS: ~1269M. Threads: 1. load average: 1.28 1.15 1.22 1/280 409
38122:29:17.
38222:29:17# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/resync_basic_epic_fields_to_work_item_spec.rb. Expected to take 47.51 seconds.
38322:29:17Gitlab::BackgroundMigration::ResyncBasicEpicFieldsToWorkItem
38422:29:54 when backfilling all epics
38522:30:00 backfills the work items for specific group only
38622:30:00# [RSpecRunTime] RSpec elapsed time: 19 minutes 33.42 seconds. Current RSS: ~1264M. Threads: 1. load average: 1.25 1.16 1.22 1/280 410
38722:30:00.
38822:30:18INFO: analyzing "public.p_ci_pipelines" inheritance tree
38922:30:18INFO: analyzing "public.ci_pipelines"
39022:30:18INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
39122:30:48# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/resync_basic_epic_fields_to_work_item_spec.rb. It took 1 minute 31.44 seconds. Expected to take 47.51 seconds.
39222:30:48# [RSpecRunTime] RSpec elapsed time: 20 minutes 21.44 seconds. Current RSS: ~1263M. Threads: 1. load average: 1.08 1.12 1.20 1/280 411
39322:30:48.
39422:30:48# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_ml_candidate_metrics_project_id_spec.rb. Expected to take 40.07 seconds.
39522:30:48Gitlab::BackgroundMigration::BackfillMlCandidateMetricsProjectId
39622:31:19 performs without error
39722:31:23 constructs a valid query
39822:31:28INFO: analyzing "public.p_ci_pipelines" inheritance tree
39922:31:28INFO: analyzing "public.ci_pipelines"
40022:31:28INFO: "ci_pipelines": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
40122:31:58# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_ml_candidate_metrics_project_id_spec.rb. It took 1 minute 9.84 seconds. Expected to take 40.07 seconds.
40222:31:58# [RSpecRunTime] RSpec elapsed time: 21 minutes 31.33 seconds. Current RSS: ~1263M. Threads: 1. load average: 0.89 1.06 1.17 1/280 412
40322:31:58.
40422:31:58# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_identifier_names_of_vulnerability_reads_spec.rb. Expected to take 25.12 seconds.
40522:31:58Gitlab::BackgroundMigration::BackfillIdentifierNamesOfVulnerabilityReads
40622:31:59 #perform
40722:31:59 with vulnerability data
40822:32:03 updates identifier_names for vulnerability_reads
40922:32:07 updates identifier_names with correct aggregation
41022:32:11 sorts identifier_names
41122:32:11# [RSpecRunTime] RSpec elapsed time: 21 minutes 44.47 seconds. Current RSS: ~1251M. Threads: 1. load average: 0.92 1.06 1.17 1/280 413
41222:32:11.
41322:32:11 with no matching identifiers
41422:32:15 does not update identifier_names
41522:32:15# [RSpecRunTime] RSpec elapsed time: 21 minutes 48.66 seconds. Current RSS: ~1250M. Threads: 1. load average: 0.92 1.06 1.17 1/280 414
41622:32:15.
41722:32:20# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_identifier_names_of_vulnerability_reads_spec.rb. It took 22.15 seconds. Expected to take 25.12 seconds.
41822:32:20# [RSpecRunTime] RSpec elapsed time: 21 minutes 53.53 seconds. Current RSS: ~1247M. Threads: 1. load average: 0.85 1.04 1.16 1/280 415
41922:32:20.
42022:32:20# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/migrate_os_sbom_occurrences_to_components_without_prefix_spec.rb. Expected to take 17.96 seconds.
42122:32:20Gitlab::BackgroundMigration::MigrateOsSbomOccurrencesToComponentsWithoutPrefix
42222:32:21 when sbom occurrence belongs to sbom component with os prefix
42322:32:25 migrates the data correctly
42422:32:25 when components have no versions
42522:32:29 does not raise error
42622:32:29# [RSpecRunTime] RSpec elapsed time: 22 minutes 2.36 seconds. Current RSS: ~1253M. Threads: 1. load average: 0.87 1.04 1.16 1/280 416
42722:32:29.
42822:32:29 when components have no occurrences
42922:32:33 does not raise an error
43022:32:33# [RSpecRunTime] RSpec elapsed time: 22 minutes 6.14 seconds. Current RSS: ~1252M. Threads: 1. load average: 0.87 1.04 1.16 1/280 417
43122:32:33.
43222:32:38# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/migrate_os_sbom_occurrences_to_components_without_prefix_spec.rb. It took 17.48 seconds. Expected to take 17.96 seconds.
43322:32:38# [RSpecRunTime] RSpec elapsed time: 22 minutes 11.05 seconds. Current RSS: ~1250M. Threads: 1. load average: 0.88 1.04 1.16 1/280 418
43422:32:38.
43522:32:38# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_ci_runners_partitioned_table_spec.rb. Expected to take 13.66 seconds.
43622:32:38Gitlab::BackgroundMigration::BackfillCiRunnersPartitionedTable
43722:32:40 #perform
43822:32:44 backfills with valid runners
43922:32:44# [RSpecRunTime] RSpec elapsed time: 22 minutes 17.37 seconds. Current RSS: ~1267M. Threads: 1. load average: 0.90 1.04 1.16 1/280 419
44022:32:44.
44122:32:52# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_ci_runners_partitioned_table_spec.rb. It took 14.36 seconds. Expected to take 13.66 seconds.
44222:32:52# [RSpecRunTime] RSpec elapsed time: 22 minutes 25.46 seconds. Current RSS: ~1256M. Threads: 1. load average: 0.83 1.02 1.15 1/280 420
44322:32:52.
44422:32:52# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/mark_duplicate_issuable_resource_links_spec.rb. Expected to take 6.82 seconds.
44522:32:52Gitlab::BackgroundMigration::MarkDuplicateIssuableResourceLinks
44622:32:57 marks single issuable links as unique
44722:33:02# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/mark_duplicate_issuable_resource_links_spec.rb. It took 9.93 seconds. Expected to take 6.82 seconds.
44822:33:02# [RSpecRunTime] RSpec elapsed time: 22 minutes 35.43 seconds. Current RSS: ~1257M. Threads: 1. load average: 0.86 1.02 1.15 1/280 421
44922:33:02.
45022:33:02# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/batching_strategies/base_strategy_spec.rb. Expected to take 6.23 seconds.
45122:33:02Gitlab::BackgroundMigration::BatchingStrategies::BaseStrategy#next_batch
45222:33:03 #next_batch
45322:33:06 raises an error if not overridden by a subclass
45422:33:06# [RSpecRunTime] RSpec elapsed time: 22 minutes 39.78 seconds. Current RSS: ~1264M. Threads: 1. load average: 0.87 1.02 1.15 1/280 422
45522:33:06.
45622:33:11# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/batching_strategies/base_strategy_spec.rb. It took 9.24 seconds. Expected to take 6.23 seconds.
45722:33:11# [RSpecRunTime] RSpec elapsed time: 22 minutes 44.72 seconds. Current RSS: ~1260M. Threads: 1. load average: 0.88 1.02 1.15 1/280 423
45822:33:11.
45922:33:39auto_explain log contains 1200 entries for main, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-background-migration-pg14-single-db-14-17.344.main.ndjson.gz
46022:33:39took 27.641741248
46122:33:39[TEST PROF INFO] EventProf results for sql.active_record
46222:33:39Total time: 12:46.615 of 22:39.582 (56.39%)
46322:33:39Total events: 582888
46422:33:39Top 5 slowest suites (by time):
46522:33:39Gitlab::Backg...PublicProjects (./spec/lib/gitlab/background_migration/set_legacy_open_source_license_available_for_non_public_projects_spec.rb:5) – 02:27.114 (112228 / 1) of 03:56.758 (62.14%)
46622:33:39Gitlab::Backg...ionsReleasedAt (./spec/lib/gitlab/background_migration/backfill_catalog_resource_versions_released_at_spec.rb:5) – 01:56.729 (89968 / 1) of 03:06.064 (62.74%)
46722:33:39Gitlab::Backg...AgentProjectId (./spec/lib/gitlab/background_migration/backfill_agent_activity_events_agent_project_id_spec.rb:5) – 01:16.617 (54716 / 2) of 02:10.680 (58.63%)
46822:33:39Gitlab::Backg...nksNamespaceId (./spec/lib/gitlab/background_migration/backfill_issue_links_namespace_id_spec.rb:5) – 01:16.238 (53573 / 2) of 02:09.664 (58.8%)
46922:33:39Gitlab::Backg...eVersionSemVer (./spec/lib/gitlab/background_migration/backfill_catalog_resource_version_sem_ver_spec.rb:5) – 01:08.950 (49306 / 1) of 01:54.134 (60.41%)
47022:33:39Knapsack report was generated. Preview:
47122:33:39{
47222:33:39 "spec/lib/gitlab/background_migration/set_legacy_open_source_license_available_for_non_public_projects_spec.rb": 117.48950426099964,
47322:33:39 "spec/lib/gitlab/background_migration/resolve_vulnerabilities_for_removed_analyzers_spec.rb": 90.80276992600011,
47422:33:39 "spec/lib/gitlab/background_migration/backfill_catalog_resource_versions_released_at_spec.rb": 87.95632303300044,
47522:33:39 "spec/lib/gitlab/background_migration/backfill_epic_issues_into_work_item_parent_links_spec.rb": 72.54668400799983,
47622:33:39 "spec/lib/gitlab/background_migration/backfill_agent_activity_events_agent_project_id_spec.rb": 65.30846388000009,
47722:33:39 "spec/lib/gitlab/background_migration/backfill_issue_links_namespace_id_spec.rb": 64.9921034150002,
47822:33:39 "spec/lib/gitlab/background_migration/backfill_catalog_resource_version_sem_ver_spec.rb": 52.327697449999505,
47922:33:39 "spec/lib/gitlab/background_migration/backfill_protected_tag_create_access_levels_project_id_spec.rb": 51.720495575000314,
48022:33:39 "spec/lib/gitlab/background_migration/resync_basic_epic_fields_to_work_item_spec.rb": 43.482558513000185,
48122:33:39 "spec/lib/gitlab/background_migration/backfill_ml_candidate_metrics_project_id_spec.rb": 34.40019028400002,
48222:33:39 "spec/lib/gitlab/background_migration/backfill_identifier_names_of_vulnerability_reads_spec.rb": 17.345467861000543,
48322:33:39 "spec/lib/gitlab/background_migration/migrate_os_sbom_occurrences_to_components_without_prefix_spec.rb": 12.634120379000706,
48422:33:39 "spec/lib/gitlab/background_migration/backfill_ci_runners_partitioned_table_spec.rb": 6.34178049699949,
48522:33:39 "spec/lib/gitlab/background_migration/mark_duplicate_issuable_resource_links_spec.rb": 5.117618960999607,
48622:33:39 "spec/lib/gitlab/background_migration/batching_strategies/base_strategy_spec.rb": 4.371365347999927
48722:33:39}
48822:33:39Knapsack global time execution for tests: 12m 06s
48922:33:39Finished in 23 minutes 12 seconds (files took 55.13 seconds to load)
49022:33:3943 examples, 0 failures
49122:33:39Randomized with seed 17153
49222:33:44[TEST PROF INFO] Time spent in factories: 00:00.280 (0.02% of total time)
49322:33:45RSpec exited with 0.
49422:33:45No examples to retry, congrats!
495 22:33:45 Running after_script 00:12
49622:33:46Running after script...
49722:33:46$ source scripts/utils.sh
49822:33:46$ log_disk_usage
49922:33:46*******************************************************
50022:33:46This runner currently has 75G free disk space.
50122:33:46*******************************************************
502 22:33:46 Disk usage detail 00:05
55822:33:51$ bundle exec gem list gitlab_quality-test_tooling
55922:33:52gitlab_quality-test_tooling (2.1.0)
56022:33:52$ section_start "failed-test-issues" "Report test failures" # collapsed multi-line command
561 22:33:52 Report test failures 00:00
56322:33:52$ section_start "flaky-test-issues" "Report test flakiness" # collapsed multi-line command
564 22:33:52 Report test flakiness 00:00
56622:33:52$ section_start "slow-test-issues" "Report test slowness" # collapsed multi-line command
567 22:33:52 Report test slowness 00:00
56922:33:52$ section_start "slow-test-merge-request-report-note" "Report test slowness in MR note" # collapsed multi-line command
570 22:33:52 Report test slowness in MR note 00:02
57322:33:54$ section_start "knapsack-report-issues" "Report test files close to timing out" # collapsed multi-line command
574 22:33:54 Report test files close to timing out 00:02
57722:33:56$ tooling/bin/push_job_metrics || true
57822:33:57[job-metrics] Pushing job metrics file for the CI/CD job.
57922:33:57[job-metrics] Pushed 4 CI job metric entries to InfluxDB.
580 22:33:57 Saving cache for successful job 00:01
58122:33:58Not uploading cache ruby-gems-debian-bookworm-ruby-3.2.5-gemfile-Gemfile-20 due to policy
582 22:33:58 Uploading artifacts for successful job 00:05
58322:33:59Uploading artifacts...
58422:33:59auto_explain/: found 2 matching artifact files and directories
58522:33:59coverage/: found 5 matching artifact files and directories
58622:33:59crystalball/: found 2 matching artifact files and directories
58722:33:59WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
58822:33:59knapsack/: found 4 matching artifact files and directories
58922:33:59rspec/: found 16 matching artifact files and directories
59022:33:59WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
59122:33:59log/*.log: found 13 matching artifact files and directories
59222:33:59WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8353287241/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
59322:33:59WARNING: Retrying... context=artifacts-uploader error=request redirected
59422:34:02Uploading artifacts as "archive" to coordinator... 201 Created id=8353287241 responseStatus=201 Created token=glcbt-66
59522:34:02Uploading artifacts...
59622:34:02rspec/rspec-*.xml: found 1 matching artifact files and directories
59722:34:02WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/8353287241/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
59822:34:02WARNING: Retrying... context=artifacts-uploader error=request redirected
59922:34:03Uploading artifacts as "junit" to coordinator... 201 Created id=8353287241 responseStatus=201 Created token=glcbt-66
600 22:34:03 Cleaning up project directory and file based variables 00:01
60122:34:13Job succeeded