Skip to content
Snippets Groups Projects

rspec background_migration pg14 2/10

Passed Started by
Allen Cook
@acook.gitlab
Log timestamps in UTC.
119:58:42Running with gitlab-runner 17.0.0~pre.88.g761ae5dd (761ae5dd)
219:58:42 on green-4.shared-gitlab-org.runners-manager.gitlab.com/default x5QiHUKw, system ID: s_b9637080a79e
319:58:42 feature flags: FF_NETWORK_PER_BUILD:true, FF_TIMESTAMPS:true
419:58:42Resolving secrets
5 19:58:42 Preparing the "docker+machine" executor 00:09
619:58:42Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.4-golang-1.22-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
719:58:44Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
819:58:44Authenticating with credentials from job payload (GitLab Registry)
919:58:44Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
1019:58:44Using docker image sha256:82f132c22567f8ce17cc132c14b2f9aa3eaf9bb5424d91c2d966912433f0257d for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:c55e1364ee4327b244a9cfa1750f19feea14fc774eaf792b725967d146eb45f5 ...
1119:58:45WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1219:58:45WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
1319:58:45Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
1419:58:45Authenticating with credentials from job payload (GitLab Registry)
1519:58:45Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
1619:58:45Using docker image sha256:5c5ba5b83d6c60cb0b225bd670b7a43be8c238cc72347d24af57e5027c3648f3 for registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:46aceab84c42d0e819c8e7940f2f98ce9e184785cd7b22d95872024a35f52407 ...
1719:58:46Starting service redis:6.2-alpine ...
1819:58:46Pulling docker image redis:6.2-alpine ...
1919:58:46Using docker image sha256:36c1d3cfe18f4b12d4640576f7048068acbfc3625027b6bbb46bba0e31b11831 for redis:6.2-alpine with digest redis@sha256:e3b17ba9479deec4b7d1eeec1548a253acc5374d68d3b27937fcfe4df8d18c7e ...
2019:58:47Waiting for services to be up and running (timeout 30 seconds)...
2119:58:50Authenticating with credentials from job payload (GitLab Registry)
2219:58:50Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.4-golang-1.22-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
2319:58:51Using docker image sha256:81bfdb4bfb87f95db78298b0ff56c643c968d2ca9638c8e84fed595e8744cfde for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.4-golang-1.22-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.4-golang-1.22-rust-1.73-node-20.12-postgresql-14@sha256:711c7f3c79e2d421a11f6ed17f4003cc71c09a5f4aa1fe6438df677bf30a1c78 ...
24 19:58:51 Preparing environment 00:00
2519:58:51Running on runner-x5qihukw-project-278964-concurrent-0 via runner-x5qihukw-shared-gitlab-org-1724425028-1e7d129d...
26 19:58:51 Getting source from Git repository 00:01
2719:58:52Skipping Git repository setup
2819:58:52Skipping Git checkout
2919:58:52Skipping Git submodules setup
30 19:58:52 Restoring cache 00:21
3119:58:53Checking cache for ruby-gems-debian-bookworm-ruby-3.2.4-17...
3219:58:53Downloading cache from https://storage.googleapis.com/gitlab-com-runners-cache/project/278964/ruby-gems-debian-bookworm-ruby-3.2.4-17
3319:59:07Successfully extracted cache
34 19:59:13 Downloading artifacts 00:45
3519:59:14Downloading artifacts for clone-gitlab-repo (7655314187)...
3619:59:18Downloading artifacts from coordinator... ok host=storage.googleapis.com id=7655314187 responseStatus=200 OK token=glcbt-66
3719:59:18WARNING: Part of .git directory is on the list of files to extract
3819:59:18WARNING: This may introduce unexpected problems
3919:59:31Downloading artifacts for compile-test-assets (7655314234)...
4019:59:34Downloading artifacts from coordinator... ok host=storage.googleapis.com id=7655314234 responseStatus=200 OK token=glcbt-66
4119:59:41Downloading artifacts for detect-tests (7655314239)...
4219:59:42Downloading artifacts from coordinator... ok host=storage.googleapis.com id=7655314239 responseStatus=200 OK token=glcbt-66
4319:59:42Downloading artifacts for retrieve-tests-metadata (7655314243)...
4419:59:42Downloading artifacts from coordinator... ok host=storage.googleapis.com id=7655314243 responseStatus=200 OK token=glcbt-66
4519:59:42Downloading artifacts for setup-test-env (7655314236)...
4619:59:46Downloading artifacts from coordinator... ok host=storage.googleapis.com id=7655314236 responseStatus=200 OK token=glcbt-66
47 19:59:58 Executing "step_script" stage of the job script
4819:59:58Using docker image sha256:81bfdb4bfb87f95db78298b0ff56c643c968d2ca9638c8e84fed595e8744cfde for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.4-golang-1.22-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.45-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.4-golang-1.22-rust-1.73-node-20.12-postgresql-14@sha256:711c7f3c79e2d421a11f6ed17f4003cc71c09a5f4aa1fe6438df677bf30a1c78 ...
4919:59:59$ echo $FOSS_ONLY
5019:59:59$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
5119:59:59$ export GOPATH=$CI_PROJECT_DIR/.go
5219:59:59$ mkdir -p $GOPATH
5319:59:59$ source scripts/utils.sh
5419:59:59$ log_disk_usage before_script
5519:59:59[log_disk_usage before_script] start
5619:59:59df -h
5719:59:59Filesystem Size Used Avail Use% Mounted on
5819:59:59overlay 46G 21G 25G 47% /
5919:59:59tmpfs 64M 0 64M 0% /dev
6019:59:59shm 256M 0 256M 0% /dev/shm
6119:59:59/dev/sda1 46G 21G 25G 47% /cache
6219:59:59tmpfs 3.9G 0 3.9G 0% /sys/devices/virtual/dmi/id
6319:59:59tmpfs 3.9G 0 3.9G 0% /proc/acpi
6419:59:59tmpfs 3.9G 0 3.9G 0% /proc/scsi
6519:59:59tmpfs 3.9G 0 3.9G 0% /sys/firmware
6619:59:59ls -lhS tmp
6719:59:59total 20K
6819:59:59drwxrwxrwx 2 root root 4.0K Aug 23 19:54 feature_flags
6919:59:59drwxrwxrwx 2 root root 4.0K Aug 23 19:54 pids
7019:59:59drwxrwxrwx 5 root root 4.0K Aug 23 19:54 prometheus_multiproc_dir
7119:59:59drwxrwxrwx 3 root root 4.0K Aug 23 19:54 sockets
7219:59:59drwxrwxrwx 10 root root 4.0K Aug 23 19:59 tests
7319:59:59[log_disk_usage before_script] end
7419:59:59$ source scripts/prepare_build.sh
75 19:59:59 Installing gems 00:19
10420:00:18Using decomposed database config (config/database.yml.decomposed-postgresql)
10520:00:18Geo DB won't be set up.
10620:00:18Embedding DB won't be set up.
107 20:00:18 Setting up DBs 01:18
11920:01:36$ source ./scripts/rspec_helpers.sh
12020:01:36$ run_timed_command "gem install knapsack --no-document"
12120:01:36$ gem install knapsack --no-document
12220:01:37Successfully installed knapsack-4.0.0
12320:01:371 gem installed
12420:01:36==> 'gem install knapsack --no-document' succeeded in 1 seconds.
12520:01:37$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"
126 20:01:37 Spawning Gitaly 00:04
13020:01:41$ export RSPEC_SKIPPED_TESTS_REPORT_PATH="rspec/skipped_tests-${CI_JOB_ID}.txt"
13120:01:41$ export RSPEC_RETRIED_TESTS_REPORT_PATH="rspec/retried_tests-${CI_JOB_ID}.txt"
13220:01:41$ tooling/bin/create_job_metrics_file || true
13320:01:44[job-metrics] Creating the job metrics file for the CI/CD job.
13420:01:44$ rspec_section rspec_parallelized_job "--fail-fast=${RSPEC_FAIL_FAST_THRESHOLD} --tag ~quarantine --tag ~zoekt --tag ~click_house"
135 20:01:44 RSpec 34:59
13620:01:44[20:01:44] Starting rspec_parallelized_job
13720:01:37RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
13820:01:44KNAPSACK_GENERATE_REPORT: true
13920:01:44FLAKY_RSPEC_GENERATE_REPORT: true
14020:01:44KNAPSACK_TEST_FILE_PATTERN: spec/{lib/gitlab/background_migration,lib/ee/gitlab/background_migration}{,/**/}*_spec.rb
14120:01:44KNAPSACK_LOG_LEVEL: debug
14220:01:44KNAPSACK_REPORT_PATH: knapsack/rspec_background_migration_pg14_2_10_278964_report.json
14320:01:44FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
14420:01:44FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec_background_migration_pg14_2_10_278964_report.json
14520:01:44NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec_background_migration_pg14_2_10_278964_report.json
14620:01:44RSPEC_SKIPPED_TESTS_REPORT_PATH: rspec/skipped_tests-7655314487.txt
14720:01:44CRYSTALBALL:
14820:01:44RSPEC_TESTS_MAPPING_ENABLED:
14920:01:44RSPEC_TESTS_FILTER_FILE:
15020:01:44Shell set options (set -o) enabled:
15120:01:44braceexpand on
15220:01:44hashall on
15320:01:44interactive-comments on
15420:01:44pipefail on
15520:01:52Knapsack report generator started!
15620:01:44/builds/gitlab-org/gitlab/vendor/ruby/3.2.0/gems/io-event-1.6.5/lib/io/event/support.rb:27: warning: IO::Buffer is experimental and both the Ruby and C interface may change in the future!
15720:02:45Run options: exclude {:quarantine=>true, :zoekt=>true, :click_house=>true}
15820:02:45# [RSpecRunTime] Starting RSpec timer...
15920:02:45[TEST PROF INFO] EventProf enabled (sql.active_record)
16020:02:45unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
16120:02:45unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
16220:02:51Test environment set up in 2.189062268 seconds
16320:02:51# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_project_statistics_storage_size_without_pipeline_artifacts_size_job_spec.rb. Expected to take 2 minutes 43.81 seconds.
16420:02:51Gitlab::BackgroundMigration::BackfillProjectStatisticsStorageSizeWithoutPipelineArtifactsSizeJob
16520:04:34 #perform
16620:04:50 coerces a null wiki_size to 0
16720:05:05 coerces a null snippets_size to 0
16820:05:05 when project_statistics backfill runs
16920:05:05 when storage_size includes pipeline_artifacts_size
17020:05:19 removes pipeline_artifacts_size from storage_size
17120:05:19 when storage_size does not include default_pipeline_artifacts_size
17220:05:33 does not update the record
17320:05:33# [RSpecRunTime] RSpec elapsed time: 2 minutes 47.87 seconds. Current RSS: ~1197M. Threads: 2. load average: 0.98 0.97 0.83 1/279 378
17420:05:33.
17520:05:33 #filter_batch
17620:05:47 filters out project_statistics with no artifacts size
17720:05:47# [RSpecRunTime] RSpec elapsed time: 3 minutes 1.52 seconds. Current RSS: ~1197M. Threads: 2. load average: 0.99 0.97 0.83 1/279 379
17820:05:47.
17920:06:07INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree
18020:06:07INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"
18120:06:07INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
18220:06:07INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"
18320:06:07INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
18420:06:07INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_102"
18520:06:07INFO: "ci_runner_machine_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
18620:06:07INFO: analyzing "public.p_ci_job_annotations" inheritance tree
18720:06:07INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"
18820:06:07INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
18920:06:07INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"
19020:06:07INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
19120:06:07INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_102"
19220:06:07INFO: "ci_job_annotations_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
19320:06:07INFO: analyzing "public.p_ci_builds_metadata" inheritance tree
19420:06:07INFO: analyzing "public.ci_builds_metadata"
19520:06:07INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
19620:06:07INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"
19720:06:07INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
19820:06:07INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_102"
19920:06:07INFO: "ci_builds_metadata_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
20020:06:07INFO: analyzing "public.p_ci_builds" inheritance tree
20120:06:07INFO: analyzing "public.ci_builds"
20220:06:07INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
20320:06:07INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"
20420:06:07INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
20520:06:07INFO: analyzing "gitlab_partitions_dynamic.ci_builds_102"
20620:06:07INFO: "ci_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
20720:06:08I, [2024-08-23T20:06:08.071700 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_build_ch_sync_events': Lock Writes
20820:06:30I, [2024-08-23T20:06:30.702851 #332] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
20920:06:32INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
21020:06:32INFO: analyzing "public.ci_pipeline_variables"
21120:06:32INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
21220:06:32I, [2024-08-23T20:06:32.532767 #332] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
21320:06:32I, [2024-08-23T20:06:32.534061 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
21420:06:32I, [2024-08-23T20:06:32.535025 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
21520:06:34INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
21620:06:34INFO: analyzing "public.ci_pipeline_variables"
21720:06:34INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
21820:06:39INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
21920:06:39INFO: analyzing "public.ci_job_artifacts"
22020:06:39INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
22120:06:39I, [2024-08-23T20:06:39.780282 #332] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
22220:06:39I, [2024-08-23T20:06:39.781694 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
22320:06:39I, [2024-08-23T20:06:39.782707 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
22420:06:43INFO: analyzing "public.p_ci_stages" inheritance tree
22520:06:43INFO: analyzing "public.ci_stages"
22620:06:43INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
22720:06:43I, [2024-08-23T20:06:43.486654 #332] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
22820:06:43I, [2024-08-23T20:06:43.487863 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
22920:06:43I, [2024-08-23T20:06:43.488737 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
23020:06:44I, [2024-08-23T20:06:44.824153 #332] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
23120:06:52I, [2024-08-23T20:06:52.060321 #332] INFO -- : Database: 'main', Table: 'p_ci_builds_execution_configs': Lock Writes
23220:07:08I, [2024-08-23T20:07:08.146392 #332] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
23320:07:08I, [2024-08-23T20:07:08.147793 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
23420:07:08I, [2024-08-23T20:07:08.148740 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
23520:07:21I, [2024-08-23T20:07:21.826959 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
23620:07:29I, [2024-08-23T20:07:29.619653 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
23720:07:38I, [2024-08-23T20:07:38.448402 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
23820:07:50# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_project_statistics_storage_size_without_pipeline_artifacts_size_job_spec.rb. It took 4 minutes 58.4 seconds. Expected to take 2 minutes 43.81 seconds.
23920:07:50# [RSpecRunTime] RSpec elapsed time: 5 minutes 4.37 seconds. Current RSS: ~1210M. Threads: 2. load average: 1.18 1.06 0.89 1/275 380
24020:07:50.
24120:07:50# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_has_merge_request_of_vulnerability_reads_spec.rb. Expected to take 1 minute 49.97 seconds.
24220:07:50Gitlab::BackgroundMigration::BackfillHasMergeRequestOfVulnerabilityReads
24320:09:31 sets the has_merge_request of existing record
24420:09:44 does not modify has_merge_request of other vulnerabilities which do not have merge request
24520:09:45INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree
24620:09:45INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"
24720:09:45INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
24820:09:45INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"
24920:09:45INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
25020:09:45INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_102"
25120:09:45INFO: "ci_runner_machine_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
25220:09:45INFO: analyzing "public.p_ci_job_annotations" inheritance tree
25320:09:45INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"
25420:09:45INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
25520:09:45INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"
25620:09:45INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
25720:09:45INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_102"
25820:09:45INFO: "ci_job_annotations_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
25920:09:45INFO: analyzing "public.p_ci_builds_metadata" inheritance tree
26020:09:45INFO: analyzing "public.ci_builds_metadata"
26120:09:45INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
26220:09:45INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"
26320:09:45INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
26420:09:45INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_102"
26520:09:45INFO: "ci_builds_metadata_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
26620:09:45INFO: analyzing "public.p_ci_builds" inheritance tree
26720:09:45INFO: analyzing "public.ci_builds"
26820:09:45INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
26920:09:45INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"
27020:09:45INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
27120:09:45INFO: analyzing "gitlab_partitions_dynamic.ci_builds_102"
27220:09:45INFO: "ci_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
27320:09:46I, [2024-08-23T20:09:46.360493 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_build_ch_sync_events': Lock Writes
27420:10:09I, [2024-08-23T20:10:09.172177 #332] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
27520:10:11INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
27620:10:11INFO: analyzing "public.ci_pipeline_variables"
27720:10:11INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
27820:10:11I, [2024-08-23T20:10:11.035674 #332] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
27920:10:11I, [2024-08-23T20:10:11.037054 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
28020:10:11I, [2024-08-23T20:10:11.038033 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
28120:10:13INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
28220:10:13INFO: analyzing "public.ci_pipeline_variables"
28320:10:13INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
28420:10:18INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
28520:10:18INFO: analyzing "public.ci_job_artifacts"
28620:10:18INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
28720:10:18I, [2024-08-23T20:10:18.362306 #332] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
28820:10:18I, [2024-08-23T20:10:18.363969 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
28920:10:18I, [2024-08-23T20:10:18.365078 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
29020:10:22INFO: analyzing "public.p_ci_stages" inheritance tree
29120:10:22INFO: analyzing "public.ci_stages"
29220:10:22INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
29320:10:22I, [2024-08-23T20:10:22.208581 #332] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
29420:10:22I, [2024-08-23T20:10:22.210025 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
29520:10:22I, [2024-08-23T20:10:22.211072 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
29620:10:23I, [2024-08-23T20:10:23.687882 #332] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
29720:10:31I, [2024-08-23T20:10:31.177774 #332] INFO -- : Database: 'main', Table: 'p_ci_builds_execution_configs': Lock Writes
29820:10:47I, [2024-08-23T20:10:47.336470 #332] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
29920:10:47I, [2024-08-23T20:10:47.337888 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
30020:10:47I, [2024-08-23T20:10:47.338813 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
30120:11:01I, [2024-08-23T20:11:01.326354 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
30220:11:09I, [2024-08-23T20:11:09.546134 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
30320:11:18I, [2024-08-23T20:11:18.533033 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
30420:11:29# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_has_merge_request_of_vulnerability_reads_spec.rb. It took 3 minutes 39.89 seconds. Expected to take 1 minute 49.97 seconds.
30520:11:30# [RSpecRunTime] RSpec elapsed time: 8 minutes 44.31 seconds. Current RSS: ~1221M. Threads: 2. load average: 1.27 1.21 1.00 1/276 381
30620:11:30.
30720:11:30# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/resolve_vulnerabilities_for_removed_analyzers_spec.rb. Expected to take 1 minute 33.74 seconds.
30820:11:30Gitlab::BackgroundMigration::ResolveVulnerabilitiesForRemovedAnalyzers
30920:11:30 #perform
31020:11:30 for vulnerability resolution
31120:11:37 resolves vulnerabilities and vulnerability_reads for removed scanners
31220:11:44 does not resolve vulnerabilities or vulnerability_reads for active scanners
31320:11:44 when the sub_batch size is 1
31420:11:50 does not raise an exception
31520:11:50# [RSpecRunTime] RSpec elapsed time: 9 minutes 5.02 seconds. Current RSS: ~1233M. Threads: 2. load average: 1.26 1.21 1.00 1/277 382
31620:11:50.
31720:11:50 for vulnerability state transitions
31820:11:57 creates vulnerability state transitions for the resolved vulnerabilities
31920:11:57# [RSpecRunTime] RSpec elapsed time: 9 minutes 11.58 seconds. Current RSS: ~1231M. Threads: 2. load average: 1.30 1.22 1.01 1/277 383
32020:11:57.
32120:11:57 for system notes
32220:12:03 creates system notes for the resolved vulnerabilities
32320:12:10 creates system note metadata for the resolved vulnerabilities
32420:12:10# [RSpecRunTime] RSpec elapsed time: 9 minutes 24.56 seconds. Current RSS: ~1238M. Threads: 2. load average: 1.26 1.21 1.01 1/277 384
32520:12:10.
32620:12:10 for vulnerability_read dismissal_reason
32720:12:16 nullifies the dismissal_reason of vulnerability_reads for removed scanners
32820:12:24 does not alter the dismissal_reason of vulnerability_reads for active scanners
32920:12:24# [RSpecRunTime] RSpec elapsed time: 9 minutes 38.52 seconds. Current RSS: ~1239M. Threads: 2. load average: 1.27 1.22 1.01 1/277 385
33020:12:24.
33120:12:24 for vulnerability_statistics
33220:12:24 when there are no vulnerability_statistics records
33320:12:30 does not create a vulnerability_statistics record
33420:12:30# [RSpecRunTime] RSpec elapsed time: 9 minutes 44.82 seconds. Current RSS: ~1224M. Threads: 2. load average: 1.17 1.20 1.00 1/277 386
33520:12:30.
33620:12:30 when there are vulnerability_statistics records
33720:12:36 subtracts the number of resolved vulnerabilities from the total number of vulnerabilities
33820:12:43 subtracts the num of resolved vulnerabilities from the num of vulnerabilities for the severity level
33920:12:49 adjusts the letter_grade to reflect the current vulnerabilities
34020:12:49 and the vulnerabilities to remove all belong to the same project
34120:12:56 updates the vulnerability_statistics table in a single operation
34220:12:56# [RSpecRunTime] RSpec elapsed time: 10 minutes 10.82 seconds. Current RSS: ~1227M. Threads: 2. load average: 1.23 1.21 1.01 1/277 387
34320:12:56.
34420:12:56 and the vulnerabilities to remove all belong to different projects
34520:13:04 updates the vulnerability_statistics table in a separate operation for each project
34620:13:04# [RSpecRunTime] RSpec elapsed time: 10 minutes 18.68 seconds. Current RSS: ~1227M. Threads: 2. load average: 1.21 1.21 1.01 1/277 388
34720:13:04.
34820:13:04 for vulnerability_feedback
34920:13:10 deletes dismissed vulnerability_feedback for removed scanners
35020:13:10# [RSpecRunTime] RSpec elapsed time: 10 minutes 25.0 seconds. Current RSS: ~1233M. Threads: 2. load average: 1.36 1.24 1.02 1/277 389
35120:13:10.
35220:13:19# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/resolve_vulnerabilities_for_removed_analyzers_spec.rb. It took 1 minute 49.81 seconds. Expected to take 1 minute 33.74 seconds.
35320:13:19# [RSpecRunTime] RSpec elapsed time: 10 minutes 34.17 seconds. Current RSS: ~1228M. Threads: 2. load average: 1.38 1.24 1.03 1/277 390
35420:13:19.
35520:13:19# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/delete_invalid_protected_branch_merge_access_levels_spec.rb. Expected to take 1 minute 16.84 seconds.
35620:13:19Gitlab::BackgroundMigration::DeleteInvalidProtectedBranchMergeAccessLevels
35720:14:28 when there are merge access levels
35820:14:36 deletes merge access levels with groups that do not have project_group_links to the project
35920:14:36# [RSpecRunTime] RSpec elapsed time: 11 minutes 51.16 seconds. Current RSS: ~1272M. Threads: 2. load average: 1.37 1.27 1.06 1/277 391
36020:14:36.
36120:14:39I, [2024-08-23T20:14:39.531785 #332] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
36220:14:41INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
36320:14:41INFO: analyzing "public.ci_pipeline_variables"
36420:14:41INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
36520:14:41I, [2024-08-23T20:14:41.383355 #332] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
36620:14:41I, [2024-08-23T20:14:41.384528 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
36720:14:41I, [2024-08-23T20:14:41.385319 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
36820:14:43INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
36920:14:43INFO: analyzing "public.ci_pipeline_variables"
37020:14:43INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
37120:14:48INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
37220:14:48INFO: analyzing "public.ci_job_artifacts"
37320:14:48INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
37420:14:48I, [2024-08-23T20:14:48.462256 #332] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
37520:14:48I, [2024-08-23T20:14:48.463732 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
37620:14:48I, [2024-08-23T20:14:48.464721 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
37720:14:52INFO: analyzing "public.p_ci_stages" inheritance tree
37820:14:52INFO: analyzing "public.ci_stages"
37920:14:52INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
38020:14:52I, [2024-08-23T20:14:52.280098 #332] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
38120:14:52I, [2024-08-23T20:14:52.281458 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
38220:14:52I, [2024-08-23T20:14:52.282423 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
38320:14:53I, [2024-08-23T20:14:53.702874 #332] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
38420:15:01I, [2024-08-23T20:15:01.021530 #332] INFO -- : Database: 'main', Table: 'p_ci_builds_execution_configs': Lock Writes
38520:15:16I, [2024-08-23T20:15:16.913594 #332] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
38620:15:16I, [2024-08-23T20:15:16.915068 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
38720:15:16I, [2024-08-23T20:15:16.916158 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
38820:15:30I, [2024-08-23T20:15:30.605526 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
38920:15:38I, [2024-08-23T20:15:38.731665 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
39020:15:47I, [2024-08-23T20:15:47.790627 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
39120:15:59# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/delete_invalid_protected_branch_merge_access_levels_spec.rb. It took 2 minutes 39.76 seconds. Expected to take 1 minute 16.84 seconds.
39220:15:59# [RSpecRunTime] RSpec elapsed time: 13 minutes 13.98 seconds. Current RSS: ~1241M. Threads: 2. load average: 1.16 1.21 1.05 1/277 392
39320:15:59.
39420:15:59# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_default_organization_owners_spec.rb. Expected to take 1 minute 11.91 seconds.
39520:15:59Gitlab::BackgroundMigration::BackfillDefaultOrganizationOwners
39620:17:10 #perform
39720:17:18 runs without error for no-op
39820:17:18# [RSpecRunTime] RSpec elapsed time: 14 minutes 32.82 seconds. Current RSS: ~1275M. Threads: 2. load average: 1.70 1.37 1.12 1/277 393
39920:17:18.
40020:17:20INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
40120:17:20INFO: analyzing "public.ci_pipeline_variables"
40220:17:20INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
40320:17:20I, [2024-08-23T20:17:20.378560 #332] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
40420:17:20I, [2024-08-23T20:17:20.379964 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
40520:17:20I, [2024-08-23T20:17:20.380876 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
40620:17:22INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
40720:17:22INFO: analyzing "public.ci_pipeline_variables"
40820:17:22INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
40920:17:27INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
41020:17:27INFO: analyzing "public.ci_job_artifacts"
41120:17:27INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
41220:17:27I, [2024-08-23T20:17:27.778619 #332] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
41320:17:27I, [2024-08-23T20:17:27.780337 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
41420:17:27I, [2024-08-23T20:17:27.781388 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
41520:17:31INFO: analyzing "public.p_ci_stages" inheritance tree
41620:17:31INFO: analyzing "public.ci_stages"
41720:17:31INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
41820:17:31I, [2024-08-23T20:17:31.759816 #332] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
41920:17:31I, [2024-08-23T20:17:31.761308 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
42020:17:31I, [2024-08-23T20:17:31.762388 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
42120:17:33I, [2024-08-23T20:17:33.268530 #332] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
42220:17:40I, [2024-08-23T20:17:40.779280 #332] INFO -- : Database: 'main', Table: 'p_ci_builds_execution_configs': Lock Writes
42320:17:57I, [2024-08-23T20:17:57.157776 #332] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
42420:17:57I, [2024-08-23T20:17:57.159019 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
42520:17:57I, [2024-08-23T20:17:57.159908 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
42620:18:11I, [2024-08-23T20:18:11.060936 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
42720:18:19I, [2024-08-23T20:18:19.224084 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
42820:18:28I, [2024-08-23T20:18:28.336584 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
42920:18:39# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_default_organization_owners_spec.rb. It took 2 minutes 40.21 seconds. Expected to take 1 minute 11.91 seconds.
43020:18:39# [RSpecRunTime] RSpec elapsed time: 15 minutes 54.24 seconds. Current RSS: ~1219M. Threads: 2. load average: 1.44 1.35 1.13 1/277 394
43120:18:39.
43220:18:39# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_approval_project_rules_users_project_id_spec.rb. Expected to take 57.98 seconds.
43320:18:39Gitlab::BackgroundMigration::BackfillApprovalProjectRulesUsersProjectId
43420:19:37 constructs a valid query
43520:19:43 performs without error
43620:19:59I, [2024-08-23T20:19:59.724376 #332] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
43720:19:59I, [2024-08-23T20:19:59.726033 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
43820:19:59I, [2024-08-23T20:19:59.727113 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
43920:20:13I, [2024-08-23T20:20:13.805327 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
44020:20:22I, [2024-08-23T20:20:22.106673 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
44120:20:31I, [2024-08-23T20:20:31.468562 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
44220:20:43# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_approval_project_rules_users_project_id_spec.rb. It took 2 minutes 3.18 seconds. Expected to take 57.98 seconds.
44320:20:43# [RSpecRunTime] RSpec elapsed time: 17 minutes 57.46 seconds. Current RSS: ~1222M. Threads: 2. load average: 1.05 1.25 1.12 1/278 395
44420:20:43.
44520:20:43# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_boards_epic_board_labels_group_id_spec.rb. Expected to take 42.52 seconds.
44620:20:43Gitlab::BackgroundMigration::BackfillBoardsEpicBoardLabelsGroupId
44720:21:22 constructs a valid query
44820:21:27 performs without error
44920:21:28I, [2024-08-23T20:21:28.956622 #332] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
45020:21:28I, [2024-08-23T20:21:28.957797 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
45120:21:28I, [2024-08-23T20:21:28.958616 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
45220:21:42I, [2024-08-23T20:21:42.278212 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
45320:21:50I, [2024-08-23T20:21:50.235755 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
45420:21:59I, [2024-08-23T20:21:59.002509 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
45520:22:10# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_boards_epic_board_labels_group_id_spec.rb. It took 1 minute 27.52 seconds. Expected to take 42.52 seconds.
45620:22:10# [RSpecRunTime] RSpec elapsed time: 19 minutes 25.03 seconds. Current RSS: ~1224M. Threads: 2. load average: 1.23 1.28 1.14 1/278 396
45720:22:10.
45820:22:10# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_vulnerability_user_mentions_project_id_spec.rb. Expected to take 41.74 seconds.
45920:22:10Gitlab::BackgroundMigration::BackfillVulnerabilityUserMentionsProjectId
46020:22:47 performs without error
46120:22:53 constructs a valid query
46220:23:07I, [2024-08-23T20:23:07.180631 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
46320:23:15I, [2024-08-23T20:23:15.057878 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
46420:23:24I, [2024-08-23T20:23:24.101855 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
46520:23:35# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_vulnerability_user_mentions_project_id_spec.rb. It took 1 minute 24.79 seconds. Expected to take 41.74 seconds.
46620:23:35# [RSpecRunTime] RSpec elapsed time: 20 minutes 49.87 seconds. Current RSS: ~1225M. Threads: 2. load average: 1.16 1.24 1.14 1/278 397
46720:23:35.
46820:23:35# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_agent_activity_events_agent_project_id_spec.rb. Expected to take 40.65 seconds.
46920:23:35Gitlab::BackgroundMigration::BackfillAgentActivityEventsAgentProjectId
47020:24:13 performs without error
47120:24:18 constructs a valid query
47220:24:19I, [2024-08-23T20:24:19.385943 #332] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
47320:24:19I, [2024-08-23T20:24:19.387200 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
47420:24:19I, [2024-08-23T20:24:19.388088 #332] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
47520:24:32I, [2024-08-23T20:24:32.646496 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
47620:24:40I, [2024-08-23T20:24:40.487985 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
47720:24:49I, [2024-08-23T20:24:49.546793 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
47820:25:01# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_agent_activity_events_agent_project_id_spec.rb. It took 1 minute 25.46 seconds. Expected to take 40.65 seconds.
47920:25:01# [RSpecRunTime] RSpec elapsed time: 22 minutes 15.38 seconds. Current RSS: ~1228M. Threads: 2. load average: 1.20 1.24 1.14 1/278 398
48020:25:01.
48120:25:01# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_epic_user_mentions_group_id_spec.rb. Expected to take 39.66 seconds.
48220:25:01Gitlab::BackgroundMigration::BackfillEpicUserMentionsGroupId
48320:25:38 constructs a valid query
48420:25:43 performs without error
48520:25:56I, [2024-08-23T20:25:56.930018 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
48620:26:04I, [2024-08-23T20:26:04.799058 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
48720:26:14I, [2024-08-23T20:26:14.075550 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
48820:26:25# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_epic_user_mentions_group_id_spec.rb. It took 1 minute 24.25 seconds. Expected to take 39.66 seconds.
48920:26:25# [RSpecRunTime] RSpec elapsed time: 23 minutes 39.68 seconds. Current RSS: ~1228M. Threads: 2. load average: 1.28 1.26 1.16 1/277 399
49020:26:25.
49120:26:25# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_packages_debian_group_distribution_keys_group_id_spec.rb. Expected to take 37.61 seconds.
49220:26:25Gitlab::BackgroundMigration::BackfillPackagesDebianGroupDistributionKeysGroupId
49320:27:01 performs without error
49420:27:07 constructs a valid query
49520:27:20I, [2024-08-23T20:27:20.331561 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
49620:27:28I, [2024-08-23T20:27:28.344402 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
49720:27:37I, [2024-08-23T20:27:37.306075 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
49820:27:49# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_packages_debian_group_distribution_keys_group_id_spec.rb. It took 1 minute 24.51 seconds. Expected to take 37.61 seconds.
49920:27:49# [RSpecRunTime] RSpec elapsed time: 25 minutes 4.24 seconds. Current RSS: ~1225M. Threads: 2. load average: 1.12 1.21 1.15 1/278 400
50020:27:49.
50120:27:49# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_packages_conan_metadata_project_id_spec.rb. Expected to take 28.15 seconds.
50220:27:49Gitlab::BackgroundMigration::BackfillPackagesConanMetadataProjectId
50320:28:13 constructs a valid query
50420:28:18 performs without error
50520:28:19I, [2024-08-23T20:28:19.825598 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
50620:28:27I, [2024-08-23T20:28:27.525537 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
50720:28:36I, [2024-08-23T20:28:36.440421 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
50820:28:47# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_packages_conan_metadata_project_id_spec.rb. It took 57.78 seconds. Expected to take 28.15 seconds.
50920:28:47# [RSpecRunTime] RSpec elapsed time: 26 minutes 2.07 seconds. Current RSS: ~1218M. Threads: 2. load average: 1.23 1.23 1.16 1/278 401
51020:28:47.
51120:28:47# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_vulnerability_finding_signatures_project_id_spec.rb. Expected to take 27.24 seconds.
51220:28:47Gitlab::BackgroundMigration::BackfillVulnerabilityFindingSignaturesProjectId
51320:29:11 constructs a valid query
51420:29:16 performs without error
51520:29:17I, [2024-08-23T20:29:17.316716 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
51620:29:24I, [2024-08-23T20:29:24.957618 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
51720:29:33I, [2024-08-23T20:29:33.927061 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
51820:29:45# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_vulnerability_finding_signatures_project_id_spec.rb. It took 57.7 seconds. Expected to take 27.24 seconds.
51920:29:45# [RSpecRunTime] RSpec elapsed time: 26 minutes 59.82 seconds. Current RSS: ~1221M. Threads: 2. load average: 1.34 1.26 1.18 1/279 402
52020:29:45.
52120:29:45# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_packages_debian_project_architectures_project_id_spec.rb. Expected to take 25.83 seconds.
52220:29:45Gitlab::BackgroundMigration::BackfillPackagesDebianProjectArchitecturesProjectId
52320:30:09 performs without error
52420:30:13 constructs a valid query
52520:30:14I, [2024-08-23T20:30:14.793502 #332] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
52620:30:22I, [2024-08-23T20:30:22.292669 #332] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
52720:30:31I, [2024-08-23T20:30:31.109740 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
52820:30:42# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_packages_debian_project_architectures_project_id_spec.rb. It took 57.0 seconds. Expected to take 25.83 seconds.
52920:30:42# [RSpecRunTime] RSpec elapsed time: 27 minutes 56.87 seconds. Current RSS: ~1224M. Threads: 2. load average: 1.21 1.26 1.18 1/279 403
53020:30:42.
53120:30:42# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_compliance_framework_security_policies_project_id_spec.rb. Expected to take 19.2 seconds.
53220:30:42Gitlab::BackgroundMigration::BackfillComplianceFrameworkSecurityPoliciesProjectId
53320:30:59 performs without error
53420:31:03 constructs a valid query
53520:31:12I, [2024-08-23T20:31:12.373818 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
53620:31:23# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_compliance_framework_security_policies_project_id_spec.rb. It took 41.22 seconds. Expected to take 19.2 seconds.
53720:31:23# [RSpecRunTime] RSpec elapsed time: 28 minutes 38.14 seconds. Current RSS: ~1227M. Threads: 2. load average: 1.14 1.22 1.17 1/279 404
53820:31:23.
53920:31:23# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_vulnerability_occurrence_identifiers_project_id_spec.rb. Expected to take 17.94 seconds.
54020:31:23Gitlab::BackgroundMigration::BackfillVulnerabilityOccurrenceIdentifiersProjectId
54120:31:39 constructs a valid query
54220:31:43 performs without error
54320:31:52I, [2024-08-23T20:31:52.094335 #332] INFO -- : Database: 'main', Table: 'p_ci_build_trace_metadata': Lock Writes
54420:32:03# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_vulnerability_occurrence_identifiers_project_id_spec.rb. It took 39.67 seconds. Expected to take 17.94 seconds.
54520:32:03# [RSpecRunTime] RSpec elapsed time: 29 minutes 17.87 seconds. Current RSS: ~1226M. Threads: 2. load average: 1.02 1.19 1.17 1/279 405
54620:32:03.
54720:32:03# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_partition_id_ci_daily_build_group_report_result_spec.rb. Expected to take 11.53 seconds.
54820:32:03Gitlab::BackgroundMigration::BackfillPartitionIdCiDailyBuildGroupReportResult
54920:32:07 #perform
55020:32:07 when second partition does not exist
55120:32:11 does not execute the migration
55220:32:11# [RSpecRunTime] RSpec elapsed time: 29 minutes 25.99 seconds. Current RSS: ~1234M. Threads: 2. load average: 1.16 1.22 1.18 1/279 406
55320:32:11.
55420:32:11 when second partition exists
55520:32:15 fixes invalid records in the wrong the partition
55620:32:16# [RSpecRunTime] RSpec elapsed time: 29 minutes 30.28 seconds. Current RSS: ~1229M. Threads: 2. load average: 1.16 1.22 1.18 1/279 407
55720:32:16.
55820:32:26# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_partition_id_ci_daily_build_group_report_result_spec.rb. It took 22.99 seconds. Expected to take 11.53 seconds.
55920:32:26# [RSpecRunTime] RSpec elapsed time: 29 minutes 40.9 seconds. Current RSS: ~1225M. Threads: 2. load average: 1.21 1.22 1.18 1/280 408
56020:32:26.
56120:32:26# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_default_branch_protection_settings_spec.rb. Expected to take 9.14 seconds.
56220:32:26Gitlab::BackgroundMigration::BackfillDefaultBranchProtectionSettings
56320:32:31 updates default_branch_protection_defaults to a correct value
56420:32:31 when all the namespaces have `default_branch_protection` set
56520:32:36 does not update the settings
56620:32:36# [RSpecRunTime] RSpec elapsed time: 29 minutes 50.36 seconds. Current RSS: ~1233M. Threads: 2. load average: 1.27 1.24 1.18 1/279 409
56720:32:36.
56820:32:44# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_default_branch_protection_settings_spec.rb. It took 18.17 seconds. Expected to take 9.14 seconds.
56920:32:44# [RSpecRunTime] RSpec elapsed time: 29 minutes 59.13 seconds. Current RSS: ~1228M. Threads: 2. load average: 1.23 1.23 1.18 1/279 410
57020:32:44.
57120:32:44# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/update_jira_tracker_data_deployment_type_based_on_url_spec.rb. Expected to take 5.48 seconds.
57220:32:44Gitlab::BackgroundMigration::UpdateJiraTrackerDataDeploymentTypeBasedOnUrl
57320:32:49 changes unknown deployment_types based on URL
57420:32:58# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/update_jira_tracker_data_deployment_type_based_on_url_spec.rb. It took 13.98 seconds. Expected to take 5.48 seconds.
57520:32:58# [RSpecRunTime] RSpec elapsed time: 30 minutes 13.15 seconds. Current RSS: ~1228M. Threads: 2. load average: 1.18 1.22 1.18 1/279 411
57620:32:58.
57720:32:58# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/delete_orphaned_deploy_tokens_spec.rb. Expected to take 5.04 seconds.
57820:32:58Gitlab::BackgroundMigration::DeleteOrphanedDeployTokens
57920:33:05 removes deploy tokens with no project or group join table record
58020:33:13# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/delete_orphaned_deploy_tokens_spec.rb. It took 14.98 seconds. Expected to take 5.04 seconds.
58120:33:13# [RSpecRunTime] RSpec elapsed time: 30 minutes 28.18 seconds. Current RSS: ~1214M. Threads: 2. load average: 1.20 1.22 1.18 1/279 412
58220:33:13.
58320:34:01auto_explain log contains 1086 entries for main, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-background-migration-pg14-2-10.332.main.ndjson.gz
58420:34:01took 47.222781109
58520:34:47auto_explain log contains 1087 entries for ci, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-background-migration-pg14-2-10.332.ci.ndjson.gz
58620:34:47took 45.481227305
58720:34:47[TEST PROF INFO] EventProf results for sql.active_record
58820:34:47Total time: 19:23.793 of 30:22.244 (63.87%)
58920:34:47Total events: 774286
59020:34:47Top 5 slowest suites (by time):
59120:34:47Gitlab::Backg...tifactsSizeJob (./spec/lib/gitlab/background_migration/backfill_project_statistics_storage_size_without_pipeline_artifacts_size_job_spec.rb:5) – 02:57.625 (109267 / 5) of 04:58.446 (59.52%)
59220:34:47Gitlab::Backg...erabilityReads (./spec/lib/gitlab/background_migration/backfill_has_merge_request_of_vulnerability_reads_spec.rb:5) – 02:27.315 (94254 / 2) of 03:39.942 (66.98%)
59320:34:47Gitlab::Backg...geAccessLevels (./spec/lib/gitlab/background_migration/delete_invalid_protected_branch_merge_access_levels_spec.rb:5) – 01:53.246 (73630 / 1) of 02:39.807 (70.86%)
59420:34:47Gitlab::Backg...nizationOwners (./spec/lib/gitlab/background_migration/backfill_default_organization_owners_spec.rb:5) – 01:53.105 (72321 / 1) of 02:40.255 (70.58%)
59520:34:47Gitlab::Backg...UsersProjectId (./spec/lib/gitlab/background_migration/backfill_approval_project_rules_users_project_id_spec.rb:5) – 01:24.433 (54719 / 2) of 02:03.225 (68.52%)
59620:34:47Knapsack report was generated. Preview:
59720:34:47{
59820:34:47 "spec/lib/gitlab/background_migration/backfill_project_statistics_storage_size_without_pipeline_artifacts_size_job_spec.rb": 177.32898454700262,
59920:34:47 "spec/lib/gitlab/background_migration/backfill_has_merge_request_of_vulnerability_reads_spec.rb": 114.96320186699813,
60020:34:47 "spec/lib/gitlab/background_migration/resolve_vulnerabilities_for_removed_analyzers_spec.rb": 100.86504283199974,
60120:34:47 "spec/lib/gitlab/background_migration/delete_invalid_protected_branch_merge_access_levels_spec.rb": 77.31806243300161,
60220:34:47 "spec/lib/gitlab/background_migration/backfill_default_organization_owners_spec.rb": 79.0317853259985,
60320:34:47 "spec/lib/gitlab/background_migration/backfill_approval_project_rules_users_project_id_spec.rb": 63.399960520000604,
60420:34:47 "spec/lib/gitlab/background_migration/backfill_boards_epic_board_labels_group_id_spec.rb": 44.54827213899989,
60520:34:47 "spec/lib/gitlab/background_migration/backfill_vulnerability_user_mentions_project_id_spec.rb": 42.621049339999445,
60620:34:47 "spec/lib/gitlab/background_migration/backfill_agent_activity_events_agent_project_id_spec.rb": 43.07286541099893,
60720:34:47 "spec/lib/gitlab/background_migration/backfill_epic_user_mentions_group_id_spec.rb": 42.49736773300174,
60820:34:47 "spec/lib/gitlab/background_migration/backfill_packages_debian_group_distribution_keys_group_id_spec.rb": 42.03448583299905,
60920:34:47 "spec/lib/gitlab/background_migration/backfill_packages_conan_metadata_project_id_spec.rb": 28.541739382999367,
61020:34:47 "spec/lib/gitlab/background_migration/backfill_vulnerability_finding_signatures_project_id_spec.rb": 28.49536006699782,
61120:34:47 "spec/lib/gitlab/background_migration/backfill_packages_debian_project_architectures_project_id_spec.rb": 28.62343453500216,
61220:34:47 "spec/lib/gitlab/background_migration/backfill_compliance_framework_security_policies_project_id_spec.rb": 21.04995988399969,
61320:34:47 "spec/lib/gitlab/background_migration/backfill_vulnerability_occurrence_identifiers_project_id_spec.rb": 20.172971702002542,
61420:34:47 "spec/lib/gitlab/background_migration/backfill_partition_id_ci_daily_build_group_report_result_spec.rb": 12.57113381399904,
61520:34:47 "spec/lib/gitlab/background_migration/backfill_default_branch_protection_settings_spec.rb": 9.622557997001422,
61620:34:47 "spec/lib/gitlab/background_migration/update_jira_tracker_data_deployment_type_based_on_url_spec.rb": 5.311342003999016,
61720:34:47 "spec/lib/gitlab/background_migration/delete_orphaned_deploy_tokens_spec.rb": 6.540891592998378
61820:34:47}
61920:34:47Knapsack global time execution for tests: 16m 28s
62020:34:47Finished in 32 minutes 2 seconds (files took 57.43 seconds to load)
62120:34:4752 examples, 0 failures
62220:34:47Randomized with seed 28451
62320:34:57RSpec exited with 0.
62420:34:57No examples to retry, congrats!
625 20:34:57 Running after_script 00:09
62620:34:58Running after script...
62720:34:58$ source scripts/utils.sh
62820:34:58$ log_disk_usage after_script
62920:34:58[log_disk_usage after_script] start
63020:34:58df -h
63120:34:58Filesystem Size Used Avail Use% Mounted on
63220:34:58overlay 46G 23G 23G 50% /
63320:34:58tmpfs 64M 0 64M 0% /dev
63420:34:58shm 256M 0 256M 0% /dev/shm
63520:34:58/dev/sda1 46G 23G 23G 50% /cache
63620:34:58tmpfs 3.9G 0 3.9G 0% /sys/devices/virtual/dmi/id
63720:34:58tmpfs 3.9G 0 3.9G 0% /proc/acpi
63820:34:58tmpfs 3.9G 0 3.9G 0% /proc/scsi
63920:34:58tmpfs 3.9G 0 3.9G 0% /sys/firmware
64020:34:58ls -lhS tmp
64120:34:58total 40K
64220:34:58drwxr-xr-x 3 root root 4.0K Aug 23 20:00 cache
64320:34:58drwxrwxrwx 2 root root 4.0K Aug 23 19:54 feature_flags
64420:34:58drwxrwxrwx 2 root root 4.0K Aug 23 19:54 pids
64520:34:58drwxrwxrwx 5 root root 4.0K Aug 23 20:02 prometheus_multiproc_dir
64620:34:58drwxr-xr-x 4 root root 4.0K Aug 23 20:01 run
64720:34:58drwxrwxrwx 3 root root 4.0K Aug 23 19:54 sockets
64820:34:58drwxrwxrwx 16 root root 4.0K Aug 23 20:33 tests
64920:34:58-rw-r--r-- 1 root root 363 Aug 23 20:01 job-metrics.json
65020:34:58-rw-r--r-- 1 root root 58 Aug 23 20:01 duration_setup_db.txt
65120:34:58-rw------- 1 root root 44 Aug 23 20:00 gitlab_workhorse_test_secret
65220:34:58[log_disk_usage after_script] end
65320:34:58$ bundle exec gem list gitlab_quality-test_tooling
65420:35:00gitlab_quality-test_tooling (1.35.0)
65520:35:00$ section_start "failed-test-issues" "Report test failures" # collapsed multi-line command
656 20:35:00 Report test failures 00:00
65820:35:00$ section_start "flaky-test-issues" "Report test flakiness" # collapsed multi-line command
659 20:35:00 Report test flakiness 00:00
66120:35:00$ section_start "slow-test-issues" "Report test slowness" # collapsed multi-line command
662 20:35:00 Report test slowness 00:00
66420:35:00$ section_start "slow-test-merge-request-report-note" "Report test slowness in MR note" # collapsed multi-line command
665 20:35:00 Report test slowness in MR note 00:02
66820:35:02$ section_start "knapsack-report-issues" "Report test files close to timing out" # collapsed multi-line command
669 20:35:02 Report test files close to timing out 00:02
67220:35:04$ tooling/bin/push_job_metrics || true
67320:35:05[job-metrics] Pushing job metrics file for the CI/CD job.
67420:35:05[job-metrics] Pushed 4 CI job metric entries to InfluxDB.
675 20:35:06 Saving cache for successful job 00:01
67620:35:06Not uploading cache ruby-gems-debian-bookworm-ruby-3.2.4-17 due to policy
677 20:35:07 Uploading artifacts for successful job 00:05
67820:35:07Uploading artifacts...
67920:35:07auto_explain/: found 3 matching artifact files and directories
68020:35:07coverage/: found 5 matching artifact files and directories
68120:35:07crystalball/: found 2 matching artifact files and directories
68220:35:07WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
68320:35:07knapsack/: found 4 matching artifact files and directories
68420:35:07rspec/: found 16 matching artifact files and directories
68520:35:07WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
68620:35:07log/*.log: found 13 matching artifact files and directories
68720:35:07WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/7655314487/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
68820:35:07WARNING: Retrying... context=artifacts-uploader error=request redirected
68920:35:10Uploading artifacts as "archive" to coordinator... 201 Created id=7655314487 responseStatus=201 Created token=glcbt-66
69020:35:10Uploading artifacts...
69120:35:10rspec/rspec-*.xml: found 1 matching artifact files and directories
69220:35:10WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/7655314487/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
69320:35:10WARNING: Retrying... context=artifacts-uploader error=request redirected
69420:35:12Uploading artifacts as "junit" to coordinator... 201 Created id=7655314487 responseStatus=201 Created token=glcbt-66
695 20:35:12 Cleaning up project directory and file based variables 00:01
69620:35:21Job succeeded