Skip to content
Snippets Groups Projects

rspec background_migration pg14 4/5

Passed Started by
🤖 GitLab Bot 🤖
@gitlab-bot
1Running with gitlab-runner 16.11.0~pre.21.gaa21be2d (aa21be2d)
2 on blue-5.private.runners-manager.gitlab.com/gitlab.com/gitlab-org PYwgZLQB, system ID: s_4bff81aff7f7
3 feature flags: FF_NETWORK_PER_BUILD:true, FF_USE_IMPROVED_URL_MASKING:true
4 Resolving secrets 00:00
5 Preparing the "docker+machine" executor 00:21
6Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.1.patched-golang-1.20-rust-1.73-node-18.17-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-120-yarn-1.22-graphicsmagick-1.3.36 ...
7Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
8Authenticating with credentials from job payload (GitLab Registry)
9Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
10Using docker image sha256:82f132c22567f8ce17cc132c14b2f9aa3eaf9bb5424d91c2d966912433f0257d for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:c55e1364ee4327b244a9cfa1750f19feea14fc774eaf792b725967d146eb45f5 ...
11WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
12WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
13Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
14Authenticating with credentials from job payload (GitLab Registry)
15Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
16Using docker image sha256:5c5ba5b83d6c60cb0b225bd670b7a43be8c238cc72347d24af57e5027c3648f3 for registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:46aceab84c42d0e819c8e7940f2f98ce9e184785cd7b22d95872024a35f52407 ...
17Starting service redis:6.2-alpine ...
18Pulling docker image redis:6.2-alpine ...
19Using docker image sha256:57763d55554967cf0a9b05258512282482807d361c68b10fd9599ac9732bfb04 for redis:6.2-alpine with digest redis@sha256:3fcb624d83a9c478357f16dc173c58ded325ccc5fd2a4375f3916c04cc579f70 ...
20Waiting for services to be up and running (timeout 30 seconds)...
21Authenticating with credentials from job payload (GitLab Registry)
22Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.1.patched-golang-1.20-rust-1.73-node-18.17-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-120-yarn-1.22-graphicsmagick-1.3.36 ...
23Using docker image sha256:4d97a6e6b48a500f28599f739761ccb23dc0b775b23fe71357e1f48df9074e52 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.1.patched-golang-1.20-rust-1.73-node-18.17-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-120-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.1.patched-golang-1.20-rust-1.73-node-18.17-postgresql-14@sha256:56b23cca550b55e86db3c2471a1223d2b3a97ddff9a4bf6bd246dcef3ec64284 ...
24 Preparing environment 00:00
25Running on runner-pywgzlqb-project-278964-concurrent-0 via runner-pywgzlqb-private-1712139753-67da1f9b...
26 Getting source from Git repository 00:01
27Skipping Git repository setup
28Skipping Git checkout
29Skipping Git submodules setup
30 Restoring cache 00:16
31Checking cache for ruby-gems-debian-bookworm-ruby-3.1-17...
32Downloading cache from https://storage.googleapis.com/gitlab-com-runners-cache/project/278964/ruby-gems-debian-bookworm-ruby-3.1-17
33Successfully extracted cache
34 Downloading artifacts 00:34
35Downloading artifacts for clone-gitlab-repo (6536638914)...
36Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6536638914 responseStatus=200 OK token=glcbt-65
37WARNING: Part of .git directory is on the list of files to extract
38WARNING: This may introduce unexpected problems
39Downloading artifacts for compile-test-assets (6536638957)...
40Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6536638957 responseStatus=200 OK token=glcbt-65
41Downloading artifacts for detect-tests (6536638978)...
42Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6536638978 responseStatus=200 OK token=glcbt-65
43Downloading artifacts for retrieve-tests-metadata (6536638983)...
44Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6536638983 responseStatus=200 OK token=glcbt-65
45Downloading artifacts for setup-test-env (6536638964)...
46Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6536638964 responseStatus=200 OK token=glcbt-65
47 Executing "step_script" stage of the job script
48Using docker image sha256:4d97a6e6b48a500f28599f739761ccb23dc0b775b23fe71357e1f48df9074e52 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.1.patched-golang-1.20-rust-1.73-node-18.17-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-120-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.1.patched-golang-1.20-rust-1.73-node-18.17-postgresql-14@sha256:56b23cca550b55e86db3c2471a1223d2b3a97ddff9a4bf6bd246dcef3ec64284 ...
49$ echo $FOSS_ONLY
50$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
51$ export GOPATH=$CI_PROJECT_DIR/.go
52$ mkdir -p $GOPATH
53$ source scripts/utils.sh
54$ source scripts/prepare_build.sh
55 Installing gems 00:21
731Using decomposed database config (config/database.yml.decomposed-postgresql)
732Geo DB won't be set up.
733Embedding DB won't be set up.
734 Setting up DBs 01:13
745$ source ./scripts/rspec_helpers.sh
746$ run_timed_command "gem install knapsack --no-document"
747$ gem install knapsack --no-document
748Successfully installed knapsack-4.0.0
7491 gem installed
750==> 'gem install knapsack --no-document' succeeded in 0 seconds.
751$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"
752 Spawning Gitaly 00:05
756$ export RSPEC_SKIPPED_TESTS_REPORT_PATH="rspec/skipped_tests-${CI_JOB_ID}.txt"
757$ export RSPEC_RETRIED_TESTS_REPORT_PATH="rspec/retried_tests-${CI_JOB_ID}.txt"
758$ tooling/bin/create_job_metrics_file || true
759[job-metrics] Creating the job metrics file for the CI/CD job.
760$ rspec_section rspec_parallelized_job "--fail-fast=${RSPEC_FAIL_FAST_THRESHOLD} --tag ~quarantine --tag ~zoekt --tag ~click_house"
761 RSpec 24:20
762[10:33:35] Starting rspec_parallelized_job
763RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
764KNAPSACK_GENERATE_REPORT: true
765FLAKY_RSPEC_GENERATE_REPORT: true
766KNAPSACK_TEST_FILE_PATTERN: spec/{lib/gitlab/background_migration,lib/ee/gitlab/background_migration}{,/**/}*_spec.rb
767KNAPSACK_LOG_LEVEL: debug
768KNAPSACK_REPORT_PATH: knapsack/rspec_background_migration_pg14_4_5_278964_report.json
769FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
770FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec_background_migration_pg14_4_5_278964_report.json
771NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec_background_migration_pg14_4_5_278964_report.json
772RSPEC_SKIPPED_TESTS_REPORT_PATH: rspec/skipped_tests-6536639209.txt
773CRYSTALBALL:
774RSPEC_TESTS_MAPPING_ENABLED:
775RSPEC_TESTS_FILTER_FILE:
776Shell set options (set -o) enabled:
777braceexpand on
778hashall on
779interactive-comments on
780pipefail on
781Knapsack report generator started!
782Run options: exclude {:quarantine=>true, :zoekt=>true, :click_house=>true}
783# [RSpecRunTime] Starting RSpec timer...
784[TEST PROF INFO] EventProf enabled (sql.active_record)
785unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
786unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
787Test environment set up in 3.043782732 seconds
788# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/legacy_upload_mover_spec.rb. Expected to take 1 minute 29.23 seconds.
789Gitlab::BackgroundMigration::LegacyUploadMover
790 when no note found for the upload
791 behaves like legacy upload deletion
792 removes the upload record
793 when upload does not belong to a note
794 does not remove the upload
795# [RSpecRunTime] RSpec elapsed time: 18.13 seconds. Current RSS: ~1367M. load average: 1.14 1.42 0.94 1/277 400
796 when the upload move fails
797 behaves like move error
798 does not remove the upload file
799# [RSpecRunTime] RSpec elapsed time: 23.55 seconds. Current RSS: ~1377M. load average: 1.13 1.41 0.94 1/277 401
800 when the upload is in local storage
801 when the upload file does not exist on the filesystem
802 behaves like legacy upload deletion
803 removes the upload record
804# [RSpecRunTime] RSpec elapsed time: 28.81 seconds. Current RSS: ~1375M. load average: 1.12 1.40 0.94 1/277 402
805 when an upload belongs to a legacy_diff_note
806 when the file does not exist for the upload
807 behaves like move error
808 does not remove the upload file
809# [RSpecRunTime] RSpec elapsed time: 34.38 seconds. Current RSS: ~1376M. load average: 1.11 1.39 0.94 1/276 403
810 when the file does not exist on expected path
811 behaves like move error
812 does not remove the upload file
813# [RSpecRunTime] RSpec elapsed time: 39.57 seconds. Current RSS: ~1372M. load average: 1.10 1.39 0.94 1/276 404
814 when the file path does not include system/note/attachment
815 behaves like move error
816 does not remove the upload file
817# [RSpecRunTime] RSpec elapsed time: 44.82 seconds. Current RSS: ~1363M. load average: 1.09 1.38 0.94 1/276 405
818 when the file move raises an error
819 behaves like move error
820 does not remove the upload file
821# [RSpecRunTime] RSpec elapsed time: 50.02 seconds. Current RSS: ~1364M. load average: 1.08 1.37 0.94 1/277 406
822 when upload has mount_point nil
823 behaves like migrates the file correctly
824 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
825# [RSpecRunTime] RSpec elapsed time: 55.37 seconds. Current RSS: ~1366M. load average: 0.99 1.35 0.94 1/277 407
826 when the file can be handled correctly
827 behaves like migrates the file correctly
828 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
829# [RSpecRunTime] RSpec elapsed time: 1 minute 0.69 second. Current RSS: ~1366M. load average: 1.15 1.37 0.95 1/277 408
830 when object storage is disabled for FileUploader
831 when the file belongs to a legacy project
832 behaves like migrates the file correctly
833 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
834# [RSpecRunTime] RSpec elapsed time: 1 minute 6.19 seconds. Current RSS: ~1364M. load average: 1.22 1.38 0.95 2/277 409
835 when the file belongs to a hashed project
836 behaves like migrates the file correctly
837 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
838# [RSpecRunTime] RSpec elapsed time: 1 minute 11.49 seconds. Current RSS: ~1363M. load average: 1.12 1.36 0.95 1/276 410
839 when object storage is enabled for FileUploader
840 when the file belongs to a legacy project
841 behaves like migrates the file correctly
842 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
843# [RSpecRunTime] RSpec elapsed time: 1 minute 17.15 seconds. Current RSS: ~1364M. load average: 1.19 1.37 0.95 1/276 411
844 when the file belongs to a hashed project
845 behaves like migrates the file correctly
846 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
847# [RSpecRunTime] RSpec elapsed time: 1 minute 22.63 seconds. Current RSS: ~1364M. load average: 1.18 1.37 0.96 1/276 413
848 when legacy uploads are stored in object storage
849 when the upload file does not exist on the filesystem
850 behaves like legacy upload deletion
851 removes the upload record
852# [RSpecRunTime] RSpec elapsed time: 1 minute 27.97 seconds. Current RSS: ~1360M. load average: 1.08 1.34 0.95 1/276 414
853 when the file belongs to a legacy project
854 behaves like migrates the file correctly
855 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
856# [RSpecRunTime] RSpec elapsed time: 1 minute 35.14 seconds. Current RSS: ~1360M. load average: 0.92 1.30 0.94 1/276 415
857 when the file belongs to a hashed project
858 behaves like migrates the file correctly
859 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
860# [RSpecRunTime] RSpec elapsed time: 1 minute 40.36 seconds. Current RSS: ~1391M. load average: 0.92 1.29 0.94 4/277 416
861# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/legacy_upload_mover_spec.rb. It took 1 minute 43.69 seconds. Expected to take 1 minute 29.23 seconds.
862# [RSpecRunTime] RSpec elapsed time: 1 minute 49.48 seconds. Current RSS: ~1367M. load average: 0.93 1.29 0.94 1/276 417
863# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_project_statistics_storage_size_without_pipeline_artifacts_size_job_spec.rb. Expected to take 1 minute 3.17 seconds.
864Gitlab::BackgroundMigration::BackfillProjectStatisticsStorageSizeWithoutPipelineArtifactsSizeJob
865 #perform
866 coerces a null wiki_size to 0
867 coerces a null snippets_size to 0
868 when project_statistics backfill runs
869 when storage_size includes pipeline_artifacts_size
870 removes pipeline_artifacts_size from storage_size
871# [RSpecRunTime] RSpec elapsed time: 2 minutes 49.73 seconds. Current RSS: ~1386M. load average: 1.06 1.28 0.96 1/275 418
872 when storage_size does not include default_pipeline_artifacts_size
873 does not update the record
874# [RSpecRunTime] RSpec elapsed time: 2 minutes 53.3 seconds. Current RSS: ~1384M. load average: 1.06 1.27 0.96 1/275 419
875 #filter_batch
876 filters out project_statistics with no artifacts size
877# [RSpecRunTime] RSpec elapsed time: 2 minutes 56.64 seconds. Current RSS: ~1383M. load average: 1.13 1.28 0.97 1/275 420
878INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree
879INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"
880INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
881INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"
882INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
883INFO: analyzing "public.p_ci_job_annotations" inheritance tree
884INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"
885INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
886INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"
887INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
888INFO: analyzing "public.p_ci_builds_metadata" inheritance tree
889INFO: analyzing "public.ci_builds_metadata"
890INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
891INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"
892INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
893INFO: analyzing "public.p_ci_builds" inheritance tree
894INFO: analyzing "public.ci_builds"
895INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
896INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"
897INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
898I, [2024-04-03T10:38:08.039034 #342] INFO -- : Database: 'main', Table: 'p_ci_finished_build_ch_sync_events': Lock Writes
899INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
900INFO: analyzing "public.ci_pipeline_variables"
901INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
902I, [2024-04-03T10:38:29.547408 #342] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
903I, [2024-04-03T10:38:29.548814 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
904I, [2024-04-03T10:38:29.549665 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
905I, [2024-04-03T10:38:30.067360 #342] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
906INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
907INFO: analyzing "public.ci_job_artifacts"
908INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
909I, [2024-04-03T10:38:31.545033 #342] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
910I, [2024-04-03T10:38:31.546310 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
911I, [2024-04-03T10:38:31.547251 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
912INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
913INFO: analyzing "public.ci_pipeline_variables"
914INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
915INFO: analyzing "public.p_ci_stages" inheritance tree
916INFO: analyzing "public.ci_stages"
917INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
918I, [2024-04-03T10:38:38.132917 #342] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
919I, [2024-04-03T10:38:38.134253 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
920I, [2024-04-03T10:38:38.135209 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
921I, [2024-04-03T10:38:39.884661 #342] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
922# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_project_statistics_storage_size_without_pipeline_artifacts_size_job_spec.rb. It took 2 minutes 4.88 seconds. Expected to take 1 minute 3.17 seconds.
923# [RSpecRunTime] RSpec elapsed time: 3 minutes 54.41 seconds. Current RSS: ~1362M. load average: 1.16 1.26 0.98 1/276 421
924# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_project_repositories_spec.rb. Expected to take 59.86 seconds.
925Gitlab::BackgroundMigration::BackfillProjectRepositories
926 Gitlab::BackgroundMigration::BackfillProjectRepositories::ShardFinder
927 #find_shard_id
928 creates a new shard when it does not exist yet
929 returns the shard when it exists
930 only queries the database once to retrieve shards
931# [RSpecRunTime] RSpec elapsed time: 4 minutes 4.96 seconds. Current RSS: ~1387M. load average: 1.20 1.27 0.99 1/277 422
932 Gitlab::BackgroundMigration::BackfillProjectRepositories::Project
933 .on_hashed_storage
934 finds projects with repository on hashed storage
935# [RSpecRunTime] RSpec elapsed time: 4 minutes 11.48 seconds. Current RSS: ~1387M. load average: 1.18 1.26 0.99 1/277 423
936 .on_legacy_storage
937 finds projects with repository on legacy storage
938# [RSpecRunTime] RSpec elapsed time: 4 minutes 17.71 seconds. Current RSS: ~1383M. load average: 1.17 1.26 0.99 1/277 424
939 .without_project_repository
940 finds projects which do not have a projects_repositories entry
941# [RSpecRunTime] RSpec elapsed time: 4 minutes 24.39 seconds. Current RSS: ~1375M. load average: 1.15 1.25 0.99 1/277 425
942 #disk_path
943 for projects on hashed storage
944 returns the correct disk_path
945# [RSpecRunTime] RSpec elapsed time: 4 minutes 30.79 seconds. Current RSS: ~1374M. load average: 1.13 1.24 0.99 1/277 426
946 for projects on legacy storage
947 returns the correct disk_path
948 returns the correct disk_path using the route entry
949 raises OrphanedNamespaceError when any parent namespace does not exist
950# [RSpecRunTime] RSpec elapsed time: 4 minutes 51.18 seconds. Current RSS: ~1380M. load average: 1.10 1.23 0.99 1/277 427
951# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_project_repositories_spec.rb. It took 1 minute 3.45 seconds. Expected to take 59.86 seconds.
952# [RSpecRunTime] RSpec elapsed time: 4 minutes 57.9 seconds. Current RSS: ~1384M. load average: 1.09 1.22 0.99 1/277 428
953# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/delete_orphaned_packages_dependencies_spec.rb. Expected to take 56.88 seconds.
954Gitlab::BackgroundMigration::DeleteOrphanedPackagesDependencies
955 executes 3 queries
956 deletes only orphaned dependencies
957INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree
958INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"
959INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
960INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"
961INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
962INFO: analyzing "public.p_ci_job_annotations" inheritance tree
963INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"
964INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
965INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"
966INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
967INFO: analyzing "public.p_ci_builds_metadata" inheritance tree
968INFO: analyzing "public.ci_builds_metadata"
969INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
970INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"
971INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
972INFO: analyzing "public.p_ci_builds" inheritance tree
973INFO: analyzing "public.ci_builds"
974INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
975INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"
976INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
977I, [2024-04-03T10:41:09.014657 #342] INFO -- : Database: 'main', Table: 'p_ci_finished_build_ch_sync_events': Lock Writes
978INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
979INFO: analyzing "public.ci_pipeline_variables"
980INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
981I, [2024-04-03T10:41:30.519091 #342] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
982I, [2024-04-03T10:41:30.520847 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
983I, [2024-04-03T10:41:30.521702 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
984I, [2024-04-03T10:41:31.082206 #342] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
985INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
986INFO: analyzing "public.ci_job_artifacts"
987INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
988I, [2024-04-03T10:41:32.567261 #342] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
989I, [2024-04-03T10:41:32.568702 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
990I, [2024-04-03T10:41:32.569708 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
991INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
992INFO: analyzing "public.ci_pipeline_variables"
993INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
994INFO: analyzing "public.p_ci_stages" inheritance tree
995INFO: analyzing "public.ci_stages"
996INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
997I, [2024-04-03T10:41:39.177275 #342] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
998I, [2024-04-03T10:41:39.178507 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
999I, [2024-04-03T10:41:39.179415 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1000I, [2024-04-03T10:41:40.846123 #342] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
1001# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/delete_orphaned_packages_dependencies_spec.rb. It took 1 minute 57.37 seconds. Expected to take 56.88 seconds.
1002# [RSpecRunTime] RSpec elapsed time: 6 minutes 55.32 seconds. Current RSS: ~1392M. load average: 0.88 1.11 0.99 1/277 429
1003# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_code_suggestions_namespace_settings_spec.rb. Expected to take 55.09 seconds.
1004Gitlab::BackgroundMigration::BackfillCodeSuggestionsNamespaceSettings
1005 updates the code suggestions values only for group and user namespace
1006INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree
1007INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"
1008INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1009INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"
1010INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1011INFO: analyzing "public.p_ci_job_annotations" inheritance tree
1012INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"
1013INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1014INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"
1015INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1016INFO: analyzing "public.p_ci_builds_metadata" inheritance tree
1017INFO: analyzing "public.ci_builds_metadata"
1018INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1019INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"
1020INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1021INFO: analyzing "public.p_ci_builds" inheritance tree
1022INFO: analyzing "public.ci_builds"
1023INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1024INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"
1025INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1026I, [2024-04-03T10:43:02.149810 #342] INFO -- : Database: 'main', Table: 'p_ci_finished_build_ch_sync_events': Lock Writes
1027INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1028INFO: analyzing "public.ci_pipeline_variables"
1029INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1030I, [2024-04-03T10:43:24.193277 #342] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
1031I, [2024-04-03T10:43:24.194427 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1032I, [2024-04-03T10:43:24.195234 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1033I, [2024-04-03T10:43:24.712446 #342] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
1034INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
1035INFO: analyzing "public.ci_job_artifacts"
1036INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1037I, [2024-04-03T10:43:26.075178 #342] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
1038I, [2024-04-03T10:43:26.076419 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1039I, [2024-04-03T10:43:26.077289 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1040INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1041INFO: analyzing "public.ci_pipeline_variables"
1042INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1043INFO: analyzing "public.p_ci_stages" inheritance tree
1044INFO: analyzing "public.ci_stages"
1045INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1046I, [2024-04-03T10:43:32.567969 #342] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
1047I, [2024-04-03T10:43:32.569037 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1048I, [2024-04-03T10:43:32.569802 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1049I, [2024-04-03T10:43:34.253295 #342] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
1050# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_code_suggestions_namespace_settings_spec.rb. It took 1 minute 53.49 seconds. Expected to take 55.09 seconds.
1051# [RSpecRunTime] RSpec elapsed time: 8 minutes 48.86 seconds. Current RSS: ~1390M. load average: 0.93 1.07 0.99 1/276 430
1052# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/disable_legacy_open_source_license_for_projects_less_than_one_mb_spec.rb. Expected to take 52.97 seconds.
1053Gitlab::BackgroundMigration::DisableLegacyOpenSourceLicenseForProjectsLessThanOneMb
1054 sets `legacy_open_source_license_available` to false only for projects less than 1 MiB
1055INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree
1056INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"
1057INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1058INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"
1059INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1060INFO: analyzing "public.p_ci_job_annotations" inheritance tree
1061INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"
1062INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1063INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"
1064INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1065INFO: analyzing "public.p_ci_builds_metadata" inheritance tree
1066INFO: analyzing "public.ci_builds_metadata"
1067INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1068INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"
1069INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1070INFO: analyzing "public.p_ci_builds" inheritance tree
1071INFO: analyzing "public.ci_builds"
1072INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1073INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"
1074INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1075I, [2024-04-03T10:44:56.823679 #342] INFO -- : Database: 'main', Table: 'p_ci_finished_build_ch_sync_events': Lock Writes
1076INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1077INFO: analyzing "public.ci_pipeline_variables"
1078INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1079I, [2024-04-03T10:45:18.756608 #342] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
1080I, [2024-04-03T10:45:18.758188 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1081I, [2024-04-03T10:45:18.758986 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1082I, [2024-04-03T10:45:19.279343 #342] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
1083INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
1084INFO: analyzing "public.ci_job_artifacts"
1085INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1086I, [2024-04-03T10:45:20.627533 #342] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
1087I, [2024-04-03T10:45:20.629002 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1088I, [2024-04-03T10:45:20.630044 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1089INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1090INFO: analyzing "public.ci_pipeline_variables"
1091INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1092INFO: analyzing "public.p_ci_stages" inheritance tree
1093INFO: analyzing "public.ci_stages"
1094INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1095I, [2024-04-03T10:45:27.301241 #342] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
1096I, [2024-04-03T10:45:27.302371 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1097I, [2024-04-03T10:45:27.303137 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1098I, [2024-04-03T10:45:28.966814 #342] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
1099# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/disable_legacy_open_source_license_for_projects_less_than_one_mb_spec.rb. It took 1 minute 54.8 seconds. Expected to take 52.97 seconds.
1100# [RSpecRunTime] RSpec elapsed time: 10 minutes 43.7 seconds. Current RSS: ~1387M. load average: 0.96 1.03 1.00 1/276 431
1101# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_missing_ci_cd_settings_spec.rb. Expected to take 51.72 seconds.
1102Gitlab::BackgroundMigration::BackfillMissingCiCdSettings
1103 creates ci_cd_settings with default values
1104 creates ci_cd_settings for projects without ci_cd_settings
1105INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree
1106INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"
1107INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1108INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"
1109INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1110INFO: analyzing "public.p_ci_job_annotations" inheritance tree
1111INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"
1112INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1113INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"
1114INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1115INFO: analyzing "public.p_ci_builds_metadata" inheritance tree
1116INFO: analyzing "public.ci_builds_metadata"
1117INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1118INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"
1119INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1120INFO: analyzing "public.p_ci_builds" inheritance tree
1121INFO: analyzing "public.ci_builds"
1122INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1123INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"
1124INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1125I, [2024-04-03T10:46:53.887876 #342] INFO -- : Database: 'main', Table: 'p_ci_finished_build_ch_sync_events': Lock Writes
1126INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1127INFO: analyzing "public.ci_pipeline_variables"
1128INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1129I, [2024-04-03T10:47:16.590514 #342] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
1130I, [2024-04-03T10:47:16.591966 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1131I, [2024-04-03T10:47:16.592926 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1132I, [2024-04-03T10:47:17.062910 #342] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
1133INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
1134INFO: analyzing "public.ci_job_artifacts"
1135INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1136I, [2024-04-03T10:47:18.418354 #342] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
1137I, [2024-04-03T10:47:18.419439 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1138I, [2024-04-03T10:47:18.420285 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1139INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1140INFO: analyzing "public.ci_pipeline_variables"
1141INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1142INFO: analyzing "public.p_ci_stages" inheritance tree
1143INFO: analyzing "public.ci_stages"
1144INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1145I, [2024-04-03T10:47:25.252290 #342] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
1146I, [2024-04-03T10:47:25.253420 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1147I, [2024-04-03T10:47:25.254487 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1148I, [2024-04-03T10:47:26.976165 #342] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
1149# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_missing_ci_cd_settings_spec.rb. It took 1 minute 57.82 seconds. Expected to take 51.72 seconds.
1150# [RSpecRunTime] RSpec elapsed time: 12 minutes 41.56 seconds. Current RSS: ~1379M. load average: 1.06 1.05 1.01 1/276 432
1151# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/remove_self_managed_wiki_notes_spec.rb. Expected to take 50.8 seconds.
1152Gitlab::BackgroundMigration::RemoveSelfManagedWikiNotes
1153 removes all wiki notes
1154INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree
1155INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"
1156INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1157INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"
1158INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1159INFO: analyzing "public.p_ci_job_annotations" inheritance tree
1160INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"
1161INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1162INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"
1163INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1164INFO: analyzing "public.p_ci_builds_metadata" inheritance tree
1165INFO: analyzing "public.ci_builds_metadata"
1166INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1167INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"
1168INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1169INFO: analyzing "public.p_ci_builds" inheritance tree
1170INFO: analyzing "public.ci_builds"
1171INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1172INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"
1173INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1174I, [2024-04-03T10:48:52.464575 #342] INFO -- : Database: 'main', Table: 'p_ci_finished_build_ch_sync_events': Lock Writes
1175INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1176INFO: analyzing "public.ci_pipeline_variables"
1177INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1178I, [2024-04-03T10:49:15.783589 #342] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
1179I, [2024-04-03T10:49:15.784798 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1180I, [2024-04-03T10:49:15.785600 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1181I, [2024-04-03T10:49:16.320704 #342] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
1182INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
1183INFO: analyzing "public.ci_job_artifacts"
1184INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1185I, [2024-04-03T10:49:17.714607 #342] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
1186I, [2024-04-03T10:49:17.715772 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1187I, [2024-04-03T10:49:17.716593 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1188INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1189INFO: analyzing "public.ci_pipeline_variables"
1190INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1191INFO: analyzing "public.p_ci_stages" inheritance tree
1192INFO: analyzing "public.ci_stages"
1193INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1194I, [2024-04-03T10:49:24.555212 #342] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
1195I, [2024-04-03T10:49:24.557133 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1196I, [2024-04-03T10:49:24.558209 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1197I, [2024-04-03T10:49:26.027413 #342] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
1198# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/remove_self_managed_wiki_notes_spec.rb. It took 1 minute 58.9 seconds. Expected to take 50.8 seconds.
1199# [RSpecRunTime] RSpec elapsed time: 14 minutes 40.51 seconds. Current RSS: ~1371M. load average: 1.02 1.04 1.00 1/276 433
1200# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_users_with_defaults_spec.rb. Expected to take 37.64 seconds.
1201Gitlab::BackgroundMigration::BackfillUsersWithDefaults
1202 backfills the null values with the default values
1203INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree
1204INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"
1205INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1206INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"
1207INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1208INFO: analyzing "public.p_ci_job_annotations" inheritance tree
1209INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"
1210INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1211INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"
1212INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1213INFO: analyzing "public.p_ci_builds_metadata" inheritance tree
1214INFO: analyzing "public.ci_builds_metadata"
1215INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1216INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"
1217INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1218INFO: analyzing "public.p_ci_builds" inheritance tree
1219INFO: analyzing "public.ci_builds"
1220INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1221INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"
1222INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1223I, [2024-04-03T10:50:13.835245 #342] INFO -- : Database: 'main', Table: 'p_ci_finished_build_ch_sync_events': Lock Writes
1224INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1225INFO: analyzing "public.ci_pipeline_variables"
1226INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1227I, [2024-04-03T10:50:36.355993 #342] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
1228I, [2024-04-03T10:50:36.357344 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1229I, [2024-04-03T10:50:36.358300 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1230I, [2024-04-03T10:50:36.875832 #342] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
1231INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
1232INFO: analyzing "public.ci_job_artifacts"
1233INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1234I, [2024-04-03T10:50:38.306769 #342] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
1235I, [2024-04-03T10:50:38.308141 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1236I, [2024-04-03T10:50:38.309226 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1237INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1238INFO: analyzing "public.ci_pipeline_variables"
1239INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1240INFO: analyzing "public.p_ci_stages" inheritance tree
1241INFO: analyzing "public.ci_stages"
1242INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1243I, [2024-04-03T10:50:45.236978 #342] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
1244I, [2024-04-03T10:50:45.238195 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1245I, [2024-04-03T10:50:45.239134 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1246I, [2024-04-03T10:50:46.994574 #342] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
1247# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_users_with_defaults_spec.rb. It took 1 minute 21.08 seconds. Expected to take 37.64 seconds.
1248# [RSpecRunTime] RSpec elapsed time: 16 minutes 1.64 seconds. Current RSS: ~1375M. load average: 1.00 1.03 1.00 1/276 434
1249# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_packages_tags_project_id_spec.rb. Expected to take 30.07 seconds.
1250Gitlab::BackgroundMigration::BackfillPackagesTagsProjectId
1251 backfills the missing project_id for the batch
1252The application_settings (main) table has 1212 columns.
1253Recreating the database
1254Dropped database 'gitlabhq_test'
1255Dropped database 'gitlabhq_test_ci'
1256Created database 'gitlabhq_test'
1257Created database 'gitlabhq_test_ci'
1258main: == [advisory_lock_connection] object_id: 169645180, pg_backend_pid: 295
1259main: == [advisory_lock_connection] object_id: 169645180, pg_backend_pid: 295
1260ci: == [advisory_lock_connection] object_id: 169656120, pg_backend_pid: 297
1261ci: == [advisory_lock_connection] object_id: 169656120, pg_backend_pid: 297
1262Databases re-creation done in 13.13279746299986
1263# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_packages_tags_project_id_spec.rb. It took 41.9 seconds. Expected to take 30.07 seconds.
1264# [RSpecRunTime] RSpec elapsed time: 16 minutes 43.59 seconds. Current RSS: ~1374M. load average: 1.00 1.03 1.00 1/277 437
1265# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/legacy_uploads_migrator_spec.rb. Expected to take 24.97 seconds.
1266Gitlab::BackgroundMigration::LegacyUploadsMigrator
1267 removes all legacy files
1268 removes all Note AttachmentUploader records
1269 creates new uploads for successfully migrated records
1270 does not remove appearance uploads
1271# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/legacy_uploads_migrator_spec.rb. It took 30.59 seconds. Expected to take 24.97 seconds.
1272# [RSpecRunTime] RSpec elapsed time: 17 minutes 14.22 seconds. Current RSS: ~1362M. load average: 0.88 0.99 0.99 1/278 438
1273# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_vs_code_settings_uuid_spec.rb. Expected to take 21.11 seconds.
1274Gitlab::BackgroundMigration::BackfillVsCodeSettingsUuid
1275 #perform
1276 when it finds vs_code_setting rows with empty uuid
1277 populates uuid column with a generated uuid
1278# [RSpecRunTime] RSpec elapsed time: 17 minutes 31.9 seconds. Current RSS: ~1402M. load average: 0.83 0.98 0.99 1/278 439
1279 when it finds vs_code_setting rows with non-empty uuid
1280 populates uuid column with a generated uuid
1281# [RSpecRunTime] RSpec elapsed time: 17 minutes 34.76 seconds. Current RSS: ~1423M. load average: 0.83 0.98 0.99 1/278 440
1282INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1283INFO: analyzing "public.ci_pipeline_variables"
1284INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1285I, [2024-04-03T10:52:36.177183 #342] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
1286I, [2024-04-03T10:52:36.178521 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1287I, [2024-04-03T10:52:36.179532 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1288I, [2024-04-03T10:52:36.736359 #342] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
1289INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
1290INFO: analyzing "public.ci_job_artifacts"
1291INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1292I, [2024-04-03T10:52:38.155392 #342] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
1293I, [2024-04-03T10:52:38.156507 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1294I, [2024-04-03T10:52:38.157470 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1295INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1296INFO: analyzing "public.ci_pipeline_variables"
1297INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1298INFO: analyzing "public.p_ci_stages" inheritance tree
1299INFO: analyzing "public.ci_stages"
1300INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1301I, [2024-04-03T10:52:44.702922 #342] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
1302I, [2024-04-03T10:52:44.704147 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1303I, [2024-04-03T10:52:44.704938 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1304I, [2024-04-03T10:52:46.415755 #342] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
1305# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_vs_code_settings_uuid_spec.rb. It took 46.83 seconds. Expected to take 21.11 seconds.
1306# [RSpecRunTime] RSpec elapsed time: 18 minutes 1.09 seconds. Current RSS: ~1406M. load average: 0.90 0.98 0.99 2/279 441
1307# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_partition_id_ci_pipeline_config_spec.rb. Expected to take 14.2 seconds.
1308Gitlab::BackgroundMigration::BackfillPartitionIdCiPipelineConfig
1309 #perform
1310 when second partition does not exist
1311 does not execute the migration
1312# [RSpecRunTime] RSpec elapsed time: 18 minutes 12.32 seconds. Current RSS: ~1390M. load average: 1.00 1.00 1.00 1/278 442
1313 when second partition exists
1314 fixes invalid records in the wrong the partition
1315# [RSpecRunTime] RSpec elapsed time: 18 minutes 15.22 seconds. Current RSS: ~1416M. load average: 1.00 1.00 1.00 1/278 443
1316I, [2024-04-03T10:53:08.666768 #342] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
1317INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
1318INFO: analyzing "public.ci_job_artifacts"
1319INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1320I, [2024-04-03T10:53:10.283126 #342] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
1321I, [2024-04-03T10:53:10.284595 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1322I, [2024-04-03T10:53:10.285587 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1323INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
1324INFO: analyzing "public.ci_pipeline_variables"
1325INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1326INFO: analyzing "public.p_ci_stages" inheritance tree
1327INFO: analyzing "public.ci_stages"
1328INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
1329I, [2024-04-03T10:53:16.805330 #342] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
1330I, [2024-04-03T10:53:16.806513 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
1331I, [2024-04-03T10:53:16.807370 #342] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
1332I, [2024-04-03T10:53:18.527274 #342] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
1333# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_partition_id_ci_pipeline_config_spec.rb. It took 31.84 seconds. Expected to take 14.2 seconds.
1334# [RSpecRunTime] RSpec elapsed time: 18 minutes 32.98 seconds. Current RSS: ~1384M. load average: 1.00 1.00 1.00 1/278 444
1335# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/fix_incoherent_packages_size_on_project_statistics_spec.rb. Expected to take 12.9 seconds.
1336Gitlab::BackgroundMigration::FixIncoherentPackagesSizeOnProjectStatistics
1337 #perform
1338 with incoherent packages_size
1339 behaves like enqueuing a buffered updates
1340 fixes the packages_size stat
1341# [RSpecRunTime] RSpec elapsed time: 18 minutes 36.44 seconds. Current RSS: ~1395M. load average: 0.92 0.98 0.99 1/278 445
1342 with updates waiting on redis
1343 behaves like enqueuing a buffered updates
1344 fixes the packages_size stat
1345# [RSpecRunTime] RSpec elapsed time: 18 minutes 39.66 seconds. Current RSS: ~1433M. load average: 0.92 0.98 0.99 1/278 446
1346 with no incoherent packages_size
1347 behaves like not updating project statistics
1348 does not change them
1349# [RSpecRunTime] RSpec elapsed time: 18 minutes 43.18 seconds. Current RSS: ~1425M. load average: 0.84 0.97 0.99 1/278 447
1350 #filter_batch
1351 selects all package size statistics
1352# [RSpecRunTime] RSpec elapsed time: 18 minutes 46.35 seconds. Current RSS: ~1420M. load average: 0.86 0.97 0.99 1/278 448
1353# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/fix_incoherent_packages_size_on_project_statistics_spec.rb. It took 20.01 seconds. Expected to take 12.9 seconds.
1354# [RSpecRunTime] RSpec elapsed time: 18 minutes 53.03 seconds. Current RSS: ~1382M. load average: 0.87 0.97 0.99 1/278 449
1355# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/delete_orphans_approval_project_rules2_spec.rb. Expected to take 10.78 seconds.
1356Gitlab::BackgroundMigration::DeleteOrphansApprovalProjectRules2
1357 #perform
1358 delete only approval rules without association with the security project and report_type equals to 4
1359 with rule sources
1360 deletes referenced sources
1361 does not delete unreferenced sources
1362# [RSpecRunTime] RSpec elapsed time: 19 minutes 2.55 seconds. Current RSS: ~1404M. load average: 0.82 0.95 0.98 1/278 450
1363# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/delete_orphans_approval_project_rules2_spec.rb. It took 16.12 seconds. Expected to take 10.78 seconds.
1364# [RSpecRunTime] RSpec elapsed time: 19 minutes 9.19 seconds. Current RSS: ~1374M. load average: 0.83 0.95 0.98 1/278 451
1365# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/delete_orphans_approval_merge_request_rules2_spec.rb. Expected to take 9.13 seconds.
1366Gitlab::BackgroundMigration::DeleteOrphansApprovalMergeRequestRules2
1367 #perform
1368 delete only approval rules without association with the security project and report_type equals to 4 or 2
1369 with rule sources
1370 deletes referenced sources
1371 does not delete unreferenced sources
1372# [RSpecRunTime] RSpec elapsed time: 19 minutes 18.74 seconds. Current RSS: ~1401M. load average: 0.78 0.94 0.98 1/278 452
1373# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/delete_orphans_approval_merge_request_rules2_spec.rb. It took 16.26 seconds. Expected to take 9.13 seconds.
1374# [RSpecRunTime] RSpec elapsed time: 19 minutes 25.5 seconds. Current RSS: ~1375M. load average: 0.74 0.92 0.97 1/278 453
1375# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_has_issues_for_external_issue_links_spec.rb. Expected to take 6.41 seconds.
1376Gitlab::BackgroundMigration::BackfillHasIssuesForExternalIssueLinks
1377 sets has_issues of an existing record
1378 when there exists a record with has_issues
1379 does not modify existing records with has_issues
1380# [RSpecRunTime] RSpec elapsed time: 19 minutes 31.93 seconds. Current RSS: ~1399M. load average: 0.76 0.93 0.97 1/278 454
1381# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_has_issues_for_external_issue_links_spec.rb. It took 12.97 seconds. Expected to take 6.41 seconds.
1382# [RSpecRunTime] RSpec elapsed time: 19 minutes 38.51 seconds. Current RSS: ~1380M. load average: 0.78 0.93 0.98 1/278 455
1383# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/delete_orphans_approval_project_rules_spec.rb. Expected to take 3.8 seconds.
1384Gitlab::BackgroundMigration::DeleteOrphansApprovalProjectRules
1385 #perform
1386 delete only approval rules without association with the security project and report_type equals to 4
1387# [RSpecRunTime] RSpec elapsed time: 19 minutes 41.83 seconds. Current RSS: ~1380M. load average: 0.80 0.93 0.98 1/278 456
1388# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/delete_orphans_approval_project_rules_spec.rb. It took 9.91 seconds. Expected to take 3.8 seconds.
1389# [RSpecRunTime] RSpec elapsed time: 19 minutes 48.47 seconds. Current RSS: ~1375M. load average: 0.81 0.93 0.98 1/278 457
1390# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_sbom_occurrences_traversal_ids_and_archived_spec.rb. Expected to take 3.68 seconds.
1391Gitlab::BackgroundMigration::BackfillSbomOccurrencesTraversalIdsAndArchived
1392 backfills traversal_ids and archived
1393# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_sbom_occurrences_traversal_ids_and_archived_spec.rb. It took 9.62 seconds. Expected to take 3.68 seconds.
1394# [RSpecRunTime] RSpec elapsed time: 19 minutes 58.14 seconds. Current RSS: ~1370M. load average: 0.77 0.92 0.97 1/278 458
1395# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/disable_legacy_open_source_license_for_inactive_public_projects_spec.rb. Expected to take 3.58 seconds.
1396Gitlab::BackgroundMigration::DisableLegacyOpenSourceLicenseForInactivePublicProjects
1397 sets `legacy_open_source_license_available` attribute to false for inactive, public projects
1398# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/disable_legacy_open_source_license_for_inactive_public_projects_spec.rb. It took 9.66 seconds. Expected to take 3.58 seconds.
1399# [RSpecRunTime] RSpec elapsed time: 20 minutes 7.84 seconds. Current RSS: ~1364M. load average: 0.73 0.90 0.97 1/278 459
1400# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_namespace_details_spec.rb. Expected to take 3.42 seconds.
1401Gitlab::BackgroundMigration::BackfillNamespaceDetails
1402 #perform
1403 creates details for all namespaces in range
1404# [RSpecRunTime] RSpec elapsed time: 20 minutes 11.04 seconds. Current RSS: ~1371M. load average: 0.67 0.89 0.96 1/278 460
1405# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_namespace_details_spec.rb. It took 9.64 seconds. Expected to take 3.42 seconds.
1406# [RSpecRunTime] RSpec elapsed time: 20 minutes 17.52 seconds. Current RSS: ~1363M. load average: 0.70 0.89 0.96 1/278 461
1407# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_project_namespace_details_spec.rb. Expected to take 3.31 seconds.
1408Gitlab::BackgroundMigration::BackfillProjectNamespaceDetails
1409 #perform
1410 creates details for all project namespaces in range
1411# [RSpecRunTime] RSpec elapsed time: 20 minutes 20.76 seconds. Current RSS: ~1367M. load average: 0.72 0.89 0.96 1/278 462
1412# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_project_namespace_details_spec.rb. It took 9.87 seconds. Expected to take 3.31 seconds.
1413# [RSpecRunTime] RSpec elapsed time: 20 minutes 27.43 seconds. Current RSS: ~1366M. load average: 0.66 0.88 0.96 1/278 463
1414# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_users_color_mode_id_spec.rb. Expected to take 3.25 seconds.
1415Gitlab::BackgroundMigration::BackfillUsersColorModeId
1416 backfills with the default values
1417# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_users_color_mode_id_spec.rb. It took 9.51 seconds. Expected to take 3.25 seconds.
1418# [RSpecRunTime] RSpec elapsed time: 20 minutes 36.98 seconds. Current RSS: ~1368M. load average: 0.79 0.90 0.96 1/278 464
1419auto_explain log contains 961 entries for main, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-background-migration-pg14-4-5.342.main.ndjson.gz
1420took 17.816605801
1421auto_explain log contains 961 entries for ci, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-background-migration-pg14-4-5.342.ci.ndjson.gz
1422took 18.128443533
1423[TEST PROF INFO] EventProf results for sql.active_record
1424Total time: 13:42.707 of 20:31.234 (66.82%)
1425Total events: 580520
1426Top 5 slowest suites (by time):
1427Gitlab::Backg...nagedWikiNotes (./spec/lib/gitlab/background_migration/remove_self_managed_wiki_notes_spec.rb:5) – 01:31.960 (49710 / 1) of 01:58.945 (77.31%)
1428Gitlab::Backg...ngCiCdSettings (./spec/lib/gitlab/background_migration/backfill_missing_ci_cd_settings_spec.rb:5) – 01:29.911 (49721 / 2) of 01:57.864 (76.28%)
1429Gitlab::Backg...tifactsSizeJob (./spec/lib/gitlab/background_migration/backfill_project_statistics_storage_size_without_pipeline_artifacts_size_job_spec.rb:5) – 01:29.320 (53250 / 5) of 02:04.928 (71.5%)
1430Gitlab::Backg...esDependencies (./spec/lib/gitlab/background_migration/delete_orphaned_packages_dependencies_spec.rb:5) – 01:28.409 (51841 / 2) of 01:57.417 (75.3%)
1431Gitlab::Backg...sLessThanOneMb (./spec/lib/gitlab/background_migration/disable_legacy_open_source_license_for_projects_less_than_one_mb_spec.rb:5) – 01:28.187 (49766 / 1) of 01:54.842 (76.79%)
1432Knapsack report was generated. Preview:
1433{
1434 "spec/lib/gitlab/background_migration/legacy_upload_mover_spec.rb": 95.5296438370001,
1435 "spec/lib/gitlab/background_migration/backfill_project_statistics_storage_size_without_pipeline_artifacts_size_job_spec.rb": 67.27444562400001,
1436 "spec/lib/gitlab/background_migration/backfill_project_repositories_spec.rb": 56.879533699000035,
1437 "spec/lib/gitlab/background_migration/delete_orphaned_packages_dependencies_spec.rb": 55.47617168799991,
1438 "spec/lib/gitlab/background_migration/backfill_code_suggestions_namespace_settings_spec.rb": 50.608965717000046,
1439 "spec/lib/gitlab/background_migration/disable_legacy_open_source_license_for_projects_less_than_one_mb_spec.rb": 51.241473426000084,
1440 "spec/lib/gitlab/background_migration/backfill_missing_ci_cd_settings_spec.rb": 54.472854996000024,
1441 "spec/lib/gitlab/background_migration/remove_self_managed_wiki_notes_spec.rb": 53.32693462700013,
1442 "spec/lib/gitlab/background_migration/backfill_users_with_defaults_spec.rb": 36.664383112999985,
1443 "spec/lib/gitlab/background_migration/backfill_packages_tags_project_id_spec.rb": 28.675825286999952,
1444 "spec/lib/gitlab/background_migration/legacy_uploads_migrator_spec.rb": 22.78527576700003,
1445 "spec/lib/gitlab/background_migration/backfill_vs_code_settings_uuid_spec.rb": 20.690310289999843,
1446 "spec/lib/gitlab/background_migration/backfill_partition_id_ci_pipeline_config_spec.rb": 14.215418401000079,
1447 "spec/lib/gitlab/background_migration/fix_incoherent_packages_size_on_project_statistics_spec.rb": 13.466619856999841,
1448 "spec/lib/gitlab/background_migration/delete_orphans_approval_project_rules2_spec.rb": 9.620466326999804,
1449 "spec/lib/gitlab/background_migration/delete_orphans_approval_merge_request_rules2_spec.rb": 9.650106808999908,
1450 "spec/lib/gitlab/background_migration/backfill_has_issues_for_external_issue_links_spec.rb": 6.526084089000051,
1451 "spec/lib/gitlab/background_migration/delete_orphans_approval_project_rules_spec.rb": 3.4169115500001226,
1452 "spec/lib/gitlab/background_migration/backfill_sbom_occurrences_traversal_ids_and_archived_spec.rb": 3.3872693939999863,
1453 "spec/lib/gitlab/background_migration/disable_legacy_open_source_license_for_inactive_public_projects_spec.rb": 3.4050155019999693,
1454 "spec/lib/gitlab/background_migration/backfill_namespace_details_spec.rb": 3.285753717000034,
1455 "spec/lib/gitlab/background_migration/backfill_project_namespace_details_spec.rb": 3.343191279999928,
1456 "spec/lib/gitlab/background_migration/backfill_users_color_mode_id_spec.rb": 3.225467684000023
1457}
1458Knapsack global time execution for tests: 11m 07s
1459Finished in 21 minutes 13 seconds (files took 1 minute 15.01 seconds to load)
146067 examples, 0 failures
1461Randomized with seed 1588
1462[TEST PROF INFO] Time spent in factories: 01:07.246 (5.27% of total time)
1463RSpec exited with 0.
1464No examples to retry, congrats!
1465 Running after_script 00:06
1466Running after script...
1467$ source scripts/utils.sh
1468$ bundle exec gem list gitlab_quality-test_tooling
1469gitlab_quality-test_tooling (1.21.0)
1470$ section_start "relate-failure-issue" "Report test failures" # collapsed multi-line command
1471 Report test failures 00:00
1472$ section_start "flaky-test-issues" "Report test flakiness" # collapsed multi-line command
1473 Report test flakiness 00:00
1474$ section_start "slow-test-issues" "Report test slowness" # collapsed multi-line command
1475 Report test slowness 00:00
1476$ section_start "slow-test-merge-request-report-note" "Report test slowness in MR note" # collapsed multi-line command
1477 Report test slowness in MR note 00:02
1480$ section_start "knapsack-report-issues" "Report test files close to timing out" # collapsed multi-line command
1481 Report test files close to timing out 00:01
1484$ tooling/bin/push_job_metrics || true
1485[job-metrics] Pushing job metrics file for the CI/CD job.
1486[job-metrics] Pushed 4 CI job metric entries to InfluxDB.
1487 Saving cache for successful job 00:01
1488Not uploading cache ruby-gems-debian-bookworm-ruby-3.1-17 due to policy
1489 Uploading artifacts for successful job 00:05
1490Uploading artifacts...
1491auto_explain/: found 3 matching artifact files and directories
1492coverage/: found 5 matching artifact files and directories
1493crystalball/: found 2 matching artifact files and directories
1494WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
1495knapsack/: found 4 matching artifact files and directories
1496rspec/: found 16 matching artifact files and directories
1497WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
1498log/*.log: found 13 matching artifact files and directories
1499WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/6536639209/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
1500WARNING: Retrying... context=artifacts-uploader error=request redirected
1501Uploading artifacts as "archive" to coordinator... 201 Created id=6536639209 responseStatus=201 Created token=glcbt-65
1502Uploading artifacts...
1503rspec/rspec-*.xml: found 1 matching artifact files and directories
1504WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/6536639209/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
1505WARNING: Retrying... context=artifacts-uploader error=request redirected
1506Uploading artifacts as "junit" to coordinator... 201 Created id=6536639209 responseStatus=201 Created token=glcbt-65
1507 Cleaning up project directory and file based variables 00:01
1508Job succeeded