rspec background_migration pg13 2/4
Passed Started
by
@ohoral
Olena Horal-Koretska
1Running with gitlab-runner 15.9.0~beta.212.g8ccc65e7 (8ccc65e7)2 on green-1.private.runners-manager.gitlab.com/gitlab.com/gitlab-org 4bq1s9yM, system ID: s_9d15f3e4e7ae3 feature flags: FF_NETWORK_PER_BUILD:true, FF_USE_FASTZIP:true, FF_USE_IMPROVED_URL_MASKING:true6Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.19-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 ...7Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-13-pgvector-0.4.1 ...8Authenticating with credentials from job payload (GitLab Registry)9Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-13-pgvector-0.4.1 ...10Using docker image sha256:b643610fd4d2fbdd55447ceb5a6cba0c3d1a26945817741d73e1b51a1ec07d01 for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-13-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:dfccb5b5ddadf4f1a3b9cb72cf21f5b99a28a55c217de34d9fa6b7a45a910031 ...11Starting service redis:6.2-alpine ...12Pulling docker image redis:6.2-alpine ...13Using docker image sha256:a9a47a706682d445577bb5da7328f0faaa0863a5742a315c829faa461dfc23ae for redis:6.2-alpine with digest redis@sha256:317575f05099ea47b1f2855b1bb6e068b52847bfa19b87014d88d57f82d4b8f0 ...14Waiting for services to be up and running (timeout 30 seconds)...15Authenticating with credentials from job payload (GitLab Registry)16Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.19-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 ...17Using docker image sha256:552b81110cdd830e05d17c8e7365f72e1dd96842217d7225636cb55a75777ea7 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.19-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.19-rust-1.65-node-16.14-postgresql-13@sha256:a386dd1acb1341f710f3c3c320984f70512694bcfec8cb1c771365058ac7c475 ...19Running on runner-4bq1s9ym-project-278964-concurrent-0 via runner-4bq1s9ym-private-1682499623-4f84ad28...21$ eval "$CI_PRE_CLONE_SCRIPT"22Fetching changes with git depth set to 20...23Initialized empty Git repository in /builds/gitlab-org/gitlab/.git/24Created fresh repository.25remote: Enumerating objects: 165305, done. 26remote: Counting objects: 100% (165305/165305), done. 27remote: Compressing objects: 100% (99239/99239), done. 28remote: Total 165305 (delta 81744), reused 118324 (delta 59962), pack-reused 0 29Receiving objects: 100% (165305/165305), 131.92 MiB | 30.90 MiB/s, done.30Resolving deltas: 100% (81744/81744), done.32 * [new ref] refs/pipelines/849373675 -> refs/pipelines/84937367533 * [new branch] master -> origin/master34Checking out f463609d as detached HEAD (ref is master)...35Skipping Git submodules setup36$ git remote set-url origin "${CI_REPOSITORY_URL}"38Checking cache for ruby-gems-debian-bullseye-ruby-3.0-16...39Downloading cache.zip from https://storage.googleapis.com/gitlab-com-runners-cache/project/278964/ruby-gems-debian-bullseye-ruby-3.0-16 40Successfully extracted cache42Downloading artifacts for compile-test-assets (4181384009)...43Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4181384009 responseStatus=200 OK token=64_bW7GM44Downloading artifacts for retrieve-tests-metadata (4181384016)...45Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4181384016 responseStatus=200 OK token=64_bW7GM46Downloading artifacts for setup-test-env (4181384014)...47Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4181384014 responseStatus=200 OK token=64_bW7GM49Using docker image sha256:552b81110cdd830e05d17c8e7365f72e1dd96842217d7225636cb55a75777ea7 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.19-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.19-rust-1.65-node-16.14-postgresql-13@sha256:a386dd1acb1341f710f3c3c320984f70512694bcfec8cb1c771365058ac7c475 ...50$ echo $FOSS_ONLY51$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb52$ export GOPATH=$CI_PROJECT_DIR/.go53$ mkdir -p $GOPATH54$ source scripts/utils.sh55$ source scripts/prepare_build.sh711Using decomposed database config (config/database.yml.decomposed-postgresql)712Geo DB won't be set up.713Embedding DB won't be set up.729$ source ./scripts/rspec_helpers.sh730$ run_timed_command "gem install knapsack --no-document"731$ gem install knapsack --no-document732Successfully installed knapsack-4.0.07331 gem installed734$ echo -e "\e[0Ksection_start:`date +%s`:gitaly-test-spawn[collapsed=true]\r\e[0KStarting Gitaly"735==> 'gem install knapsack --no-document' succeeded in 0 seconds.737$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"742$ echo -e "\e[0Ksection_end:`date +%s`:gitaly-test-spawn\r\e[0K"743$ rspec_paralellized_job "--tag ~quarantine --tag ~zoekt"744SKIP_FLAKY_TESTS_AUTOMATICALLY: false745RETRY_FAILED_TESTS_IN_NEW_PROCESS: true746KNAPSACK_GENERATE_REPORT: true747FLAKY_RSPEC_GENERATE_REPORT: true748KNAPSACK_TEST_FILE_PATTERN: spec/{lib/gitlab/background_migration,lib/ee/gitlab/background_migration}{,/**/}*_spec.rb749KNAPSACK_LOG_LEVEL: debug750KNAPSACK_REPORT_PATH: knapsack/rspec_background_migration_pg13_2_4_report.json751FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json752FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec_background_migration_pg13_2_4_report.json753NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec_background_migration_pg13_2_4_report.json754SKIPPED_FLAKY_TESTS_REPORT_PATH: rspec/flaky/skipped_flaky_tests_rspec_background_migration_pg13_2_4_report.txt755CRYSTALBALL: 756RSPEC_TESTS_MAPPING_ENABLED: 757RSPEC_TESTS_FILTER_FILE: 758Knapsack report generator started!759warning: parser/current is loading parser/ruby30, which recognizes 3.0.5-compliant syntax, but you are running 3.0.6.761Run options: exclude {:quarantine=>true, :zoekt=>true}762Test environment set up in 1.295749154 seconds763Gitlab::BackgroundMigration::BackfillEnvironmentTiers764 # order random765main: == [advisory_lock_connection] object_id: 401780, pg_backend_pid: 125766main: == [advisory_lock_connection] object_id: 401780, pg_backend_pid: 125767 #perform768main: == [advisory_lock_connection] object_id: 3134440, pg_backend_pid: 126769main: == [advisory_lock_connection] object_id: 3134440, pg_backend_pid: 126770 backfill tiers for all environments in range771 same behavior with guess tier772 name: "review/feature", tier: 3773main: == [advisory_lock_connection] object_id: 4018780, pg_backend_pid: 127774main: == [advisory_lock_connection] object_id: 4018780, pg_backend_pid: 127775 backfill tiers for all environments in range776 name: "review/product", tier: 3777main: == [advisory_lock_connection] object_id: 4406940, pg_backend_pid: 129778main: == [advisory_lock_connection] object_id: 4406940, pg_backend_pid: 129779 backfill tiers for all environments in range780 name: "DEV", tier: 3781main: == [advisory_lock_connection] object_id: 4799020, pg_backend_pid: 130782main: == [advisory_lock_connection] object_id: 4799020, pg_backend_pid: 130783 backfill tiers for all environments in range784 name: "development", tier: 3785main: == [advisory_lock_connection] object_id: 5202240, pg_backend_pid: 131786main: == [advisory_lock_connection] object_id: 5202240, pg_backend_pid: 131787 backfill tiers for all environments in range788 name: "trunk", tier: 3789main: == [advisory_lock_connection] object_id: 5599220, pg_backend_pid: 132790main: == [advisory_lock_connection] object_id: 5599220, pg_backend_pid: 132791 backfill tiers for all environments in range792 name: "dev", tier: 3793main: == [advisory_lock_connection] object_id: 5995100, pg_backend_pid: 133794main: == [advisory_lock_connection] object_id: 5995100, pg_backend_pid: 133795 backfill tiers for all environments in range796 name: "review/app", tier: 3797main: == [advisory_lock_connection] object_id: 6395920, pg_backend_pid: 134798main: == [advisory_lock_connection] object_id: 6395920, pg_backend_pid: 134799 backfill tiers for all environments in range800 name: "PRODUCTION", tier: 0801main: == [advisory_lock_connection] object_id: 6798000, pg_backend_pid: 135802main: == [advisory_lock_connection] object_id: 6798000, pg_backend_pid: 135803 backfill tiers for all environments in range804 name: "prod", tier: 0805main: == [advisory_lock_connection] object_id: 7200260, pg_backend_pid: 136806main: == [advisory_lock_connection] object_id: 7200260, pg_backend_pid: 136807 backfill tiers for all environments in range808 name: "prod-east-2", tier: 0809main: == [advisory_lock_connection] object_id: 7594060, pg_backend_pid: 137810main: == [advisory_lock_connection] object_id: 7594060, pg_backend_pid: 137811 backfill tiers for all environments in range812 name: "us-prod-east", tier: 0813main: == [advisory_lock_connection] object_id: 7993300, pg_backend_pid: 139814main: == [advisory_lock_connection] object_id: 7993300, pg_backend_pid: 139815 backfill tiers for all environments in range816 name: "fe-production", tier: 0817main: == [advisory_lock_connection] object_id: 8395880, pg_backend_pid: 140818main: == [advisory_lock_connection] object_id: 8395880, pg_backend_pid: 140819 backfill tiers for all environments in range820 name: "test", tier: 2821main: == [advisory_lock_connection] object_id: 8798680, pg_backend_pid: 141822main: == [advisory_lock_connection] object_id: 8798680, pg_backend_pid: 141823 backfill tiers for all environments in range824 name: "TEST", tier: 2825main: == [advisory_lock_connection] object_id: 9200760, pg_backend_pid: 142826main: == [advisory_lock_connection] object_id: 9200760, pg_backend_pid: 142827 backfill tiers for all environments in range828 name: "testing", tier: 2829main: == [advisory_lock_connection] object_id: 9598160, pg_backend_pid: 143830main: == [advisory_lock_connection] object_id: 9598160, pg_backend_pid: 143831 backfill tiers for all environments in range832 name: "testing-prd", tier: 2833main: == [advisory_lock_connection] object_id: 9995200, pg_backend_pid: 144834main: == [advisory_lock_connection] object_id: 9995200, pg_backend_pid: 144835 backfill tiers for all environments in range836 name: "acceptance-testing", tier: 2837main: == [advisory_lock_connection] object_id: 10391220, pg_backend_pid: 145838main: == [advisory_lock_connection] object_id: 10391220, pg_backend_pid: 145839 backfill tiers for all environments in range840 name: "production-test", tier: 2841main: == [advisory_lock_connection] object_id: 10782880, pg_backend_pid: 146842main: == [advisory_lock_connection] object_id: 10782880, pg_backend_pid: 146843 backfill tiers for all environments in range844 name: "test-production", tier: 2845main: == [advisory_lock_connection] object_id: 11174500, pg_backend_pid: 148846main: == [advisory_lock_connection] object_id: 11174500, pg_backend_pid: 148847 backfill tiers for all environments in range848 name: "QC", tier: 2849main: == [advisory_lock_connection] object_id: 11566020, pg_backend_pid: 149850main: == [advisory_lock_connection] object_id: 11566020, pg_backend_pid: 149851 backfill tiers for all environments in range852 name: "qa-env-2", tier: 2853main: == [advisory_lock_connection] object_id: 11966980, pg_backend_pid: 150854main: == [advisory_lock_connection] object_id: 11966980, pg_backend_pid: 150855 backfill tiers for all environments in range856 name: "gstg", tier: 1857main: == [advisory_lock_connection] object_id: 12185100, pg_backend_pid: 151858main: == [advisory_lock_connection] object_id: 12185100, pg_backend_pid: 151859 backfill tiers for all environments in range860 name: "staging", tier: 1861main: == [advisory_lock_connection] object_id: 12544640, pg_backend_pid: 152862main: == [advisory_lock_connection] object_id: 12544640, pg_backend_pid: 152863 backfill tiers for all environments in range864 name: "stage", tier: 1865main: == [advisory_lock_connection] object_id: 12949640, pg_backend_pid: 153866main: == [advisory_lock_connection] object_id: 12949640, pg_backend_pid: 153867 backfill tiers for all environments in range868 name: "Model", tier: 1869main: == [advisory_lock_connection] object_id: 13352800, pg_backend_pid: 154870main: == [advisory_lock_connection] object_id: 13352800, pg_backend_pid: 154871 backfill tiers for all environments in range872 name: "MODL", tier: 1873main: == [advisory_lock_connection] object_id: 13747160, pg_backend_pid: 155874main: == [advisory_lock_connection] object_id: 13747160, pg_backend_pid: 155875 backfill tiers for all environments in range876 name: "Pre-production", tier: 1877main: == [advisory_lock_connection] object_id: 14147760, pg_backend_pid: 156878main: == [advisory_lock_connection] object_id: 14147760, pg_backend_pid: 156879 backfill tiers for all environments in range880 name: "pre", tier: 1881main: == [advisory_lock_connection] object_id: 14551860, pg_backend_pid: 158882main: == [advisory_lock_connection] object_id: 14551860, pg_backend_pid: 158883 backfill tiers for all environments in range884 name: "Demo", tier: 1885main: == [advisory_lock_connection] object_id: 14951240, pg_backend_pid: 159886main: == [advisory_lock_connection] object_id: 14951240, pg_backend_pid: 159887 backfill tiers for all environments in range888 name: "staging", tier: 1889main: == [advisory_lock_connection] object_id: 15346100, pg_backend_pid: 160890main: == [advisory_lock_connection] object_id: 15346100, pg_backend_pid: 160891 backfill tiers for all environments in range892 name: "pre-prod", tier: 1893main: == [advisory_lock_connection] object_id: 15750680, pg_backend_pid: 161894main: == [advisory_lock_connection] object_id: 15750680, pg_backend_pid: 161895 backfill tiers for all environments in range896 name: "blue-kit-stage", tier: 1897main: == [advisory_lock_connection] object_id: 16152760, pg_backend_pid: 162898main: == [advisory_lock_connection] object_id: 16152760, pg_backend_pid: 162899 backfill tiers for all environments in range900 name: "nonprod", tier: 1901main: == [advisory_lock_connection] object_id: 16544720, pg_backend_pid: 163902main: == [advisory_lock_connection] object_id: 16544720, pg_backend_pid: 163903 backfill tiers for all environments in range904 name: "nonlive", tier: 1905main: == [advisory_lock_connection] object_id: 16945120, pg_backend_pid: 164906main: == [advisory_lock_connection] object_id: 16945120, pg_backend_pid: 164907 backfill tiers for all environments in range908 name: "non-prod", tier: 1909main: == [advisory_lock_connection] object_id: 17347200, pg_backend_pid: 165910main: == [advisory_lock_connection] object_id: 17347200, pg_backend_pid: 165911 backfill tiers for all environments in range912 name: "non-live", tier: 1913main: == [advisory_lock_connection] object_id: 17744240, pg_backend_pid: 166914main: == [advisory_lock_connection] object_id: 17744240, pg_backend_pid: 166915 backfill tiers for all environments in range916 name: "gprd", tier: 0917main: == [advisory_lock_connection] object_id: 18140820, pg_backend_pid: 168918main: == [advisory_lock_connection] object_id: 18140820, pg_backend_pid: 168919 backfill tiers for all environments in range920 name: "gprd-cny", tier: 0921main: == [advisory_lock_connection] object_id: 18541020, pg_backend_pid: 169922main: == [advisory_lock_connection] object_id: 18541020, pg_backend_pid: 169923 backfill tiers for all environments in range924 name: "production", tier: 0925main: == [advisory_lock_connection] object_id: 18943100, pg_backend_pid: 170926main: == [advisory_lock_connection] object_id: 18943100, pg_backend_pid: 170927 backfill tiers for all environments in range928 name: "Production", tier: 0929main: == [advisory_lock_connection] object_id: 19346020, pg_backend_pid: 171930main: == [advisory_lock_connection] object_id: 19346020, pg_backend_pid: 171931 backfill tiers for all environments in range932 name: "PRODUCTION", tier: 0933main: == [advisory_lock_connection] object_id: 19743160, pg_backend_pid: 172934main: == [advisory_lock_connection] object_id: 19743160, pg_backend_pid: 172935 backfill tiers for all environments in range936 name: "Production/eu", tier: 0937main: == [advisory_lock_connection] object_id: 20141580, pg_backend_pid: 173938main: == [advisory_lock_connection] object_id: 20141580, pg_backend_pid: 173939 backfill tiers for all environments in range940 name: "production/eu", tier: 0941main: == [advisory_lock_connection] object_id: 20544200, pg_backend_pid: 174942main: == [advisory_lock_connection] object_id: 20544200, pg_backend_pid: 174943 backfill tiers for all environments in range944 name: "PRODUCTION/EU", tier: 0945main: == [advisory_lock_connection] object_id: 20954860, pg_backend_pid: 175946main: == [advisory_lock_connection] object_id: 20954860, pg_backend_pid: 175947 backfill tiers for all environments in range948 name: "productioneu", tier: 0949main: == [advisory_lock_connection] object_id: 21342960, pg_backend_pid: 177950main: == [advisory_lock_connection] object_id: 21342960, pg_backend_pid: 177951 backfill tiers for all environments in range952 name: "store-produce", tier: 0953main: == [advisory_lock_connection] object_id: 21616180, pg_backend_pid: 178954main: == [advisory_lock_connection] object_id: 21616180, pg_backend_pid: 178955 backfill tiers for all environments in range956 name: "unproductive", tier: 0957main: == [advisory_lock_connection] object_id: 21950440, pg_backend_pid: 179958main: == [advisory_lock_connection] object_id: 21950440, pg_backend_pid: 179959 backfill tiers for all environments in range960 name: "production/www.gitlab.com", tier: 0961main: == [advisory_lock_connection] object_id: 22357800, pg_backend_pid: 180962main: == [advisory_lock_connection] object_id: 22357800, pg_backend_pid: 180963 backfill tiers for all environments in range964 name: "prod", tier: 0965main: == [advisory_lock_connection] object_id: 22754720, pg_backend_pid: 181966main: == [advisory_lock_connection] object_id: 22754720, pg_backend_pid: 181967 backfill tiers for all environments in range968 name: "PROD", tier: 0969main: == [advisory_lock_connection] object_id: 23150980, pg_backend_pid: 182970main: == [advisory_lock_connection] object_id: 23150980, pg_backend_pid: 182971 backfill tiers for all environments in range972 name: "Live", tier: 0973main: == [advisory_lock_connection] object_id: 23553060, pg_backend_pid: 183974main: == [advisory_lock_connection] object_id: 23553060, pg_backend_pid: 183975 backfill tiers for all environments in range976 name: "canary", tier: 4977main: == [advisory_lock_connection] object_id: 23956580, pg_backend_pid: 184978main: == [advisory_lock_connection] object_id: 23956580, pg_backend_pid: 184979 backfill tiers for all environments in range980 name: "other", tier: 4981main: == [advisory_lock_connection] object_id: 24349820, pg_backend_pid: 186982main: == [advisory_lock_connection] object_id: 24349820, pg_backend_pid: 186983 backfill tiers for all environments in range984 name: "EXP", tier: 4985main: == [advisory_lock_connection] object_id: 24750520, pg_backend_pid: 187986main: == [advisory_lock_connection] object_id: 24750520, pg_backend_pid: 187987 backfill tiers for all environments in range988 name: "something-else", tier: 4989main: == [advisory_lock_connection] object_id: 25152620, pg_backend_pid: 188990main: == [advisory_lock_connection] object_id: 25152620, pg_backend_pid: 188991 backfill tiers for all environments in range992main: == [advisory_lock_connection] object_id: 25699840, pg_backend_pid: 191993I, [2023-04-26T10:28:05.397939 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes994I, [2023-04-26T10:28:13.106631 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes995I, [2023-04-26T10:28:13.413097 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes996main: == [advisory_lock_connection] object_id: 25699840, pg_backend_pid: 191997ci: == [advisory_lock_connection] object_id: 30842600, pg_backend_pid: 195998ci: == [advisory_lock_connection] object_id: 30842600, pg_backend_pid: 195999Gitlab::BackgroundMigration::LegacyUploadMover1000main: == [advisory_lock_connection] object_id: 31128480, pg_backend_pid: 1971001main: == [advisory_lock_connection] object_id: 31128480, pg_backend_pid: 1971002 when no note found for the upload1003 behaves like legacy upload deletion1004main: == [advisory_lock_connection] object_id: 31128800, pg_backend_pid: 1981005main: == [advisory_lock_connection] object_id: 31128800, pg_backend_pid: 1981006 removes the upload record1007 when upload does not belong to a note1008main: == [advisory_lock_connection] object_id: 31432380, pg_backend_pid: 1991009main: == [advisory_lock_connection] object_id: 31432380, pg_backend_pid: 1991010 does not remove the upload1011 when the upload move fails1012 behaves like move error1013main: == [advisory_lock_connection] object_id: 32216840, pg_backend_pid: 2001014main: == [advisory_lock_connection] object_id: 32216840, pg_backend_pid: 2001015 does not remove the upload file1016 when the upload is in local storage1017 when the upload file does not exist on the filesystem1018 behaves like legacy upload deletion1019main: == [advisory_lock_connection] object_id: 32999840, pg_backend_pid: 2011020main: == [advisory_lock_connection] object_id: 32999840, pg_backend_pid: 2011021 removes the upload record1022 when an upload belongs to a legacy_diff_note1023 when the file does not exist for the upload1024 behaves like move error1025main: == [advisory_lock_connection] object_id: 33790920, pg_backend_pid: 2021026main: == [advisory_lock_connection] object_id: 33790920, pg_backend_pid: 2021027 does not remove the upload file1028 when the file does not exist on expected path1029 behaves like move error1030main: == [advisory_lock_connection] object_id: 34713320, pg_backend_pid: 2041031main: == [advisory_lock_connection] object_id: 34713320, pg_backend_pid: 2041032 does not remove the upload file1033 when the file path does not include system/note/attachment1034 behaves like move error1035main: == [advisory_lock_connection] object_id: 35570120, pg_backend_pid: 2051036main: == [advisory_lock_connection] object_id: 35570120, pg_backend_pid: 2051037 does not remove the upload file1038 when the file move raises an error1039 behaves like move error1040main: == [advisory_lock_connection] object_id: 36428980, pg_backend_pid: 2061041main: == [advisory_lock_connection] object_id: 36428980, pg_backend_pid: 2061042 does not remove the upload file1043 when upload has mount_point nil1044 behaves like migrates the file correctly1045main: == [advisory_lock_connection] object_id: 37310140, pg_backend_pid: 2071046main: == [advisory_lock_connection] object_id: 37310140, pg_backend_pid: 2071047 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record1048 when the file can be handled correctly1049 behaves like migrates the file correctly1050main: == [advisory_lock_connection] object_id: 37914740, pg_backend_pid: 2091051main: == [advisory_lock_connection] object_id: 37914740, pg_backend_pid: 2091052 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record1053 when object storage is disabled for FileUploader1054 when the file belongs to a legacy project1055 behaves like migrates the file correctly1056main: == [advisory_lock_connection] object_id: 38850180, pg_backend_pid: 2101057main: == [advisory_lock_connection] object_id: 38850180, pg_backend_pid: 2101058 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record1059 when the file belongs to a hashed project1060 behaves like migrates the file correctly1061main: == [advisory_lock_connection] object_id: 39647360, pg_backend_pid: 2111062main: == [advisory_lock_connection] object_id: 39647360, pg_backend_pid: 2111063 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record1064 when object storage is enabled for FileUploader1065 when the file belongs to a legacy project1066 behaves like migrates the file correctly1067main: == [advisory_lock_connection] object_id: 40491200, pg_backend_pid: 2121068main: == [advisory_lock_connection] object_id: 40491200, pg_backend_pid: 2121069 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record1070 when the file belongs to a hashed project1071 behaves like migrates the file correctly1072main: == [advisory_lock_connection] object_id: 41324980, pg_backend_pid: 2131073main: == [advisory_lock_connection] object_id: 41324980, pg_backend_pid: 2131074 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record1075 when legacy uploads are stored in object storage1076 when the upload file does not exist on the filesystem1077 behaves like legacy upload deletion1078main: == [advisory_lock_connection] object_id: 42148580, pg_backend_pid: 2151079main: == [advisory_lock_connection] object_id: 42148580, pg_backend_pid: 2151080 removes the upload record1081 when the file belongs to a legacy project1082 behaves like migrates the file correctly1083main: == [advisory_lock_connection] object_id: 42921740, pg_backend_pid: 2161084main: == [advisory_lock_connection] object_id: 42921740, pg_backend_pid: 2161085 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record1086 when the file belongs to a hashed project1087 behaves like migrates the file correctly1088main: == [advisory_lock_connection] object_id: 43731020, pg_backend_pid: 2171089main: == [advisory_lock_connection] object_id: 43731020, pg_backend_pid: 2171090 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record1091main: == [advisory_lock_connection] object_id: 44680020, pg_backend_pid: 2201092main: == [advisory_lock_connection] object_id: 44680020, pg_backend_pid: 2201093ci: == [advisory_lock_connection] object_id: 44865120, pg_backend_pid: 2241094ci: == [advisory_lock_connection] object_id: 44865120, pg_backend_pid: 2241095Gitlab::BackgroundMigration::BackfillNamespaceIdForNamespaceRoute1096main: == [advisory_lock_connection] object_id: 44865240, pg_backend_pid: 2251097main: == [advisory_lock_connection] object_id: 44865240, pg_backend_pid: 2251098main: == [advisory_lock_connection] object_id: 53497000, pg_backend_pid: 2271099main: == [advisory_lock_connection] object_id: 53497000, pg_backend_pid: 2271100 backfills `type` for the selected records1101main: == [advisory_lock_connection] object_id: 53784540, pg_backend_pid: 2281102main: == [advisory_lock_connection] object_id: 53784540, pg_backend_pid: 2281103 tracks timings of queries1104main: == [advisory_lock_connection] object_id: 54242440, pg_backend_pid: 2321105I, [2023-04-26T10:30:56.949039 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1106I, [2023-04-26T10:31:03.117962 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1107I, [2023-04-26T10:31:03.415728 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1108main: == [advisory_lock_connection] object_id: 54242440, pg_backend_pid: 2321109ci: == [advisory_lock_connection] object_id: 65964420, pg_backend_pid: 2371110ci: == [advisory_lock_connection] object_id: 65964420, pg_backend_pid: 2371111Gitlab::BackgroundMigration::BackfillDraftStatusOnMergeRequestsWithCorrectedRegex1112main: == [advisory_lock_connection] object_id: 66253260, pg_backend_pid: 2381113main: == [advisory_lock_connection] object_id: 66253260, pg_backend_pid: 2381114 for MRs with #draft? == true titles but draft attribute false1115main: == [advisory_lock_connection] object_id: 74089540, pg_backend_pid: 2401116main: == [advisory_lock_connection] object_id: 74089540, pg_backend_pid: 2401117 updates all eligible draft merge request's draft field to true1118main: == [advisory_lock_connection] object_id: 75170060, pg_backend_pid: 2411119main: == [advisory_lock_connection] object_id: 75170060, pg_backend_pid: 2411120 marks successful slices as completed1121 behaves like marks background migration job records1122main: == [advisory_lock_connection] object_id: 75601980, pg_backend_pid: 2421123main: == [advisory_lock_connection] object_id: 75601980, pg_backend_pid: 2421124 marks each job record as succeeded after processing1125main: == [advisory_lock_connection] object_id: 76024900, pg_backend_pid: 2431126main: == [advisory_lock_connection] object_id: 76024900, pg_backend_pid: 2431127 returns the number of job records marked as succeeded1128main: == [advisory_lock_connection] object_id: 76634960, pg_backend_pid: 2471129I, [2023-04-26T10:32:13.166841 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1130I, [2023-04-26T10:32:19.244136 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1131I, [2023-04-26T10:32:19.481095 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1132main: == [advisory_lock_connection] object_id: 76634960, pg_backend_pid: 2471133ci: == [advisory_lock_connection] object_id: 88415900, pg_backend_pid: 2521134ci: == [advisory_lock_connection] object_id: 88415900, pg_backend_pid: 2521135Gitlab::BackgroundMigration::MigratePersonalNamespaceProjectMaintainerToOwner1136main: == [advisory_lock_connection] object_id: 88611180, pg_backend_pid: 2531137main: == [advisory_lock_connection] object_id: 88611180, pg_backend_pid: 2531138main: == [advisory_lock_connection] object_id: 96875320, pg_backend_pid: 2551139main: == [advisory_lock_connection] object_id: 96875320, pg_backend_pid: 2551140 migrates MAINTAINER membership records for personal namespaces to OWNER1141main: == [advisory_lock_connection] object_id: 97528080, pg_backend_pid: 2561142main: == [advisory_lock_connection] object_id: 97528080, pg_backend_pid: 2561143 tracks timings of queries1144main: == [advisory_lock_connection] object_id: 98020320, pg_backend_pid: 2591145I, [2023-04-26T10:33:30.541427 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1146I, [2023-04-26T10:33:37.189601 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1147I, [2023-04-26T10:33:37.431467 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1148main: == [advisory_lock_connection] object_id: 98020320, pg_backend_pid: 2591149ci: == [advisory_lock_connection] object_id: 109864280, pg_backend_pid: 2651150ci: == [advisory_lock_connection] object_id: 109864280, pg_backend_pid: 2651151Gitlab::BackgroundMigration::MergeTopicsWithSameName1152 # order random1153main: == [advisory_lock_connection] object_id: 110017700, pg_backend_pid: 2661154main: == [advisory_lock_connection] object_id: 110017700, pg_backend_pid: 2661155main: == [advisory_lock_connection] object_id: 117779880, pg_backend_pid: 2681156main: == [advisory_lock_connection] object_id: 117779880, pg_backend_pid: 2681157 merges project topics with same case insensitive name1158main: == [advisory_lock_connection] object_id: 119162940, pg_backend_pid: 2711159I, [2023-04-26T10:34:42.974571 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1160I, [2023-04-26T10:34:49.499559 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1161I, [2023-04-26T10:34:49.770378 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1162main: == [advisory_lock_connection] object_id: 119162940, pg_backend_pid: 2711163ci: == [advisory_lock_connection] object_id: 131007960, pg_backend_pid: 2761164ci: == [advisory_lock_connection] object_id: 131007960, pg_backend_pid: 2761165Gitlab::BackgroundMigration::BackfillIntegrationsEnableSslVerification1166main: == [advisory_lock_connection] object_id: 131164040, pg_backend_pid: 2771167main: == [advisory_lock_connection] object_id: 131164040, pg_backend_pid: 2771168main: == [advisory_lock_connection] object_id: 138742960, pg_backend_pid: 2791169main: == [advisory_lock_connection] object_id: 138742960, pg_backend_pid: 2791170 enables SSL verification for known-good hostnames1171main: == [advisory_lock_connection] object_id: 139938120, pg_backend_pid: 2811172main: == [advisory_lock_connection] object_id: 139938120, pg_backend_pid: 2811173 only updates records within the given ID range1174main: == [advisory_lock_connection] object_id: 140396640, pg_backend_pid: 2821175main: == [advisory_lock_connection] object_id: 140396640, pg_backend_pid: 2821176 marks the job as succeeded1177main: == [advisory_lock_connection] object_id: 140971300, pg_backend_pid: 2851178I, [2023-04-26T10:35:55.609429 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1179I, [2023-04-26T10:36:02.095752 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1180I, [2023-04-26T10:36:02.339543 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1181main: == [advisory_lock_connection] object_id: 140971300, pg_backend_pid: 2851182ci: == [advisory_lock_connection] object_id: 152501620, pg_backend_pid: 2901183ci: == [advisory_lock_connection] object_id: 152501620, pg_backend_pid: 2901184Gitlab::BackgroundMigration::BackfillMemberNamespaceForGroupMembers1185main: == [advisory_lock_connection] object_id: 152760300, pg_backend_pid: 2911186main: == [advisory_lock_connection] object_id: 152760300, pg_backend_pid: 2911187main: == [advisory_lock_connection] object_id: 161246820, pg_backend_pid: 2931188main: == [advisory_lock_connection] object_id: 161246820, pg_backend_pid: 2931189 backfills `member_namespace_id` for the selected records1190main: == [advisory_lock_connection] object_id: 161678320, pg_backend_pid: 2941191main: == [advisory_lock_connection] object_id: 161678320, pg_backend_pid: 2941192 tracks timings of queries1193main: == [advisory_lock_connection] object_id: 162127820, pg_backend_pid: 2971194I, [2023-04-26T10:37:12.875098 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1195I, [2023-04-26T10:37:19.177636 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1196I, [2023-04-26T10:37:19.404770 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1197main: == [advisory_lock_connection] object_id: 162127820, pg_backend_pid: 2971198ci: == [advisory_lock_connection] object_id: 173856740, pg_backend_pid: 3031199ci: == [advisory_lock_connection] object_id: 173856740, pg_backend_pid: 3031200Gitlab::BackgroundMigration::PopulateVulnerabilityReads1201 # order random1202main: == [advisory_lock_connection] object_id: 174125300, pg_backend_pid: 3041203main: == [advisory_lock_connection] object_id: 174125300, pg_backend_pid: 3041204main: == [advisory_lock_connection] object_id: 181966180, pg_backend_pid: 3061205main: == [advisory_lock_connection] object_id: 181966180, pg_backend_pid: 3061206 does not create new records when records already exists1207main: == [advisory_lock_connection] object_id: 183052980, pg_backend_pid: 3071208main: == [advisory_lock_connection] object_id: 183052980, pg_backend_pid: 3071209 creates vulnerability_reads for the given records1210The application_settings (main) table has 1238 columns.1211Recreating the database1212Dropped database 'gitlabhq_test'1213Dropped database 'gitlabhq_test_ci'1214Created database 'gitlabhq_test'1215Created database 'gitlabhq_test_ci'1216main: == [advisory_lock_connection] object_id: 183511360, pg_backend_pid: 3181217main: == [advisory_lock_connection] object_id: 183511360, pg_backend_pid: 3181218ci: == [advisory_lock_connection] object_id: 183541780, pg_backend_pid: 3201219ci: == [advisory_lock_connection] object_id: 183541780, pg_backend_pid: 3201220ci: == [advisory_lock_connection] object_id: 183596560, pg_backend_pid: 3221221ci: == [advisory_lock_connection] object_id: 183596560, pg_backend_pid: 3221222Databases re-creation done in 10.255041270000221223Gitlab::BackgroundMigration::BackfillProjectMemberNamespaceId1224main: == [advisory_lock_connection] object_id: 183776460, pg_backend_pid: 3251225main: == [advisory_lock_connection] object_id: 183776460, pg_backend_pid: 3251226main: == [advisory_lock_connection] object_id: 191006720, pg_backend_pid: 3271227main: == [advisory_lock_connection] object_id: 191006720, pg_backend_pid: 3271228 backfills `member_namespace_id` for the selected records1229main: == [advisory_lock_connection] object_id: 192300500, pg_backend_pid: 3281230main: == [advisory_lock_connection] object_id: 192300500, pg_backend_pid: 3281231 tracks timings of queries1232 when given a negative pause_ms1233main: == [advisory_lock_connection] object_id: 192692660, pg_backend_pid: 3291234main: == [advisory_lock_connection] object_id: 192692660, pg_backend_pid: 3291235 uses 0 as a floor for pause_ms1236main: == [advisory_lock_connection] object_id: 193236160, pg_backend_pid: 3321237I, [2023-04-26T10:39:06.307470 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1238I, [2023-04-26T10:39:13.423503 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1239I, [2023-04-26T10:39:13.696635 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1240main: == [advisory_lock_connection] object_id: 193236160, pg_backend_pid: 3321241ci: == [advisory_lock_connection] object_id: 204325220, pg_backend_pid: 3371242ci: == [advisory_lock_connection] object_id: 204325220, pg_backend_pid: 3371243Gitlab::BackgroundMigration::DestroyInvalidGroupMembers1244main: == [advisory_lock_connection] object_id: 204567600, pg_backend_pid: 3381245main: == [advisory_lock_connection] object_id: 204567600, pg_backend_pid: 3381246main: == [advisory_lock_connection] object_id: 209463100, pg_backend_pid: 3401247main: == [advisory_lock_connection] object_id: 209463100, pg_backend_pid: 3401248 removes invalid memberships but keeps valid ones1249main: == [advisory_lock_connection] object_id: 210773520, pg_backend_pid: 3421250main: == [advisory_lock_connection] object_id: 210773520, pg_backend_pid: 3421251 tracks timings of queries1252main: == [advisory_lock_connection] object_id: 211135640, pg_backend_pid: 3431253main: == [advisory_lock_connection] object_id: 211135640, pg_backend_pid: 3431254 logs IDs of deleted records1255main: == [advisory_lock_connection] object_id: 211681680, pg_backend_pid: 3461256I, [2023-04-26T10:40:08.802424 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1257I, [2023-04-26T10:40:15.149014 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1258I, [2023-04-26T10:40:15.417779 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1259main: == [advisory_lock_connection] object_id: 211681680, pg_backend_pid: 3461260ci: == [advisory_lock_connection] object_id: 220205600, pg_backend_pid: 3501261ci: == [advisory_lock_connection] object_id: 220205600, pg_backend_pid: 3501262Gitlab::BackgroundMigration::PopulateTopicsNonPrivateProjectsCount1263 # order random1264main: == [advisory_lock_connection] object_id: 220394380, pg_backend_pid: 3521265main: == [advisory_lock_connection] object_id: 220394380, pg_backend_pid: 3521266main: == [advisory_lock_connection] object_id: 228780580, pg_backend_pid: 3541267main: == [advisory_lock_connection] object_id: 228780580, pg_backend_pid: 3541268 correctly populates the non private projects counters1269main: == [advisory_lock_connection] object_id: 229388960, pg_backend_pid: 3571270I, [2023-04-26T10:41:26.303731 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1271I, [2023-04-26T10:41:33.219704 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1272I, [2023-04-26T10:41:33.469596 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1273main: == [advisory_lock_connection] object_id: 229388960, pg_backend_pid: 3571274ci: == [advisory_lock_connection] object_id: 241202880, pg_backend_pid: 3621275ci: == [advisory_lock_connection] object_id: 241202880, pg_backend_pid: 3621276Gitlab::BackgroundMigration::EncryptIntegrationProperties1277 # order random1278main: == [advisory_lock_connection] object_id: 241422820, pg_backend_pid: 3631279main: == [advisory_lock_connection] object_id: 241422820, pg_backend_pid: 3631280main: == [advisory_lock_connection] object_id: 248869960, pg_backend_pid: 3661281main: == [advisory_lock_connection] object_id: 248869960, pg_backend_pid: 3661282 ensures all properties are encrypted1283main: == [advisory_lock_connection] object_id: 250368120, pg_backend_pid: 3691284I, [2023-04-26T10:42:38.500890 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1285I, [2023-04-26T10:42:45.385646 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1286I, [2023-04-26T10:42:45.635027 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1287main: == [advisory_lock_connection] object_id: 250368120, pg_backend_pid: 3691288ci: == [advisory_lock_connection] object_id: 262143040, pg_backend_pid: 3741289ci: == [advisory_lock_connection] object_id: 262143040, pg_backend_pid: 3741290Gitlab::BackgroundMigration::BackfillNamespaceIdOfVulnerabilityReads1291main: == [advisory_lock_connection] object_id: 262332120, pg_backend_pid: 3751292main: == [advisory_lock_connection] object_id: 262332120, pg_backend_pid: 3751293main: == [advisory_lock_connection] object_id: 267449980, pg_backend_pid: 3771294main: == [advisory_lock_connection] object_id: 267449980, pg_backend_pid: 3771295 sets the namespace_id of existing record1296main: == [advisory_lock_connection] object_id: 268926900, pg_backend_pid: 3801297I, [2023-04-26T10:43:36.930088 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1298I, [2023-04-26T10:43:43.192668 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1299I, [2023-04-26T10:43:43.446228 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1300main: == [advisory_lock_connection] object_id: 268926900, pg_backend_pid: 3801301ci: == [advisory_lock_connection] object_id: 277825480, pg_backend_pid: 3851302ci: == [advisory_lock_connection] object_id: 277825480, pg_backend_pid: 3851303Gitlab::BackgroundMigration::DisableLegacyOpenSourceLicenseForOneMemberNoRepoProjects1304main: == [advisory_lock_connection] object_id: 277982020, pg_backend_pid: 3861305main: == [advisory_lock_connection] object_id: 277982020, pg_backend_pid: 3861306main: == [advisory_lock_connection] object_id: 283127140, pg_backend_pid: 3881307main: == [advisory_lock_connection] object_id: 283127140, pg_backend_pid: 3881308WARNING: Active Record does not support composite primary key.1309project_authorizations has composite primary key. Composite primary key is ignored.1310 sets `legacy_open_source_license_available` to false only for public projects with 1 member and no repo1311main: == [advisory_lock_connection] object_id: 284632140, pg_backend_pid: 3911312I, [2023-04-26T10:44:34.980967 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1313I, [2023-04-26T10:44:41.412858 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1314I, [2023-04-26T10:44:41.671487 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1315main: == [advisory_lock_connection] object_id: 284632140, pg_backend_pid: 3911316ci: == [advisory_lock_connection] object_id: 293594880, pg_backend_pid: 3951317ci: == [advisory_lock_connection] object_id: 293594880, pg_backend_pid: 3951318Gitlab::BackgroundMigration::TruncateOverlongVulnerabilityHtmlTitles1319 # order random1320main: == [advisory_lock_connection] object_id: 293746900, pg_backend_pid: 3961321main: == [advisory_lock_connection] object_id: 293746900, pg_backend_pid: 3961322 #perform1323main: == [advisory_lock_connection] object_id: 296850780, pg_backend_pid: 3981324main: == [advisory_lock_connection] object_id: 296850780, pg_backend_pid: 3981325 truncates the vulnerability html title when longer than 800 characters1326main: == [advisory_lock_connection] object_id: 298007600, pg_backend_pid: 4011327I, [2023-04-26T10:45:20.704517 #324] INFO -- : Database: 'main', Table: 'ci_runner_machines': Lock Writes1328I, [2023-04-26T10:45:27.132935 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1329I, [2023-04-26T10:45:27.379019 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1330main: == [advisory_lock_connection] object_id: 298007600, pg_backend_pid: 4011331ci: == [advisory_lock_connection] object_id: 303919360, pg_backend_pid: 4051332ci: == [advisory_lock_connection] object_id: 303919360, pg_backend_pid: 4051333Gitlab::BackgroundMigration::BackfillProjectImportLevel1334main: == [advisory_lock_connection] object_id: 304083700, pg_backend_pid: 4061335main: == [advisory_lock_connection] object_id: 304083700, pg_backend_pid: 4061336 Groups1337main: == [advisory_lock_connection] object_id: 304083860, pg_backend_pid: 4071338main: == [advisory_lock_connection] object_id: 304083860, pg_backend_pid: 4071339 does not update `User` namespaces or values outside range1340main: == [advisory_lock_connection] object_id: 304085060, pg_backend_pid: 4081341main: == [advisory_lock_connection] object_id: 304085060, pg_backend_pid: 4081342 maintains default import_level if creation_level is nil1343 namespace_id: lazy { group_namespace_0.id }, prev_level: 50, new_level: 01344main: == [advisory_lock_connection] object_id: 304516140, pg_backend_pid: 4091345main: == [advisory_lock_connection] object_id: 304516140, pg_backend_pid: 4091346 backfills the correct project_import_level of Group namespaces1347 namespace_id: lazy { group_namespace_1.id }, prev_level: 50, new_level: 401348main: == [advisory_lock_connection] object_id: 304944900, pg_backend_pid: 4101349main: == [advisory_lock_connection] object_id: 304944900, pg_backend_pid: 4101350 backfills the correct project_import_level of Group namespaces1351 namespace_id: lazy { group_namespace_2.id }, prev_level: 50, new_level: 301352main: == [advisory_lock_connection] object_id: 305374420, pg_backend_pid: 4121353main: == [advisory_lock_connection] object_id: 305374420, pg_backend_pid: 4121354 backfills the correct project_import_level of Group namespaces1355main: == [advisory_lock_connection] object_id: 305964980, pg_backend_pid: 4151356main: == [advisory_lock_connection] object_id: 305964980, pg_backend_pid: 4151357ci: == [advisory_lock_connection] object_id: 306233620, pg_backend_pid: 4181358ci: == [advisory_lock_connection] object_id: 306233620, pg_backend_pid: 4181359Gitlab::BackgroundMigration::RebalancePartitionId1360 # order random1361main: == [advisory_lock_connection] object_id: 306233820, pg_backend_pid: 4191362main: == [advisory_lock_connection] object_id: 306233820, pg_backend_pid: 4191363 #perform1364 table_name: :ci_pipelines, invalid_record: #<#<Class:0x00007f1a02211740> id: 2, ref: nil, sha: nil, before_sha: nil, created_at: "2023-04-26 10:25:28.925525105 +0000", updated_at: "2023-04-26 10:25:28.925525105 +0000", tag: false, yaml_errors: nil, committed_at: nil, project_id: nil, status: nil, started_at: nil, finished_at: nil, duration: nil, user_id: nil, lock_version: 0, auto_canceled_by_id: nil, pipeline_schedule_id: nil, source: nil, config_source: nil, protected: nil, failure_reason: nil, iid: nil, merge_request_id: nil, source_sha: nil, target_sha: nil, external_pull_request_id: nil, ci_ref_id: nil, locked: 1, partition_id: 101>, valid_record: #<#<Class:0x00007f1a01e15600> id: 1, ref: nil, sha: nil, before_sha: nil, created_at: "2023-04-26 10:25:28.945219814 +0000", updated_at: "2023-04-26 10:25:28.945219814 +0000", tag: false, yaml_errors: nil, committed_at: nil, project_id: nil, status: nil, started_at: nil, finished_at: nil, duration: nil, user_id: nil, lock_version: 0, auto_canceled_by_id: nil, pipeline_schedule_id: nil, source: nil, config_source: nil, protected: nil, failure_reason: nil, iid: nil, merge_request_id: nil, source_sha: nil, target_sha: nil, external_pull_request_id: nil, ci_ref_id: nil, locked: 1, partition_id: 100>1365 behaves like fix invalid records1366main: == [advisory_lock_connection] object_id: 308262940, pg_backend_pid: 4211367main: == [advisory_lock_connection] object_id: 308262940, pg_backend_pid: 4211368 rebalances partition_id to 100 when partition_id is 1011369main: == [advisory_lock_connection] object_id: 308956580, pg_backend_pid: 4241370I, [2023-04-26T10:46:19.894558 #324] INFO -- : Database: 'main', Table: 'p_ci_runner_machine_builds': Lock Writes1371I, [2023-04-26T10:46:20.210548 #324] INFO -- : Database: 'main', Table: 'ci_cost_settings': Lock Writes1372main: == [advisory_lock_connection] object_id: 308956580, pg_backend_pid: 4241373ci: == [advisory_lock_connection] object_id: 312735700, pg_backend_pid: 4281374ci: == [advisory_lock_connection] object_id: 312735700, pg_backend_pid: 4281375Gitlab::BackgroundMigration::FixIncoherentPackagesSizeOnProjectStatistics1376 # order random1377main: == [advisory_lock_connection] object_id: 312859520, pg_backend_pid: 4291378main: == [advisory_lock_connection] object_id: 312859520, pg_backend_pid: 4291379 #filter_batch1380main: == [advisory_lock_connection] object_id: 312859600, pg_backend_pid: 4301381main: == [advisory_lock_connection] object_id: 312859600, pg_backend_pid: 4301382 selects all package size statistics1383 #perform1384 with incoherent packages_size1385 behaves like enqueuing a buffered updates1386main: == [advisory_lock_connection] object_id: 312860860, pg_backend_pid: 4311387main: == [advisory_lock_connection] object_id: 312860860, pg_backend_pid: 4311388 fixes the packages_size stat1389 with updates waiting on redis1390 behaves like enqueuing a buffered updates1391main: == [advisory_lock_connection] object_id: 313298120, pg_backend_pid: 4321392main: == [advisory_lock_connection] object_id: 313298120, pg_backend_pid: 4321393 fixes the packages_size stat1394 with no incoherent packages_size1395 behaves like not updating project statistics1396main: == [advisory_lock_connection] object_id: 313751360, pg_backend_pid: 4331397main: == [advisory_lock_connection] object_id: 313751360, pg_backend_pid: 4331398 does not change them1399main: == [advisory_lock_connection] object_id: 314380480, pg_backend_pid: 4361400main: == [advisory_lock_connection] object_id: 314380480, pg_backend_pid: 4361401ci: == [advisory_lock_connection] object_id: 314632100, pg_backend_pid: 4401402ci: == [advisory_lock_connection] object_id: 314632100, pg_backend_pid: 4401403Gitlab::BackgroundMigration::DeleteOrphanedPackagesDependencies1404 # order random1405main: == [advisory_lock_connection] object_id: 314632260, pg_backend_pid: 4411406main: == [advisory_lock_connection] object_id: 314632260, pg_backend_pid: 4411407main: == [advisory_lock_connection] object_id: 315424840, pg_backend_pid: 4421408main: == [advisory_lock_connection] object_id: 315424840, pg_backend_pid: 4421409 executes 3 queries1410main: == [advisory_lock_connection] object_id: 316271780, pg_backend_pid: 4431411main: == [advisory_lock_connection] object_id: 316271780, pg_backend_pid: 4431412 deletes only orphaned dependencies1413main: == [advisory_lock_connection] object_id: 316899840, pg_backend_pid: 4461414main: == [advisory_lock_connection] object_id: 316899840, pg_backend_pid: 4461415ci: == [advisory_lock_connection] object_id: 318826200, pg_backend_pid: 4501416ci: == [advisory_lock_connection] object_id: 318826200, pg_backend_pid: 4501417Gitlab::BackgroundMigration::SetCorrectVulnerabilityState1418main: == [advisory_lock_connection] object_id: 319112540, pg_backend_pid: 4511419main: == [advisory_lock_connection] object_id: 319112540, pg_backend_pid: 4511420 #filter_batch1421main: == [advisory_lock_connection] object_id: 319112620, pg_backend_pid: 4521422main: == [advisory_lock_connection] object_id: 319112620, pg_backend_pid: 4521423 filters out vulnerabilities where dismissed_at is null1424 #perform1425main: == [advisory_lock_connection] object_id: 319113860, pg_backend_pid: 4531426main: == [advisory_lock_connection] object_id: 319113860, pg_backend_pid: 4531427 changes vulnerability state to `dismissed` when dismissed_at is not nil1428main: == [advisory_lock_connection] object_id: 319519360, pg_backend_pid: 4541429main: == [advisory_lock_connection] object_id: 319519360, pg_backend_pid: 4541430 does not change the state when dismissed_at is nil1431main: == [advisory_lock_connection] object_id: 320066440, pg_backend_pid: 4581432main: == [advisory_lock_connection] object_id: 320066440, pg_backend_pid: 4581433ci: == [advisory_lock_connection] object_id: 320339700, pg_backend_pid: 4611434ci: == [advisory_lock_connection] object_id: 320339700, pg_backend_pid: 4611435Gitlab::BackgroundMigration::BackfillDesignManagementRepositories1436 # order random1437main: == [advisory_lock_connection] object_id: 320339840, pg_backend_pid: 4621438main: == [advisory_lock_connection] object_id: 320339840, pg_backend_pid: 4621439 #perform1440main: == [advisory_lock_connection] object_id: 320341140, pg_backend_pid: 4631441main: == [advisory_lock_connection] object_id: 320341140, pg_backend_pid: 4631442 creates design_management_repositories entries for all projects in range1443 when project_id already exists in design_management_repositories1444main: == [advisory_lock_connection] object_id: 320708420, pg_backend_pid: 4641445main: == [advisory_lock_connection] object_id: 320708420, pg_backend_pid: 4641446 doesn't duplicate project_id1447main: == [advisory_lock_connection] object_id: 321298560, pg_backend_pid: 4671448main: == [advisory_lock_connection] object_id: 321298560, pg_backend_pid: 4671449ci: == [advisory_lock_connection] object_id: 321871380, pg_backend_pid: 4711450ci: == [advisory_lock_connection] object_id: 321871380, pg_backend_pid: 4711451Gitlab::BackgroundMigration::UpdateCiPipelineArtifactsUnknownLockedStatus1452 # order random1453main: == [advisory_lock_connection] object_id: 321993780, pg_backend_pid: 4721454main: == [advisory_lock_connection] object_id: 321993780, pg_backend_pid: 4721455 #perform1456main: == [advisory_lock_connection] object_id: 321993880, pg_backend_pid: 4731457main: == [advisory_lock_connection] object_id: 321993880, pg_backend_pid: 4731458 updates ci_pipeline_artifacts with unknown lock status1459main: == [advisory_lock_connection] object_id: 322228280, pg_backend_pid: 4761460main: == [advisory_lock_connection] object_id: 322228280, pg_backend_pid: 4761461ci: == [advisory_lock_connection] object_id: 322411480, pg_backend_pid: 4791462ci: == [advisory_lock_connection] object_id: 322411480, pg_backend_pid: 4791463Gitlab::BackgroundMigration::EncryptCiTriggerToken1464 # order random1465main: == [advisory_lock_connection] object_id: 322411600, pg_backend_pid: 4801466main: == [advisory_lock_connection] object_id: 322411600, pg_backend_pid: 4801467main: == [advisory_lock_connection] object_id: 322411660, pg_backend_pid: 4811468main: == [advisory_lock_connection] object_id: 322411660, pg_backend_pid: 4811469 ensures all unencrypted tokens are encrypted1470main: == [advisory_lock_connection] object_id: 322668180, pg_backend_pid: 4851471main: == [advisory_lock_connection] object_id: 322668180, pg_backend_pid: 4851472ci: == [advisory_lock_connection] object_id: 322811260, pg_backend_pid: 4881473ci: == [advisory_lock_connection] object_id: 322811260, pg_backend_pid: 4881474Gitlab::BackgroundMigration::BatchingStrategies::DismissedVulnerabilitiesStrategy#next_batch1475main: == [advisory_lock_connection] object_id: 322811340, pg_backend_pid: 4891476main: == [advisory_lock_connection] object_id: 322811340, pg_backend_pid: 4891477main: == [advisory_lock_connection] object_id: 322811400, pg_backend_pid: 4901478main: == [advisory_lock_connection] object_id: 322811400, pg_backend_pid: 4901479 is expected to be < Gitlab::BackgroundMigration::BatchingStrategies::PrimaryKeyBatchingStrategy1480main: == [advisory_lock_connection] object_id: 322888440, pg_backend_pid: 4931481main: == [advisory_lock_connection] object_id: 322888440, pg_backend_pid: 4931482ci: == [advisory_lock_connection] object_id: 323182260, pg_backend_pid: 4961483ci: == [advisory_lock_connection] object_id: 323182260, pg_backend_pid: 4961484Gitlab::BackgroundMigration::DeleteOrphansApprovalMergeRequestRules1485 # order random1486main: == [advisory_lock_connection] object_id: 323182480, pg_backend_pid: 4971487main: == [advisory_lock_connection] object_id: 323182480, pg_backend_pid: 4971488 #perform1489main: == [advisory_lock_connection] object_id: 323182520, pg_backend_pid: 4981490main: == [advisory_lock_connection] object_id: 323182520, pg_backend_pid: 4981491 delete only approval rules without association with the security project and report_type equals to 41492main: == [advisory_lock_connection] object_id: 323308620, pg_backend_pid: 5021493main: == [advisory_lock_connection] object_id: 323308620, pg_backend_pid: 5021494ci: == [advisory_lock_connection] object_id: 323608660, pg_backend_pid: 5051495ci: == [advisory_lock_connection] object_id: 323608660, pg_backend_pid: 5051496Gitlab::BackgroundMigration::UpdateDelayedProjectRemovalToNullForUserNamespaces1497main: == [advisory_lock_connection] object_id: 323608860, pg_backend_pid: 5061498main: == [advisory_lock_connection] object_id: 323608860, pg_backend_pid: 5061499main: == [advisory_lock_connection] object_id: 323608920, pg_backend_pid: 5071500main: == [advisory_lock_connection] object_id: 323608920, pg_backend_pid: 5071501 updates `delayed_project_removal` column to null for user namespaces1502main: == [advisory_lock_connection] object_id: 323758200, pg_backend_pid: 5101503main: == [advisory_lock_connection] object_id: 323758200, pg_backend_pid: 5101504ci: == [advisory_lock_connection] object_id: 324023320, pg_backend_pid: 5131505ci: == [advisory_lock_connection] object_id: 324023320, pg_backend_pid: 5131506Knapsack report was generated. Preview:1507{1508 "spec/lib/gitlab/background_migration/backfill_environment_tiers_spec.rb": 146.46527736100052,1509 "spec/lib/gitlab/background_migration/legacy_upload_mover_spec.rb": 74.01052766000066,1510 "spec/lib/gitlab/background_migration/backfill_namespace_id_for_namespace_route_spec.rb": 38.14477207100026,1511 "spec/lib/gitlab/background_migration/backfill_draft_status_on_merge_requests_with_corrected_regex_spec.rb": 33.81525826300003,1512 "spec/lib/gitlab/background_migration/migrate_personal_namespace_project_maintainer_to_owner_spec.rb": 31.868339753000328,1513 "spec/lib/gitlab/background_migration/merge_topics_with_same_name_spec.rb": 28.358264534999762,1514 "spec/lib/gitlab/background_migration/backfill_integrations_enable_ssl_verification_spec.rb": 30.727191122000477,1515 "spec/lib/gitlab/background_migration/backfill_member_namespace_for_group_members_spec.rb": 30.457998711999608,1516 "spec/lib/gitlab/background_migration/populate_vulnerability_reads_spec.rb": 30.25329375900037,1517 "spec/lib/gitlab/background_migration/backfill_project_member_namespace_id_spec.rb": 29.95379509200029,1518 "spec/lib/gitlab/background_migration/destroy_invalid_group_members_spec.rb": 25.883840324999255,1519 "spec/lib/gitlab/background_migration/populate_topics_non_private_projects_count_spec.rb": 30.556744653999885,1520 "spec/lib/gitlab/background_migration/encrypt_integration_properties_spec.rb": 27.857016443000248,1521 "spec/lib/gitlab/background_migration/backfill_namespace_id_of_vulnerability_reads_spec.rb": 21.47267786500015,1522 "spec/lib/gitlab/background_migration/disable_legacy_open_source_license_for_one_member_no_repo_projects_spec.rb": 21.746767313999953,1523 "spec/lib/gitlab/background_migration/truncate_overlong_vulnerability_html_titles_spec.rb": 16.863950721000037,1524 "spec/lib/gitlab/background_migration/backfill_project_import_level_spec.rb": 12.438797011000133,1525 "spec/lib/gitlab/background_migration/rebalance_partition_id_spec.rb": 11.876193994999994,1526 "spec/lib/gitlab/background_migration/fix_incoherent_packages_size_on_project_statistics_spec.rb": 10.818386766000003,1527 "spec/lib/gitlab/background_migration/delete_orphaned_packages_dependencies_spec.rb": 10.53852434700002,1528 "spec/lib/gitlab/background_migration/set_correct_vulnerability_state_spec.rb": 8.715772698000364,1529 "spec/lib/gitlab/background_migration/backfill_design_management_repositories_spec.rb": 7.046599716999481,1530 "spec/lib/gitlab/background_migration/update_ci_pipeline_artifacts_unknown_locked_status_spec.rb": 3.0902780609994807,1531 "spec/lib/gitlab/background_migration/encrypt_ci_trigger_token_spec.rb": 3.0067512390005504,1532 "spec/lib/gitlab/background_migration/batching_strategies/dismissed_vulnerabilities_strategy_spec.rb": 4.017818270000134,1533 "spec/lib/gitlab/background_migration/delete_orphans_approval_merge_request_rules_spec.rb": 3.2514330700005303,1534 "spec/lib/gitlab/background_migration/update_delayed_project_removal_to_null_for_user_namespaces_spec.rb": 2.9428312130003181535}1536Knapsack global time execution for tests: 11m 36s1537Finished in 23 minutes 17 seconds (files took 40.14 seconds to load)1538122 examples, 0 failures1539Randomized with seed 504301540[TEST PROF INFO] Time spent in factories: 00:34.039 (2.43% of total time)1541RSpec exited with 0.1542No examples to retry, congrats!1544Not uploading cache ruby-gems-debian-bullseye-ruby-3.0-16 due to policy1546Uploading artifacts...1547coverage/: found 5 matching artifact files and directories 1548WARNING: crystalball/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab) 1549WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab) 1550knapsack/: found 4 matching artifact files and directories 1551query_recorder/: found 2 matching artifact files and directories 1552rspec/: found 8 matching artifact files and directories 1553WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab) 1554log/*.log: found 13 matching artifact files and directories 1555WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/4181384104/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com1556WARNING: Retrying... context=artifacts-uploader error=request redirected1557Uploading artifacts as "archive" to coordinator... 201 Created id=4181384104 responseStatus=201 Created token=64_bW7GM1558Uploading artifacts...1559rspec/junit_rspec.xml: found 1 matching artifact files and directories 1560WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/4181384104/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com1561WARNING: Retrying... context=artifacts-uploader error=request redirected1562Uploading artifacts as "junit" to coordinator... 201 Created id=4181384104 responseStatus=201 Created token=64_bW7GM1564Job succeeded