rspec migration pg14 single-db-ci-connection 9/15
Passed Started
by
@krasio

Krasimir Angelov
1Running with gitlab-runner 17.0.0~pre.88.g761ae5dd (761ae5dd)2 on green-4.private.runners-manager.gitlab.com/gitlab.com/gitlab-org rpvz2FF9, system ID: s_d704414ba02a3 feature flags: FF_NETWORK_PER_BUILD:true4Resolving secrets6Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.patched-golang-1.21-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...7Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...8Authenticating with credentials from job payload (GitLab Registry)9Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...10Using docker image sha256:82f132c22567f8ce17cc132c14b2f9aa3eaf9bb5424d91c2d966912433f0257d for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:c55e1364ee4327b244a9cfa1750f19feea14fc774eaf792b725967d146eb45f5 ...11WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.12WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.13Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...14Authenticating with credentials from job payload (GitLab Registry)15Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...16Using docker image sha256:5c5ba5b83d6c60cb0b225bd670b7a43be8c238cc72347d24af57e5027c3648f3 for registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:46aceab84c42d0e819c8e7940f2f98ce9e184785cd7b22d95872024a35f52407 ...17Starting service redis:6.2-alpine ...18Pulling docker image redis:6.2-alpine ...19Using docker image sha256:0fc0b666ef9eb249e61edd4e2ec434a328e98117079727c5e7cf6dc9a00d7a94 for redis:6.2-alpine with digest redis@sha256:c6abddbb4223951cf5cb54a19d4a83418582fa69c97c0458ab4f0974f24f119c ...20Waiting for services to be up and running (timeout 30 seconds)...21Authenticating with credentials from job payload (GitLab Registry)22Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.patched-golang-1.21-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...23Using docker image sha256:d10d211334d3c94a5e626cf961467431b7d3f3bd8b6109e5caf9357421c0117b for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.patched-golang-1.21-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.patched-golang-1.21-rust-1.73-node-20.12-postgresql-14@sha256:3c4cd9a237deb59350b4836552151ba2aae96247034074c8f0c2ccaff4558cab ...25Running on runner-rpvz2ff9-project-278964-concurrent-0 via runner-rpvz2ff9-private-1717022599-2274c08a...27Skipping Git repository setup28Skipping Git checkout29Skipping Git submodules setup31Checking cache for ruby-gems-debian-bookworm-ruby-3.2-17...32Downloading cache from https://storage.googleapis.com/gitlab-com-runners-cache/project/278964/ruby-gems-debian-bookworm-ruby-3.2-17 33Successfully extracted cache35Downloading artifacts for clone-gitlab-repo (6975007209)...36Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6975007209 responseStatus=200 OK token=glcbt-6537WARNING: Part of .git directory is on the list of files to extract 38WARNING: This may introduce unexpected problems 39Downloading artifacts for compile-test-assets (6975007223)...40Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6975007223 responseStatus=200 OK token=glcbt-6541Downloading artifacts for detect-tests (6975007229)...42Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6975007229 responseStatus=200 OK token=glcbt-6543Downloading artifacts for retrieve-tests-metadata (6975007235)...44Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6975007235 responseStatus=200 OK token=glcbt-6545Downloading artifacts for setup-test-env (6975007225)...46Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6975007225 responseStatus=200 OK token=glcbt-65 47 Executing "step_script" stage of the job script 48Using docker image sha256:d10d211334d3c94a5e626cf961467431b7d3f3bd8b6109e5caf9357421c0117b for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.patched-golang-1.21-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.patched-golang-1.21-rust-1.73-node-20.12-postgresql-14@sha256:3c4cd9a237deb59350b4836552151ba2aae96247034074c8f0c2ccaff4558cab ...49$ echo $FOSS_ONLY50$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb51$ export GOPATH=$CI_PROJECT_DIR/.go52$ mkdir -p $GOPATH53$ source scripts/utils.sh54$ source scripts/prepare_build.sh755Using two connections, single database config (config/database.yml.postgresql)756Geo DB won't be set up.757Embedding DB won't be set up.769$ source ./scripts/rspec_helpers.sh770$ run_timed_command "gem install knapsack --no-document"771$ gem install knapsack --no-document772Successfully installed knapsack-4.0.07731 gem installed774==> 'gem install knapsack --no-document' succeeded in 1 seconds.775$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"780$ export RSPEC_SKIPPED_TESTS_REPORT_PATH="rspec/skipped_tests-${CI_JOB_ID}.txt"781$ export RSPEC_RETRIED_TESTS_REPORT_PATH="rspec/retried_tests-${CI_JOB_ID}.txt"782$ tooling/bin/create_job_metrics_file || true783[job-metrics] Creating the job metrics file for the CI/CD job.784$ rspec_section rspec_parallelized_job "--fail-fast=${RSPEC_FAIL_FAST_THRESHOLD} --tag ~quarantine --tag ~zoekt --tag ~click_house"786[23:32:30] Starting rspec_parallelized_job787RETRY_FAILED_TESTS_IN_NEW_PROCESS: true788KNAPSACK_GENERATE_REPORT: true789FLAKY_RSPEC_GENERATE_REPORT: true790KNAPSACK_TEST_FILE_PATTERN: spec/{migrations}{,/**/}*_spec.rb791KNAPSACK_LOG_LEVEL: debug792KNAPSACK_REPORT_PATH: knapsack/rspec_migration_pg14_single-db-ci-connection_9_15_278964_report.json793FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json794FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec_migration_pg14_single-db-ci-connection_9_15_278964_report.json795NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec_migration_pg14_single-db-ci-connection_9_15_278964_report.json796RSPEC_SKIPPED_TESTS_REPORT_PATH: rspec/skipped_tests-6975007435.txt797CRYSTALBALL: 798RSPEC_TESTS_MAPPING_ENABLED: 799RSPEC_TESTS_FILTER_FILE: 800Shell set options (set -o) enabled:801braceexpand on802hashall on803interactive-comments on804pipefail on805Knapsack report generator started!806warning: parser/current is loading parser/ruby32, which recognizes 3.2.3-compliant syntax, but you are running 3.2.4.808Run options: exclude {:quarantine=>true, :zoekt=>true, :click_house=>true}809# [RSpecRunTime] Starting RSpec timer...810[TEST PROF INFO] EventProf enabled (sql.active_record)811unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.812Test environment set up in 2.203071467 seconds813# [RSpecRunTime] Starting example group spec/migrations/20230816152639_swap_design_user_mentions_note_id_to_big_int_for_self_managed_spec.rb. Expected to take 3 minutes 33.6 seconds.814SwapDesignUserMentionsNoteIdToBigIntForSelfManaged815 #up816 when GitLab.com, dev, or test817 behaves like column `note_id_convert_to_bigint` is already dropped818 does not swap the columns819 when self-managed instance with the `note_id_convert_to_bigint` column already dropped820 behaves like column `note_id_convert_to_bigint` is already dropped821 does not swap the columns822# [RSpecRunTime] RSpec elapsed time: 2 minutes 47.74 seconds. Current RSS: ~1168M. Threads: 2. load average: 1.02 1.20 1.17 1/288 392823.824 when self-managed instance columns already swapped825 does not swaps the columns826# [RSpecRunTime] RSpec elapsed time: 3 minutes 11.67 seconds. Current RSS: ~1144M. Threads: 2. load average: 1.01 1.18 1.16 1/288 393827.828 when self-managed instance829 swaps the columns830# [RSpecRunTime] RSpec elapsed time: 3 minutes 55.82 seconds. Current RSS: ~1141M. Threads: 2. load average: 1.00 1.16 1.15 1/288 394831.832INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree833INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"834INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows835INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"836INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows837INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_102"838INFO: "ci_runner_machine_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows839INFO: analyzing "public.p_ci_job_annotations" inheritance tree840INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"841INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows842INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"843INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows844INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_102"845INFO: "ci_job_annotations_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows846INFO: analyzing "public.p_ci_builds_metadata" inheritance tree847INFO: analyzing "public.ci_builds_metadata"848INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows849INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"850INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows851INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_102"852INFO: "ci_builds_metadata_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows853INFO: analyzing "public.p_ci_builds" inheritance tree854INFO: analyzing "public.ci_builds"855INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows856INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"857INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows858INFO: analyzing "gitlab_partitions_dynamic.ci_builds_102"859INFO: "ci_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows860INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree861INFO: analyzing "public.ci_pipeline_variables"862INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows863INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree864INFO: analyzing "public.ci_pipeline_variables"865INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows866INFO: analyzing "public.p_ci_job_artifacts" inheritance tree867INFO: analyzing "public.ci_job_artifacts"868INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows869INFO: analyzing "public.p_ci_stages" inheritance tree870INFO: analyzing "public.ci_stages"871INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows872# [RSpecRunTime] Finishing example group spec/migrations/20230816152639_swap_design_user_mentions_note_id_to_big_int_for_self_managed_spec.rb. It took 5 minutes 14.24 seconds. Expected to take 3 minutes 33.6 seconds.873# [RSpecRunTime] RSpec elapsed time: 5 minutes 20.51 seconds. Current RSS: ~1111M. Threads: 2. load average: 0.86 1.08 1.12 1/288 395874.875# [RSpecRunTime] Starting example group spec/migrations/20230906204935_restart_self_hosted_sent_notifications_backfill_spec.rb. Expected to take 2 minutes 55.02 seconds.876RestartSelfHostedSentNotificationsBackfill877 #up878 when is self-hosted879 when id is integer880 when a backfill has never been done881 when there is a record of an incomplete backfill882 calls delete_batched_background_migration and does not raise an error883# [RSpecRunTime] RSpec elapsed time: 6 minutes 55.94 seconds. Current RSS: ~1179M. Threads: 2. load average: 1.24 1.13 1.14 1/288 396884.885 when there is no previous record of a backfill886 begins a backfill887# [RSpecRunTime] RSpec elapsed time: 7 minutes 18.59 seconds. Current RSS: ~1170M. Threads: 2. load average: 1.16 1.12 1.13 1/288 397888.889 when a backfill has previously been done890 does not start a backfill891# [RSpecRunTime] RSpec elapsed time: 7 minutes 40.9 seconds. Current RSS: ~1167M. Threads: 2. load average: 1.27 1.15 1.14 1/288 398892.893 when id is a bigint894 does not start a backfill895# [RSpecRunTime] RSpec elapsed time: 8 minutes 2.16 seconds. Current RSS: ~1165M. Threads: 2. load average: 1.20 1.14 1.13 1/288 399896.897 when is not self-hosted898 does not start a backfill899# [RSpecRunTime] RSpec elapsed time: 8 minutes 23.41 seconds. Current RSS: ~1165M. Threads: 2. load average: 1.18 1.14 1.14 1/288 400900.901INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree902INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"903INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows904INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"905INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows906INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_102"907INFO: "ci_runner_machine_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows908INFO: analyzing "public.p_ci_job_annotations" inheritance tree909INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"910INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows911INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"912INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows913INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_102"914INFO: "ci_job_annotations_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows915INFO: analyzing "public.p_ci_builds_metadata" inheritance tree916INFO: analyzing "public.ci_builds_metadata"917INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows918INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"919INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows920INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_102"921INFO: "ci_builds_metadata_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows922INFO: analyzing "public.p_ci_builds" inheritance tree923INFO: analyzing "public.ci_builds"924INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows925INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"926INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows927INFO: analyzing "gitlab_partitions_dynamic.ci_builds_102"928INFO: "ci_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows929INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree930INFO: analyzing "public.ci_pipeline_variables"931INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows932INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree933INFO: analyzing "public.ci_pipeline_variables"934INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows935INFO: analyzing "public.p_ci_job_artifacts" inheritance tree936INFO: analyzing "public.ci_job_artifacts"937INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows938INFO: analyzing "public.p_ci_stages" inheritance tree939INFO: analyzing "public.ci_stages"940INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows941# [RSpecRunTime] Finishing example group spec/migrations/20230906204935_restart_self_hosted_sent_notifications_backfill_spec.rb. It took 4 minutes 22.46 seconds. Expected to take 2 minutes 55.02 seconds.942# [RSpecRunTime] RSpec elapsed time: 9 minutes 43.01 seconds. Current RSS: ~1119M. Threads: 2. load average: 0.97 1.09 1.12 1/288 401943.944# [RSpecRunTime] Starting example group spec/migrations/20240108072545_fix_invalid_records_ci_job_artifact_states_spec.rb. Expected to take 2 minutes 9.29 seconds.945FixInvalidRecordsCiJobArtifactStates946 when FKs exist947ci: == [advisory_lock_connection] object_id: 86931960, pg_backend_pid: 182948ci: == 20240108072545 FixInvalidRecordsCiJobArtifactStates: migrating =============949ci: == 20240108072545 FixInvalidRecordsCiJobArtifactStates: migrated (0.0490s) ====950ci: == [advisory_lock_connection] object_id: 86931960, pg_backend_pid: 182951 does not remove records952# [RSpecRunTime] RSpec elapsed time: 10 minutes 47.18 seconds. Current RSS: ~1163M. Threads: 2. load average: 0.98 1.07 1.10 1/290 402953.954 with missing FKs955ci: == [advisory_lock_connection] object_id: 87747780, pg_backend_pid: 188956ci: == 20240108072545 FixInvalidRecordsCiJobArtifactStates: migrating =============957ci: == 20240108072545 FixInvalidRecordsCiJobArtifactStates: migrated (0.0881s) ====958ci: == [advisory_lock_connection] object_id: 87747780, pg_backend_pid: 188959 removes orphan records960 with invalid FKs961ci: == [advisory_lock_connection] object_id: 88395340, pg_backend_pid: 195962ci: == 20240108072545 FixInvalidRecordsCiJobArtifactStates: migrating =============963ci: == 20240108072545 FixInvalidRecordsCiJobArtifactStates: migrated (0.0637s) ====964ci: == [advisory_lock_connection] object_id: 88395340, pg_backend_pid: 195965 removes orphan records966# [RSpecRunTime] RSpec elapsed time: 11 minutes 13.33 seconds. Current RSS: ~1145M. Threads: 2. load average: 0.99 1.06 1.10 1/290 403967.968INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree969INFO: analyzing "public.ci_pipeline_variables"970INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows971INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree972INFO: analyzing "public.ci_pipeline_variables"973INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows974INFO: analyzing "public.p_ci_job_artifacts" inheritance tree975INFO: "ci_job_artifacts": scanned 1 of 1 pages, containing 0 live rows and 3 dead rows; 0 rows in sample, 0 estimated total rows976INFO: analyzing "public.ci_job_artifacts"977INFO: "ci_job_artifacts": scanned 1 of 1 pages, containing 0 live rows and 3 dead rows; 0 rows in sample, 0 estimated total rows978INFO: analyzing "public.p_ci_stages" inheritance tree979INFO: analyzing "public.ci_stages"980INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows981# [RSpecRunTime] Finishing example group spec/migrations/20240108072545_fix_invalid_records_ci_job_artifact_states_spec.rb. It took 2 minutes 23.66 seconds. Expected to take 2 minutes 9.29 seconds.982# [RSpecRunTime] RSpec elapsed time: 12 minutes 6.71 seconds. Current RSS: ~1129M. Threads: 2. load average: 1.02 1.06 1.09 1/290 404983.984# [RSpecRunTime] Starting example group spec/migrations/20230802085923_queue_fix_allow_descendants_override_disabled_shared_runners_spec.rb. Expected to take 1 minute 53.16 seconds.985QueueFixAllowDescendantsOverrideDisabledSharedRunners986main: == [advisory_lock_connection] object_id: 119041300, pg_backend_pid: 210987main: == 20230802085923 QueueFixAllowDescendantsOverrideDisabledSharedRunners: migrating 988main: == 20230802085923 QueueFixAllowDescendantsOverrideDisabledSharedRunners: migrated (0.0661s) 989main: == [advisory_lock_connection] object_id: 119041300, pg_backend_pid: 210990 schedules a new batched migration991INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree992INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"993INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows994INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"995INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows996INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_102"997INFO: "ci_runner_machine_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows998INFO: analyzing "public.p_ci_job_annotations" inheritance tree999INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"1000INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1001INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"1002INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1003INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_102"1004INFO: "ci_job_annotations_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1005INFO: analyzing "public.p_ci_builds_metadata" inheritance tree1006INFO: analyzing "public.ci_builds_metadata"1007INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1008INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"1009INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1010INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_102"1011INFO: "ci_builds_metadata_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1012INFO: analyzing "public.p_ci_builds" inheritance tree1013INFO: analyzing "public.ci_builds"1014INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1015INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"1016INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1017INFO: analyzing "gitlab_partitions_dynamic.ci_builds_102"1018INFO: "ci_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1019INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree1020INFO: analyzing "public.ci_pipeline_variables"1021INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1022INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree1023INFO: analyzing "public.ci_pipeline_variables"1024INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1025INFO: analyzing "public.p_ci_job_artifacts" inheritance tree1026INFO: "ci_job_artifacts": scanned 1 of 1 pages, containing 0 live rows and 3 dead rows; 0 rows in sample, 0 estimated total rows1027INFO: analyzing "public.ci_job_artifacts"1028INFO: "ci_job_artifacts": scanned 1 of 1 pages, containing 0 live rows and 3 dead rows; 0 rows in sample, 0 estimated total rows1029INFO: analyzing "public.p_ci_stages" inheritance tree1030INFO: analyzing "public.ci_stages"1031INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1032# [RSpecRunTime] Finishing example group spec/migrations/20230802085923_queue_fix_allow_descendants_override_disabled_shared_runners_spec.rb. It took 3 minutes 26.64 seconds. Expected to take 1 minute 53.16 seconds.1033# [RSpecRunTime] RSpec elapsed time: 15 minutes 33.39 seconds. Current RSS: ~1136M. Threads: 2. load average: 1.01 1.02 1.07 1/288 4051034.1035# [RSpecRunTime] Starting example group spec/migrations/20230809203254_ensure_issue_user_mentions_bigint_backfill_is_finished_for_self_managed_spec.rb. Expected to take 1 minute 45.25 seconds.1036EnsureIssueUserMentionsBigintBackfillIsFinishedForSelfManaged1037 #up1038main: == [advisory_lock_connection] object_id: 154742540, pg_backend_pid: 2271039main: == 20230809203254 EnsureIssueUserMentionsBigintBackfillIsFinishedForSelfManaged: migrating 1040main: == 20230809203254 EnsureIssueUserMentionsBigintBackfillIsFinishedForSelfManaged: migrated (0.0095s) 1041main: == [advisory_lock_connection] object_id: 154742540, pg_backend_pid: 2271042 ensures the migration is completed for self-managed instances1043main: == [advisory_lock_connection] object_id: 155452760, pg_backend_pid: 2301044main: == 20230809203254 EnsureIssueUserMentionsBigintBackfillIsFinishedForSelfManaged: migrating 1045main: == 20230809203254 EnsureIssueUserMentionsBigintBackfillIsFinishedForSelfManaged: migrated (0.0110s) 1046main: == [advisory_lock_connection] object_id: 155452760, pg_backend_pid: 2301047 skips the check for GitLab.com, dev, or test1048# [RSpecRunTime] RSpec elapsed time: 17 minutes 34.14 seconds. Current RSS: ~1176M. Threads: 2. load average: 0.92 0.97 1.04 1/287 4061049.1050INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree1051INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"1052INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1053INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"1054INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1055INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_102"1056INFO: "ci_runner_machine_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1057INFO: analyzing "public.p_ci_job_annotations" inheritance tree1058INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"1059INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1060INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"1061INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1062INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_102"1063INFO: "ci_job_annotations_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1064INFO: analyzing "public.p_ci_builds_metadata" inheritance tree1065INFO: analyzing "public.ci_builds_metadata"1066INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1067INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"1068INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1069INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_102"1070INFO: "ci_builds_metadata_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1071INFO: analyzing "public.p_ci_builds" inheritance tree1072INFO: analyzing "public.ci_builds"1073INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1074INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"1075INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1076INFO: analyzing "gitlab_partitions_dynamic.ci_builds_102"1077INFO: "ci_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1078INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree1079INFO: analyzing "public.ci_pipeline_variables"1080INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1081INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree1082INFO: analyzing "public.ci_pipeline_variables"1083INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1084INFO: analyzing "public.p_ci_job_artifacts" inheritance tree1085INFO: "ci_job_artifacts": scanned 1 of 1 pages, containing 0 live rows and 3 dead rows; 0 rows in sample, 0 estimated total rows1086INFO: analyzing "public.ci_job_artifacts"1087INFO: "ci_job_artifacts": scanned 1 of 1 pages, containing 0 live rows and 3 dead rows; 0 rows in sample, 0 estimated total rows1088INFO: analyzing "public.p_ci_stages" inheritance tree1089INFO: analyzing "public.ci_stages"1090INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1091# [RSpecRunTime] Finishing example group spec/migrations/20230809203254_ensure_issue_user_mentions_bigint_backfill_is_finished_for_self_managed_spec.rb. It took 3 minutes 21.58 seconds. Expected to take 1 minute 45.25 seconds.1092# [RSpecRunTime] RSpec elapsed time: 18 minutes 55.01 seconds. Current RSS: ~1124M. Threads: 2. load average: 0.90 0.95 1.02 1/287 4071093.1094# [RSpecRunTime] Starting example group spec/migrations/20231102142554_migrate_zoekt_shards_to_zoekt_nodes_spec.rb. Expected to take 1 minute 29.47 seconds.1095MigrateZoektShardsToZoektNodes1096 #up1097main: == [advisory_lock_connection] object_id: 188989240, pg_backend_pid: 2441098main: == 20231102142554 MigrateZoektShardsToZoektNodes: migrating ===================1099main: == 20231102142554 MigrateZoektShardsToZoektNodes: migrated (0.0120s) ==========1100main: == [advisory_lock_connection] object_id: 188989240, pg_backend_pid: 2441101 migrates zoekt_shard records to zoekt_nodes1102# [RSpecRunTime] RSpec elapsed time: 20 minutes 17.39 seconds. Current RSS: ~1177M. Threads: 2. load average: 0.96 0.95 1.01 1/287 4081103.1104 #down1105 deletes all zoekt_node records1106# [RSpecRunTime] RSpec elapsed time: 20 minutes 35.36 seconds. Current RSS: ~1160M. Threads: 2. load average: 0.97 0.96 1.01 1/287 4091107.1108INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree1109INFO: analyzing "public.ci_pipeline_variables"1110INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1111INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree1112INFO: analyzing "public.ci_pipeline_variables"1113INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1114INFO: analyzing "public.p_ci_job_artifacts" inheritance tree1115INFO: "ci_job_artifacts": scanned 1 of 1 pages, containing 0 live rows and 3 dead rows; 0 rows in sample, 0 estimated total rows1116INFO: analyzing "public.ci_job_artifacts"1117INFO: "ci_job_artifacts": scanned 1 of 1 pages, containing 0 live rows and 3 dead rows; 0 rows in sample, 0 estimated total rows1118INFO: analyzing "public.p_ci_stages" inheritance tree1119INFO: analyzing "public.ci_stages"1120INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1121# [RSpecRunTime] Finishing example group spec/migrations/20231102142554_migrate_zoekt_shards_to_zoekt_nodes_spec.rb. It took 2 minutes 51.87 seconds. Expected to take 1 minute 29.47 seconds.1122# [RSpecRunTime] RSpec elapsed time: 21 minutes 46.92 seconds. Current RSS: ~1144M. Threads: 2. load average: 0.97 0.95 1.00 1/287 4101123.1124# [RSpecRunTime] Starting example group spec/migrations/20240424091018_disable_allow_runner_registration_for_self_managed_spec.rb. Expected to take 1 minute 22.31 seconds.1125DisableAllowRunnerRegistrationForSelfManaged#up1126 when on self-managed1127 behaves like a migration disabling allow_runner_registration_token1128 when application setting does not exist1129main: == [advisory_lock_connection] object_id: 213337100, pg_backend_pid: 2581130main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrating =====1131main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrated (0.0729s) 1132main: == [advisory_lock_connection] object_id: 213337100, pg_backend_pid: 2581133 creates new application_setting set to false1134# [RSpecRunTime] RSpec elapsed time: 22 minutes 21.21 seconds. Current RSS: ~1148M. Threads: 2. load average: 1.09 0.99 1.01 1/287 4111135.1136 when application setting exists1137 with allow_runner_registration_token set to true1138main: == [advisory_lock_connection] object_id: 213951460, pg_backend_pid: 2601139main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrating =====1140main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrated (0.2427s) 1141main: == [advisory_lock_connection] object_id: 213951460, pg_backend_pid: 2601142 sets application_setting to false1143# [RSpecRunTime] RSpec elapsed time: 22 minutes 29.32 seconds. Current RSS: ~1122M. Threads: 2. load average: 1.07 0.99 1.01 1/287 4121144.1145 with allow_runner_registration_token set to false1146main: == [advisory_lock_connection] object_id: 214618960, pg_backend_pid: 2631147main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrating =====1148main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrated (0.1747s) 1149main: == [advisory_lock_connection] object_id: 214618960, pg_backend_pid: 2631150 does not change application_setting1151# [RSpecRunTime] RSpec elapsed time: 22 minutes 37.54 seconds. Current RSS: ~1126M. Threads: 2. load average: 1.07 0.99 1.01 1/287 4131152.1153 when on SaaS1154 behaves like a migration leaving allow_runner_registration_token unchanged1155 when application setting does not exist1156main: == [advisory_lock_connection] object_id: 215243680, pg_backend_pid: 2651157main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrating =====1158main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrated (0.0185s) 1159main: == [advisory_lock_connection] object_id: 215243680, pg_backend_pid: 2651160 does not create new application_setting1161# [RSpecRunTime] RSpec elapsed time: 22 minutes 45.74 seconds. Current RSS: ~1124M. Threads: 2. load average: 1.06 0.99 1.01 1/287 4141162.1163 when application setting exists1164 with allow_runner_registration_token set to true1165main: == [advisory_lock_connection] object_id: 215863280, pg_backend_pid: 2671166main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrating =====1167main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrated (0.1758s) 1168main: == [advisory_lock_connection] object_id: 215863280, pg_backend_pid: 2671169 does not change application_setting1170# [RSpecRunTime] RSpec elapsed time: 22 minutes 54.0 seconds. Current RSS: ~1126M. Threads: 2. load average: 1.05 0.99 1.00 1/287 4151171.1172 with allow_runner_registration_token set to false1173main: == [advisory_lock_connection] object_id: 216492940, pg_backend_pid: 2691174main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrating =====1175main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrated (0.1769s) 1176main: == [advisory_lock_connection] object_id: 216492940, pg_backend_pid: 2691177 does not change application_setting1178# [RSpecRunTime] RSpec elapsed time: 23 minutes 2.35 seconds. Current RSS: ~1127M. Threads: 2. load average: 1.04 1.00 1.00 1/287 4161179.1180 when instance is dedicated1181 behaves like a migration disabling allow_runner_registration_token1182 when application setting does not exist1183main: == [advisory_lock_connection] object_id: 217069180, pg_backend_pid: 2721184main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrating =====1185main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrated (0.0646s) 1186main: == [advisory_lock_connection] object_id: 217069180, pg_backend_pid: 2721187 creates new application_setting set to false1188# [RSpecRunTime] RSpec elapsed time: 23 minutes 10.19 seconds. Current RSS: ~1130M. Threads: 2. load average: 1.12 1.01 1.01 2/287 4171189.1190 when application setting exists1191 with allow_runner_registration_token set to true1192main: == [advisory_lock_connection] object_id: 217753500, pg_backend_pid: 2741193main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrating =====1194main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrated (0.1902s) 1195main: == [advisory_lock_connection] object_id: 217753500, pg_backend_pid: 2741196 sets application_setting to false1197# [RSpecRunTime] RSpec elapsed time: 23 minutes 18.64 seconds. Current RSS: ~1128M. Threads: 2. load average: 1.10 1.01 1.01 1/287 4181198.1199 with allow_runner_registration_token set to false1200main: == [advisory_lock_connection] object_id: 218378020, pg_backend_pid: 2761201main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrating =====1202main: == 20240424091018 DisableAllowRunnerRegistrationForSelfManaged: migrated (0.1780s) 1203main: == [advisory_lock_connection] object_id: 218378020, pg_backend_pid: 2761204 does not change application_setting1205# [RSpecRunTime] RSpec elapsed time: 23 minutes 26.47 seconds. Current RSS: ~1132M. Threads: 2. load average: 1.01 0.99 1.00 1/287 4191206.1207# [RSpecRunTime] Finishing example group spec/migrations/20240424091018_disable_allow_runner_registration_for_self_managed_spec.rb. It took 2 minutes 8.05 seconds. Expected to take 1 minute 22.31 seconds.1208# [RSpecRunTime] RSpec elapsed time: 23 minutes 55.02 seconds. Current RSS: ~1137M. Threads: 2. load average: 0.85 0.96 0.99 1/287 4201209.1210# [RSpecRunTime] Starting example group spec/migrations/20240113071052_queue_populate_topics_slug_column_spec.rb. Expected to take 1 minute 0.22 second.1211QueuePopulateTopicsSlugColumn1212main: == [advisory_lock_connection] object_id: 237921620, pg_backend_pid: 2881213main: == 20240113071052 QueuePopulateTopicsSlugColumn: migrating ====================1214main: == 20240113071052 QueuePopulateTopicsSlugColumn: migrated (0.0675s) ===========1215main: == [advisory_lock_connection] object_id: 237921620, pg_backend_pid: 2881216 schedules a new batched migration1217INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree1218INFO: analyzing "public.ci_pipeline_variables"1219INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1220INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree1221INFO: analyzing "public.ci_pipeline_variables"1222INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1223INFO: analyzing "public.p_ci_job_artifacts" inheritance tree1224INFO: "ci_job_artifacts": scanned 1 of 1 pages, containing 0 live rows and 3 dead rows; 0 rows in sample, 0 estimated total rows1225INFO: analyzing "public.ci_job_artifacts"1226INFO: "ci_job_artifacts": scanned 1 of 1 pages, containing 0 live rows and 3 dead rows; 0 rows in sample, 0 estimated total rows1227INFO: analyzing "public.p_ci_stages" inheritance tree1228INFO: analyzing "public.ci_stages"1229INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1230# [RSpecRunTime] Finishing example group spec/migrations/20240113071052_queue_populate_topics_slug_column_spec.rb. It took 1 minute 59.08 seconds. Expected to take 1 minute 0.22 second.1231# [RSpecRunTime] RSpec elapsed time: 25 minutes 54.14 seconds. Current RSS: ~1132M. Threads: 2. load average: 0.80 0.92 0.98 1/288 4211232.1233# [RSpecRunTime] Starting example group spec/migrations/20240307051421_update_occupies_seat_on_member_roles_spec.rb. Expected to take 51.0 seconds.1234UpdateOccupiesSeatOnMemberRoles1235 #up1236main: == [advisory_lock_connection] object_id: 261868500, pg_backend_pid: 3021237main: == 20240307051421 UpdateOccupiesSeatOnMemberRoles: migrating ==================1238main: -- execute("UPDATE member_roles SET occupies_seat = TRUE\nWHERE base_access_level > 10 OR (\n base_access_level = 10 AND (\n admin_cicd_variables = true OR\n admin_group_member = true OR\n admin_merge_request = true OR\n admin_terraform_state = true OR\n admin_vulnerability = true OR\n archive_project = true OR\n manage_group_access_tokens = true OR\n manage_project_access_tokens = true OR\n read_dependency = true OR\n read_vulnerability = true OR\n remove_group = true OR\n remove_project = true\n )\n)\n")1239main: -> 0.0025s1240main: == 20240307051421 UpdateOccupiesSeatOnMemberRoles: migrated (0.0125s) =========1241main: == [advisory_lock_connection] object_id: 261868500, pg_backend_pid: 3021242 updates occupies_seat to true for guest+ member roles1243# [RSpecRunTime] RSpec elapsed time: 26 minutes 38.04 seconds. Current RSS: ~1183M. Threads: 2. load average: 0.85 0.92 0.97 1/288 4221244.1245 #down1246main: == [advisory_lock_connection] object_id: 262570360, pg_backend_pid: 3041247main: == 20240307051421 UpdateOccupiesSeatOnMemberRoles: migrating ==================1248main: -- execute("UPDATE member_roles SET occupies_seat = TRUE\nWHERE base_access_level > 10 OR (\n base_access_level = 10 AND (\n admin_cicd_variables = true OR\n admin_group_member = true OR\n admin_merge_request = true OR\n admin_terraform_state = true OR\n admin_vulnerability = true OR\n archive_project = true OR\n manage_group_access_tokens = true OR\n manage_project_access_tokens = true OR\n read_dependency = true OR\n read_vulnerability = true OR\n remove_group = true OR\n remove_project = true\n )\n)\n")1249main: -> 0.0040s1250main: == 20240307051421 UpdateOccupiesSeatOnMemberRoles: migrated (0.0152s) =========1251main: == [advisory_lock_connection] object_id: 262570360, pg_backend_pid: 3041252 updates occupies_seat to false for all member roles1253# [RSpecRunTime] RSpec elapsed time: 26 minutes 53.73 seconds. Current RSS: ~1181M. Threads: 2. load average: 0.81 0.91 0.97 1/288 4231254.1255# [RSpecRunTime] Finishing example group spec/migrations/20240307051421_update_occupies_seat_on_member_roles_spec.rb. It took 1 minute 37.25 seconds. Expected to take 51.0 seconds.1256# [RSpecRunTime] RSpec elapsed time: 27 minutes 31.44 seconds. Current RSS: ~1155M. Threads: 2. load average: 0.90 0.92 0.97 1/288 4241257.1258# [RSpecRunTime] Starting example group spec/migrations/20240410004337_queue_backfill_deployment_approvals_project_id_spec.rb. Expected to take 35.72 seconds.1259QueueBackfillDeploymentApprovalsProjectId1260main: == [advisory_lock_connection] object_id: 279996260, pg_backend_pid: 3171261main: == 20240410004337 QueueBackfillDeploymentApprovalsProjectId: migrating ========1262main: == 20240410004337 QueueBackfillDeploymentApprovalsProjectId: migrated (0.0650s) 1263main: == [advisory_lock_connection] object_id: 279996260, pg_backend_pid: 3171264 schedules a new batched migration1265# [RSpecRunTime] Finishing example group spec/migrations/20240410004337_queue_backfill_deployment_approvals_project_id_spec.rb. It took 1 minute 8.05 seconds. Expected to take 35.72 seconds.1266# [RSpecRunTime] RSpec elapsed time: 28 minutes 39.53 seconds. Current RSS: ~1132M. Threads: 2. load average: 0.94 0.93 0.98 1/288 4251267.1268# [RSpecRunTime] Starting example group spec/migrations/extend_gitlabcom_duo_pro_trials_spec.rb. Expected to take 30.54 seconds.1269ExtendGitlabcomDuoProTrials1270 #up1271main: == [advisory_lock_connection] object_id: 294734900, pg_backend_pid: 3291272main: == 20240501113440 ExtendGitlabcomDuoProTrials: migrating ======================1273main: -- exec_query("SELECT COUNT(*) AS count FROM \"subscription_add_on_purchases\" WHERE \"subscription_add_on_purchases\".\"subscription_add_on_id\" = 1 AND \"subscription_add_on_purchases\".\"trial\" = TRUE AND \"subscription_add_on_purchases\".\"expires_on\" >= '2024-05-30'")1274main: -> 0.0025s1275main: -- exec_query("SELECT \"subscription_add_on_purchases\".\"id\" FROM \"subscription_add_on_purchases\" WHERE \"subscription_add_on_purchases\".\"subscription_add_on_id\" = 1 AND \"subscription_add_on_purchases\".\"trial\" = TRUE AND \"subscription_add_on_purchases\".\"expires_on\" >= '2024-05-30' ORDER BY \"subscription_add_on_purchases\".\"id\" ASC LIMIT 1")1276main: -> 0.0021s1277main: -- exec_query("SELECT \"subscription_add_on_purchases\".\"id\" FROM \"subscription_add_on_purchases\" WHERE \"subscription_add_on_purchases\".\"id\" >= 2 AND \"subscription_add_on_purchases\".\"subscription_add_on_id\" = 1 AND \"subscription_add_on_purchases\".\"trial\" = TRUE AND \"subscription_add_on_purchases\".\"expires_on\" >= '2024-05-30' ORDER BY \"subscription_add_on_purchases\".\"id\" ASC LIMIT 1 OFFSET 1")1278main: -> 0.0025s1279main: -- transaction(nil)1280main: -- execute("UPDATE \"subscription_add_on_purchases\" SET \"expires_on\" = (created_at + INTERVAL '60 days')::date WHERE \"subscription_add_on_purchases\".\"id\" >= 2 AND \"subscription_add_on_purchases\".\"id\" < 3 AND \"subscription_add_on_purchases\".\"subscription_add_on_id\" = 1 AND \"subscription_add_on_purchases\".\"trial\" = TRUE AND \"subscription_add_on_purchases\".\"expires_on\" >= '2024-05-30'")1281main: -> 0.0028s1282main: -> 0.0042s1283main: -- exec_query("SELECT \"subscription_add_on_purchases\".\"id\" FROM \"subscription_add_on_purchases\" WHERE \"subscription_add_on_purchases\".\"id\" >= 3 AND \"subscription_add_on_purchases\".\"subscription_add_on_id\" = 1 AND \"subscription_add_on_purchases\".\"trial\" = TRUE AND \"subscription_add_on_purchases\".\"expires_on\" >= '2024-05-30' ORDER BY \"subscription_add_on_purchases\".\"id\" ASC LIMIT 1 OFFSET 1")1284main: -> 0.0024s1285main: -- transaction(nil)1286main: -- execute("UPDATE \"subscription_add_on_purchases\" SET \"expires_on\" = (created_at + INTERVAL '60 days')::date WHERE \"subscription_add_on_purchases\".\"id\" >= 3 AND \"subscription_add_on_purchases\".\"id\" < 4 AND \"subscription_add_on_purchases\".\"subscription_add_on_id\" = 1 AND \"subscription_add_on_purchases\".\"trial\" = TRUE AND \"subscription_add_on_purchases\".\"expires_on\" >= '2024-05-30'")1287main: -> 0.0046s1288main: -> 0.0065s1289main: -- exec_query("SELECT \"subscription_add_on_purchases\".\"id\" FROM \"subscription_add_on_purchases\" WHERE \"subscription_add_on_purchases\".\"id\" >= 4 AND \"subscription_add_on_purchases\".\"subscription_add_on_id\" = 1 AND \"subscription_add_on_purchases\".\"trial\" = TRUE AND \"subscription_add_on_purchases\".\"expires_on\" >= '2024-05-30' ORDER BY \"subscription_add_on_purchases\".\"id\" ASC LIMIT 1 OFFSET 1")1290main: -> 0.0027s1291main: -- transaction(nil)1292main: -- execute("UPDATE \"subscription_add_on_purchases\" SET \"expires_on\" = (created_at + INTERVAL '60 days')::date WHERE \"subscription_add_on_purchases\".\"id\" >= 4 AND \"subscription_add_on_purchases\".\"subscription_add_on_id\" = 1 AND \"subscription_add_on_purchases\".\"trial\" = TRUE AND \"subscription_add_on_purchases\".\"expires_on\" >= '2024-05-30'")1293main: -> 0.0036s1294main: -> 0.0051s1295main: == 20240501113440 ExtendGitlabcomDuoProTrials: migrated (0.0640s) =============1296main: == [advisory_lock_connection] object_id: 294734900, pg_backend_pid: 3291297 update only the active duo_pro trials expires_on to 60.days after created date1298# [RSpecRunTime] RSpec elapsed time: 29 minutes 11.91 seconds. Current RSS: ~1149M. Threads: 2. load average: 0.83 0.91 0.97 1/286 4261299.1300# [RSpecRunTime] Finishing example group spec/migrations/extend_gitlabcom_duo_pro_trials_spec.rb. It took 59.11 seconds. Expected to take 30.54 seconds.1301# [RSpecRunTime] RSpec elapsed time: 29 minutes 38.69 seconds. Current RSS: ~1127M. Threads: 2. load average: 0.83 0.90 0.97 1/287 4271302.1303# [RSpecRunTime] Starting example group spec/migrations/20240521092459_queue_backfill_boards_epic_board_positions_group_id_spec.rb. Expected to take 6.07 seconds.1304QueueBackfillBoardsEpicBoardPositionsGroupId1305main: == [advisory_lock_connection] object_id: 302465860, pg_backend_pid: 3391306main: == 20240521092459 QueueBackfillBoardsEpicBoardPositionsGroupId: migrating =====1307main: == 20240521092459 QueueBackfillBoardsEpicBoardPositionsGroupId: migrated (0.0692s) 1308main: == [advisory_lock_connection] object_id: 302465860, pg_backend_pid: 3391309 schedules a new batched migration1310# [RSpecRunTime] Finishing example group spec/migrations/20240521092459_queue_backfill_boards_epic_board_positions_group_id_spec.rb. It took 15.15 seconds. Expected to take 6.07 seconds.1311# [RSpecRunTime] RSpec elapsed time: 29 minutes 53.88 seconds. Current RSS: ~1130M. Threads: 2. load average: 0.87 0.91 0.97 1/287 4281312.1313auto_explain log contains 956 entries for main, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-migration-pg14-single-db-ci-connection-9-15.342.main.ndjson.gz1314took 26.613621381315auto_explain log contains 957 entries for ci, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-migration-pg14-single-db-ci-connection-9-15.342.ci.ndjson.gz1316took 26.2680539471317[TEST PROF INFO] EventProf results for sql.active_record1318Total time: 16:14.583 of 29:47.647 (54.52%)1319Total events: 6422251320Top 5 slowest suites (by time):1321SwapDesignUse...ForSelfManaged (./spec/migrations/20230816152639_swap_design_user_mentions_note_id_to_big_int_for_self_managed_spec.rb:7) – 02:07.473 (79602 / 4) of 05:14.287 (40.56%)1322QueueFixAllow...dSharedRunners (./spec/migrations/20230802085923_queue_fix_allow_descendants_override_disabled_shared_runners_spec.rb:6) – 02:04.061 (74611 / 1) of 03:26.678 (60.03%)1323RestartSelfHo...ationsBackfill (./spec/migrations/20230906204935_restart_self_hosted_sent_notifications_backfill_spec.rb:34) – 02:03.754 (78990 / 5) of 04:22.498 (47.15%)1324EnsureIssueUs...ForSelfManaged (./spec/migrations/20230809203254_ensure_issue_user_mentions_bigint_backfill_is_finished_for_self_managed_spec.rb:6) – 01:59.929 (75659 / 2) of 03:21.623 (59.48%)1325MigrateZoektShardsToZoektNodes (./spec/migrations/20231102142554_migrate_zoekt_shards_to_zoekt_nodes_spec.rb:6) – 01:45.855 (65826 / 2) of 02:51.913 (61.57%)1326Knapsack report was generated. Preview:1327{1328 "spec/migrations/20230816152639_swap_design_user_mentions_note_id_to_big_int_for_self_managed_spec.rb": 230.31027402799964,1329 "spec/migrations/20230906204935_restart_self_hosted_sent_notifications_backfill_spec.rb": 183.00723233200006,1330 "spec/migrations/20240108072545_fix_invalid_records_ci_job_artifact_states_spec.rb": 90.43194197399998,1331 "spec/migrations/20230802085923_queue_fix_allow_descendants_override_disabled_shared_runners_spec.rb": 120.22204972200007,1332 "spec/migrations/20230809203254_ensure_issue_user_mentions_bigint_backfill_is_finished_for_self_managed_spec.rb": 120.84426775499969,1333 "spec/migrations/20231102142554_migrate_zoekt_shards_to_zoekt_nodes_spec.rb": 100.44659273700017,1334 "spec/migrations/20240424091018_disable_allow_runner_registration_for_self_managed_spec.rb": 99.70467424399976,1335 "spec/migrations/20240113071052_queue_populate_topics_slug_column_spec.rb": 67.14789726500021,1336 "spec/migrations/20240307051421_update_occupies_seat_on_member_roles_spec.rb": 59.73773293399972,1337 "spec/migrations/20240410004337_queue_backfill_deployment_approvals_project_id_spec.rb": 37.75676193799973,1338 "spec/migrations/extend_gitlabcom_duo_pro_trials_spec.rb": 32.513839711999935,1339 "spec/migrations/20240521092459_queue_backfill_boards_epic_board_positions_group_id_spec.rb": 6.20407342799990151340}1341Knapsack global time execution for tests: 19m 08s1342Finished in 30 minutes 47 seconds (files took 55.64 seconds to load)134332 examples, 0 failures1344Randomized with seed 480511345[TEST PROF INFO] Time spent in factories: 00:00.238 (0.01% of total time)1346RSpec exited with 0.1347No examples to retry, congrats!1349Running after script...1350$ source scripts/utils.sh1351$ bundle exec gem list gitlab_quality-test_tooling1352gitlab_quality-test_tooling (1.26.0)1353$ section_start "failed-test-issues" "Report test failures" # collapsed multi-line command1356$ section_start "flaky-test-issues" "Report test flakiness" # collapsed multi-line command1359$ section_start "slow-test-issues" "Report test slowness" # collapsed multi-line command1362$ section_start "slow-test-merge-request-report-note" "Report test slowness in MR note" # collapsed multi-line command1366$ section_start "knapsack-report-issues" "Report test files close to timing out" # collapsed multi-line command1370$ tooling/bin/push_job_metrics || true1371[job-metrics] Pushing job metrics file for the CI/CD job.1372[job-metrics] Pushed 4 CI job metric entries to InfluxDB.1374Not uploading cache ruby-gems-debian-bookworm-ruby-3.2-17 due to policy1376Uploading artifacts...1377auto_explain/: found 3 matching artifact files and directories 1378coverage/: found 5 matching artifact files and directories 1379crystalball/: found 2 matching artifact files and directories 1380WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab) 1381knapsack/: found 4 matching artifact files and directories 1382rspec/: found 16 matching artifact files and directories 1383WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab) 1384log/*.log: found 13 matching artifact files and directories 1385WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/6975007435/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com1386WARNING: Retrying... context=artifacts-uploader error=request redirected1387Uploading artifacts as "archive" to coordinator... 201 Created id=6975007435 responseStatus=201 Created token=glcbt-651388Uploading artifacts...1389rspec/rspec-*.xml: found 1 matching artifact files and directories 1390WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/6975007435/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com1391WARNING: Retrying... context=artifacts-uploader error=request redirected1392Uploading artifacts as "junit" to coordinator... 201 Created id=6975007435 responseStatus=201 Created token=glcbt-651394Job succeeded