rspec-ee migration pg14 single-db 1/2
Passed Started
by
@krasio
Krasimir Angelov
1Running with gitlab-runner 17.0.0~pre.88.g761ae5dd (761ae5dd)2 on green-3.private.runners-manager.gitlab.com/gitlab.com/gitlab-org QuQPoFsC, system ID: s_fc023362bf2f3 feature flags: FF_NETWORK_PER_BUILD:true4Resolving secrets6Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.patched-golang-1.21-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...7Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...8Authenticating with credentials from job payload (GitLab Registry)9Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...10Using docker image sha256:82f132c22567f8ce17cc132c14b2f9aa3eaf9bb5424d91c2d966912433f0257d for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:c55e1364ee4327b244a9cfa1750f19feea14fc774eaf792b725967d146eb45f5 ...11WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.12WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.13Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...14Authenticating with credentials from job payload (GitLab Registry)15Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...16Using docker image sha256:5c5ba5b83d6c60cb0b225bd670b7a43be8c238cc72347d24af57e5027c3648f3 for registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:46aceab84c42d0e819c8e7940f2f98ce9e184785cd7b22d95872024a35f52407 ...17Starting service redis:6.2-alpine ...18Pulling docker image redis:6.2-alpine ...19Using docker image sha256:0fc0b666ef9eb249e61edd4e2ec434a328e98117079727c5e7cf6dc9a00d7a94 for redis:6.2-alpine with digest redis@sha256:c6abddbb4223951cf5cb54a19d4a83418582fa69c97c0458ab4f0974f24f119c ...20WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.8 is already created. Ignoring.21WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.8 is already created. Ignoring.22Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.8 ...23Authenticating with credentials from job payload (GitLab Registry)24Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.8 ...25Using docker image sha256:df819140e3df737cdc7b8d6fb73ce804b05058c790e025b5f52840956feb1734 for registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.8 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:7bdf349fc3dd9da64bc6581d44c0e906bffd38977ddbd2668ba34adb5dedfe38 ...26Starting service elasticsearch:7.17.6 ...27Pulling docker image elasticsearch:7.17.6 ...28Using docker image sha256:5fad10241ffd65d817ed0ddfaf6e87eee1f7dc2a7db33db1047835560ea71fda for elasticsearch:7.17.6 with digest elasticsearch@sha256:6c128de5d01c0c130a806022d6bd99b3e4c27a9af5bfc33b6b81861ae117d028 ...29Starting service registry.gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/model-gateway:latest ...30Authenticating with credentials from job payload (GitLab Registry)31Pulling docker image registry.gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/model-gateway:latest ...32Using docker image sha256:3c5f1e3ac1332b78854a67ecf17c55922502c097ba3ed70937f702c71f19f962 for registry.gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/model-gateway:latest with digest registry.gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/model-gateway@sha256:c2c912f0676a3a3f4c804a2d3a170926653fb50791020260f13f5c408fcf4aa0 ...33Waiting for services to be up and running (timeout 30 seconds)...34Authenticating with credentials from job payload (GitLab Registry)35Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.patched-golang-1.21-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...36Using docker image sha256:d10d211334d3c94a5e626cf961467431b7d3f3bd8b6109e5caf9357421c0117b for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.patched-golang-1.21-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.patched-golang-1.21-rust-1.73-node-20.12-postgresql-14@sha256:3c4cd9a237deb59350b4836552151ba2aae96247034074c8f0c2ccaff4558cab ...38Running on runner-quqpofsc-project-278964-concurrent-0 via runner-quqpofsc-private-1717014931-4a36bc50...40Skipping Git repository setup41Skipping Git checkout42Skipping Git submodules setup44Checking cache for ruby-gems-debian-bookworm-ruby-3.2-17...45Downloading cache from https://storage.googleapis.com/gitlab-com-runners-cache/project/278964/ruby-gems-debian-bookworm-ruby-3.2-17 46Successfully extracted cache48Downloading artifacts for clone-gitlab-repo (6975007209)...49Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6975007209 responseStatus=200 OK token=glcbt-6550WARNING: Part of .git directory is on the list of files to extract 51WARNING: This may introduce unexpected problems 52Downloading artifacts for compile-test-assets (6975007223)...53Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6975007223 responseStatus=200 OK token=glcbt-6554Downloading artifacts for detect-tests (6975007229)...55Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6975007229 responseStatus=200 OK token=glcbt-6556Downloading artifacts for retrieve-tests-metadata (6975007235)...57Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6975007235 responseStatus=200 OK token=glcbt-6558Downloading artifacts for setup-test-env (6975007225)...59Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6975007225 responseStatus=200 OK token=glcbt-65 60 Executing "step_script" stage of the job script 61Using docker image sha256:d10d211334d3c94a5e626cf961467431b7d3f3bd8b6109e5caf9357421c0117b for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.patched-golang-1.21-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.2.patched-golang-1.21-rust-1.73-node-20.12-postgresql-14@sha256:3c4cd9a237deb59350b4836552151ba2aae96247034074c8f0c2ccaff4558cab ...62$ echo $FOSS_ONLY63$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb64$ export GOPATH=$CI_PROJECT_DIR/.go65$ mkdir -p $GOPATH66$ source scripts/utils.sh67$ source scripts/prepare_build.sh768Using two connections, single database config (config/database.yml.postgresql)769Disabling ci connection in config/database.yml770Geo DB will be set up.771Embedding DB will be set up.797$ source ./scripts/rspec_helpers.sh798$ run_timed_command "gem install knapsack --no-document"799$ gem install knapsack --no-document800Successfully installed knapsack-4.0.08011 gem installed802==> 'gem install knapsack --no-document' succeeded in 1 seconds.803$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"808$ export RSPEC_SKIPPED_TESTS_REPORT_PATH="rspec/skipped_tests-${CI_JOB_ID}.txt"809$ export RSPEC_RETRIED_TESTS_REPORT_PATH="rspec/retried_tests-${CI_JOB_ID}.txt"810$ tooling/bin/create_job_metrics_file || true811[job-metrics] Creating the job metrics file for the CI/CD job.812$ rspec_section rspec_parallelized_job "--fail-fast=${RSPEC_FAIL_FAST_THRESHOLD} --tag ~quarantine --tag ~zoekt --tag ~click_house"814[23:32:21] Starting rspec_parallelized_job815RETRY_FAILED_TESTS_IN_NEW_PROCESS: true816KNAPSACK_GENERATE_REPORT: true817FLAKY_RSPEC_GENERATE_REPORT: true818KNAPSACK_TEST_FILE_PATTERN: {ee/}spec/{migrations}{,/**/}*_spec.rb819KNAPSACK_LOG_LEVEL: debug820KNAPSACK_REPORT_PATH: knapsack/rspec-ee_migration_pg14_single-db_1_2_278964_report.json821FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json822FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec-ee_migration_pg14_single-db_1_2_278964_report.json823NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec-ee_migration_pg14_single-db_1_2_278964_report.json824RSPEC_SKIPPED_TESTS_REPORT_PATH: rspec/skipped_tests-6975007956.txt825CRYSTALBALL: 826RSPEC_TESTS_MAPPING_ENABLED: 827RSPEC_TESTS_FILTER_FILE: 828Shell set options (set -o) enabled:829braceexpand on830hashall on831interactive-comments on832pipefail on833Knapsack report generator started!834 ██ ██ █████ ██████ ███ ██ ██ ███ ██ ██████ 835 ██ ██ ██ ██ ██ ██ ████ ██ ██ ████ ██ ██ 836 ██ █ ██ ███████ ██████ ██ ██ ██ ██ ██ ██ ██ ██ ███ 837 ██ ███ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ 838 ███ ███ ██ ██ ██ ██ ██ ████ ██ ██ ████ ██████ 839******************************************************************************840 Your database has a single connection, and single connections were841 deprecated in GitLab 15.9 https://docs.gitlab.com/ee/update/deprecations.html#single-database-connection-is-deprecated.842 In GitLab 17.0 and later, you must have the two main: and ci: sections in your database.yml.843 Please add a :ci section to your database, following these instructions:845******************************************************************************846warning: parser/current is loading parser/ruby32, which recognizes 3.2.3-compliant syntax, but you are running 3.2.4.848 ██ ██ █████ ██████ ███ ██ ██ ███ ██ ██████ 849 ██ ██ ██ ██ ██ ██ ████ ██ ██ ████ ██ ██ 850 ██ █ ██ ███████ ██████ ██ ██ ██ ██ ██ ██ ██ ██ ███ 851 ██ ███ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ ██ 852 ███ ███ ██ ██ ██ ██ ██ ████ ██ ██ ████ ██████ 853******************************************************************************854 Your database has a single connection, and single connections were855 deprecated in GitLab 15.9 https://docs.gitlab.com/ee/update/deprecations.html#single-database-connection-is-deprecated.856 In GitLab 17.0 and later, you must have the two main: and ci: sections in your database.yml.857 Please add a :ci section to your database, following these instructions:859******************************************************************************860Run options: exclude {:quarantine=>true, :zoekt=>true, :click_house=>true}861# [RSpecRunTime] Starting RSpec timer...862[TEST PROF INFO] EventProf enabled (sql.active_record)863unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.864Test environment set up in 1.284081537 seconds865# [RSpecRunTime] Starting example group ee/spec/migrations/20240209153920_queue_purge_security_scans_with_empty_finding_data_spec.rb. Expected to take 2 minutes 18.8 seconds.866QueuePurgeSecurityScansWithEmptyFindingData867 for scheduling based on environment868 when it is on GitLab.com869WARNING: Active Record does not support composite primary key.870p_ci_builds has composite primary key. Composite primary key is ignored.871WARNING: Active Record does not support composite primary key.872security_findings has composite primary key. Composite primary key is ignored.873main: == [advisory_lock_connection] object_id: 11875400, pg_backend_pid: 161874main: == 20240209153920 QueuePurgeSecurityScansWithEmptyFindingData: migrating ======875main: == 20240209153920 QueuePurgeSecurityScansWithEmptyFindingData: migrated (0.0108s) 876main: == [advisory_lock_connection] object_id: 11875400, pg_backend_pid: 161877 does not schedule a new batched migration878 when it is not on GitLab.com879WARNING: Active Record does not support composite primary key.880p_ci_builds has composite primary key. Composite primary key is ignored.881WARNING: Active Record does not support composite primary key.882security_findings has composite primary key. Composite primary key is ignored.883main: == [advisory_lock_connection] object_id: 12407740, pg_backend_pid: 165884main: == 20240209153920 QueuePurgeSecurityScansWithEmptyFindingData: migrating ======885WARNING: Active Record does not support composite primary key.886security_findings has composite primary key. Composite primary key is ignored.887main: == 20240209153920 QueuePurgeSecurityScansWithEmptyFindingData: migrated (0.0717s) 888main: == [advisory_lock_connection] object_id: 12407740, pg_backend_pid: 165889 schedules a new batched migration890# [RSpecRunTime] RSpec elapsed time: 1 minute 6.73 seconds. Current RSS: ~1144M. Threads: 2. load average: 1.06 1.30 1.21 1/434 412891.892 for scheduling based on data893 when there is no succeeded scan894WARNING: Active Record does not support composite primary key.895p_ci_builds has composite primary key. Composite primary key is ignored.896WARNING: Active Record does not support composite primary key.897security_findings has composite primary key. Composite primary key is ignored.898main: == [advisory_lock_connection] object_id: 12955780, pg_backend_pid: 169899main: == 20240209153920 QueuePurgeSecurityScansWithEmptyFindingData: migrating ======900main: == 20240209153920 QueuePurgeSecurityScansWithEmptyFindingData: migrated (0.0114s) 901main: == [advisory_lock_connection] object_id: 12955780, pg_backend_pid: 169902 does not schedule a new batched migration903# [RSpecRunTime] RSpec elapsed time: 1 minute 20.4 seconds. Current RSS: ~1146M. Threads: 2. load average: 0.96 1.27 1.20 1/434 413904.905 when there is a succeeded scan906 when there is no associated finding with the security scan907WARNING: Active Record does not support composite primary key.908p_ci_builds has composite primary key. Composite primary key is ignored.909main: == [advisory_lock_connection] object_id: 13473420, pg_backend_pid: 173910main: == 20240209153920 QueuePurgeSecurityScansWithEmptyFindingData: migrating ======911main: == 20240209153920 QueuePurgeSecurityScansWithEmptyFindingData: migrated (0.0698s) 912main: == [advisory_lock_connection] object_id: 13473420, pg_backend_pid: 173913 schedules a new batched migration914# [RSpecRunTime] RSpec elapsed time: 1 minute 33.81 seconds. Current RSS: ~1126M. Threads: 2. load average: 0.97 1.26 1.20 1/429 414915.916 when the first associated finding has `finding_data`917WARNING: Active Record does not support composite primary key.918p_ci_builds has composite primary key. Composite primary key is ignored.919WARNING: Active Record does not support composite primary key.920security_findings has composite primary key. Composite primary key is ignored.921main: == [advisory_lock_connection] object_id: 14009120, pg_backend_pid: 177922main: == 20240209153920 QueuePurgeSecurityScansWithEmptyFindingData: migrating ======923main: == 20240209153920 QueuePurgeSecurityScansWithEmptyFindingData: migrated (0.0231s) 924main: == [advisory_lock_connection] object_id: 14009120, pg_backend_pid: 177925 does not schedule a new batched migration926# [RSpecRunTime] RSpec elapsed time: 1 minute 46.92 seconds. Current RSS: ~1126M. Threads: 2. load average: 0.98 1.24 1.19 1/429 415927.928 when the first associated finding does not have `finding_data`929WARNING: Active Record does not support composite primary key.930p_ci_builds has composite primary key. Composite primary key is ignored.931WARNING: Active Record does not support composite primary key.932security_findings has composite primary key. Composite primary key is ignored.933main: == [advisory_lock_connection] object_id: 14514600, pg_backend_pid: 181934main: == 20240209153920 QueuePurgeSecurityScansWithEmptyFindingData: migrating ======935main: == 20240209153920 QueuePurgeSecurityScansWithEmptyFindingData: migrated (0.0659s) 936main: == [advisory_lock_connection] object_id: 14514600, pg_backend_pid: 181937 schedules a new batched migration938# [RSpecRunTime] RSpec elapsed time: 2 minutes 0.42 second. Current RSS: ~1126M. Threads: 2. load average: 0.98 1.23 1.19 1/429 416939.940INFO: analyzing "public.p_ci_stages" inheritance tree941INFO: analyzing "public.ci_stages"942INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows943# [RSpecRunTime] Finishing example group ee/spec/migrations/20240209153920_queue_purge_security_scans_with_empty_finding_data_spec.rb. It took 2 minutes 28.64 seconds. Expected to take 2 minutes 18.8 seconds.944# [RSpecRunTime] RSpec elapsed time: 2 minutes 32.14 seconds. Current RSS: ~1109M. Threads: 2. load average: 0.91 1.19 1.17 1/429 417945.946# [RSpecRunTime] Starting example group ee/spec/migrations/20231030154117_insert_new_ultimate_trial_plan_into_plans_spec.rb. Expected to take 1 minute 48.11 seconds.947InsertNewUltimateTrialPlanIntoPlans948 #up949main: == [advisory_lock_connection] object_id: 40471660, pg_backend_pid: 204950main: == 20231030154117 InsertNewUltimateTrialPlanIntoPlans: migrating ==============951main: -- execute("INSERT INTO plans (name, title, created_at, updated_at)\nVALUES ('ultimate_trial_paid_customer', 'Ultimate Trial for Paid Customer', current_timestamp, current_timestamp)\n")952main: -> 0.0016s953main: == 20231030154117 InsertNewUltimateTrialPlanIntoPlans: migrated (0.0111s) =====954main: == [advisory_lock_connection] object_id: 40471660, pg_backend_pid: 204955 adds a new entry to the plans table956# [RSpecRunTime] RSpec elapsed time: 3 minutes 37.3 seconds. Current RSS: ~1142M. Threads: 2. load average: 1.05 1.18 1.17 1/428 418957.958 #down959main: == [advisory_lock_connection] object_id: 40958000, pg_backend_pid: 207960main: == 20231030154117 InsertNewUltimateTrialPlanIntoPlans: migrating ==============961main: -- execute("INSERT INTO plans (name, title, created_at, updated_at)\nVALUES ('ultimate_trial_paid_customer', 'Ultimate Trial for Paid Customer', current_timestamp, current_timestamp)\n")962main: -> 0.0018s963main: == 20231030154117 InsertNewUltimateTrialPlanIntoPlans: migrated (0.0129s) =====964main: == [advisory_lock_connection] object_id: 40958000, pg_backend_pid: 207965 deletes the newly added row966# [RSpecRunTime] RSpec elapsed time: 4 minutes 3.47 seconds. Current RSS: ~1153M. Threads: 2. load average: 1.10 1.18 1.17 1/428 419967.968INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree969INFO: analyzing "public.ci_pipeline_variables"970INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows971INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree972INFO: analyzing "public.ci_pipeline_variables"973INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows974INFO: analyzing "public.p_ci_job_artifacts" inheritance tree975INFO: analyzing "public.ci_job_artifacts"976INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows977INFO: analyzing "public.p_ci_stages" inheritance tree978INFO: analyzing "public.ci_stages"979INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows980# [RSpecRunTime] Finishing example group ee/spec/migrations/20231030154117_insert_new_ultimate_trial_plan_into_plans_spec.rb. It took 2 minutes 24.81 seconds. Expected to take 1 minute 48.11 seconds.981# [RSpecRunTime] RSpec elapsed time: 4 minutes 56.98 seconds. Current RSS: ~1111M. Threads: 2. load average: 1.03 1.15 1.16 1/429 420982.983# [RSpecRunTime] Starting example group ee/spec/migrations/20240104085448_queue_update_workspaces_config_version3_spec.rb. Expected to take 1 minute 4.64 seconds.984QueueUpdateWorkspacesConfigVersion3985main: == [advisory_lock_connection] object_id: 69760140, pg_backend_pid: 231986main: == 20240104085448 QueueUpdateWorkspacesConfigVersion3: migrating ==============987main: == 20240104085448 QueueUpdateWorkspacesConfigVersion3: migrated (0.0657s) =====988main: == [advisory_lock_connection] object_id: 69760140, pg_backend_pid: 231989 schedules a new batched migration990INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree991INFO: analyzing "public.ci_pipeline_variables"992INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows993INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree994INFO: analyzing "public.ci_pipeline_variables"995INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows996INFO: analyzing "public.p_ci_job_artifacts" inheritance tree997INFO: analyzing "public.ci_job_artifacts"998INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows999INFO: analyzing "public.p_ci_stages" inheritance tree1000INFO: analyzing "public.ci_stages"1001INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows1002# [RSpecRunTime] Finishing example group ee/spec/migrations/20240104085448_queue_update_workspaces_config_version3_spec.rb. It took 1 minute 42.32 seconds. Expected to take 1 minute 4.64 seconds.1003# [RSpecRunTime] RSpec elapsed time: 6 minutes 39.33 seconds. Current RSS: ~1124M. Threads: 2. load average: 0.89 1.05 1.12 1/429 4211004.1005# [RSpecRunTime] Starting example group ee/spec/migrations/geo/resync_direct_upload_job_artifact_registry_spec.rb. Expected to take 31.82 seconds.1006ResyncDirectUploadJobArtifactRegistry1007 #up1008 when direct upload is enabled for job artifacts1009 when the site is a Geo secondary1010 when sync_object_storage is enabled for the current Geo site1011 with job artifact registry rows1012geo: == [advisory_lock_connection] object_id: 83623080, pg_backend_pid: 2551013geo: == 20230808031211 ResyncDirectUploadJobArtifactRegistry: migrating ============1014geo: -- Enqueuing Geo::ResyncDirectUploadJobArtifactRegistryWorker jobs to mark artifacts pending1016geo: -- Enqueuing Geo::ResyncDirectUploadJobArtifactRegistryWorker for range 1..21017geo: -- Enqueued 1 Geo::ResyncDirectUploadJobArtifactRegistryWorker job1018geo: == 20230808031211 ResyncDirectUploadJobArtifactRegistry: migrated (0.0767s) ===1019geo: == [advisory_lock_connection] object_id: 83623080, pg_backend_pid: 2551020 marks pending if synced between 2023-06-22 and 2024-02-031021geo: == [advisory_lock_connection] object_id: 84053480, pg_backend_pid: 2611022geo: == 20230808031211 ResyncDirectUploadJobArtifactRegistry: migrating ============1023geo: -- Enqueuing Geo::ResyncDirectUploadJobArtifactRegistryWorker jobs to mark artifacts pending1025geo: -- Enqueuing Geo::ResyncDirectUploadJobArtifactRegistryWorker for range 3..41026geo: -- Enqueued 1 Geo::ResyncDirectUploadJobArtifactRegistryWorker job1027geo: == 20230808031211 ResyncDirectUploadJobArtifactRegistry: migrated (0.0589s) ===1028geo: == [advisory_lock_connection] object_id: 84053480, pg_backend_pid: 2611029 does not update if not synced1030geo: == [advisory_lock_connection] object_id: 84549220, pg_backend_pid: 2671031geo: == 20230808031211 ResyncDirectUploadJobArtifactRegistry: migrating ============1032geo: -- Enqueuing Geo::ResyncDirectUploadJobArtifactRegistryWorker jobs to mark artifacts pending1034geo: -- Enqueuing Geo::ResyncDirectUploadJobArtifactRegistryWorker for range 5..51035geo: -- Enqueued 1 Geo::ResyncDirectUploadJobArtifactRegistryWorker job1036geo: == 20230808031211 ResyncDirectUploadJobArtifactRegistry: migrated (0.0622s) ===1037geo: == [advisory_lock_connection] object_id: 84549220, pg_backend_pid: 2671038 does not update if synced before 2023-06-221039geo: == [advisory_lock_connection] object_id: 84951020, pg_backend_pid: 2741040geo: == 20230808031211 ResyncDirectUploadJobArtifactRegistry: migrating ============1041geo: -- Enqueuing Geo::ResyncDirectUploadJobArtifactRegistryWorker jobs to mark artifacts pending1043geo: -- Enqueuing Geo::ResyncDirectUploadJobArtifactRegistryWorker for range 6..61044geo: -- Enqueued 1 Geo::ResyncDirectUploadJobArtifactRegistryWorker job1045geo: == 20230808031211 ResyncDirectUploadJobArtifactRegistry: migrated (0.0688s) ===1046geo: == [advisory_lock_connection] object_id: 84951020, pg_backend_pid: 2741047 does not update if synced after 2024-02-031048# [RSpecRunTime] RSpec elapsed time: 6 minutes 49.8 seconds. Current RSS: ~1099M. Threads: 2. load average: 1.06 1.08 1.13 1/429 4221049.1050 when sync_object_storage is disabled for the current Geo site1051 does not update job artifact registry1052# [RSpecRunTime] RSpec elapsed time: 6 minutes 53.09 seconds. Current RSS: ~1093M. Threads: 2. load average: 1.22 1.11 1.14 1/429 4231053.1054 when the site is a Geo primary1055 does not update job artifact registry1056# [RSpecRunTime] RSpec elapsed time: 6 minutes 55.55 seconds. Current RSS: ~1092M. Threads: 2. load average: 1.28 1.13 1.15 1/429 4241057.1058 when direct upload is disabled for job artifacts1059 does not update job artifact registry1060# [RSpecRunTime] RSpec elapsed time: 6 minutes 57.95 seconds. Current RSS: ~1091M. Threads: 2. load average: 1.28 1.13 1.15 1/429 4251061.1062 when object storage is disabled for job artifacts1063 does not update job artifact registry1064# [RSpecRunTime] RSpec elapsed time: 7 minutes 0.4 second. Current RSS: ~1090M. Threads: 2. load average: 1.26 1.13 1.15 1/429 4261065.1066# [RSpecRunTime] Finishing example group ee/spec/migrations/geo/resync_direct_upload_job_artifact_registry_spec.rb. It took 23.34 seconds. Expected to take 31.82 seconds.1067# [RSpecRunTime] RSpec elapsed time: 7 minutes 2.71 seconds. Current RSS: ~1088M. Threads: 2. load average: 1.26 1.13 1.15 1/429 4271068.1069# [RSpecRunTime] Starting example group ee/spec/migrations/geo/migrate_ci_job_artifacts_to_separate_registry_spec.rb. Expected to take 22.65 seconds.1070MigrateCiJobArtifactsToSeparateRegistry1071 #up1072geo: == [advisory_lock_connection] object_id: 87380360, pg_backend_pid: 3221073== 20180322062741 MigrateCiJobArtifactsToSeparateRegistry: migrating ==========1074== 20180322062741 MigrateCiJobArtifactsToSeparateRegistry: migrated (0.0324s) =1075geo: == [advisory_lock_connection] object_id: 87380360, pg_backend_pid: 3221076 migrates all job artifacts to its own data table1077geo: == [advisory_lock_connection] object_id: 87765520, pg_backend_pid: 3281078== 20180322062741 MigrateCiJobArtifactsToSeparateRegistry: migrating ==========1079== 20180322062741 MigrateCiJobArtifactsToSeparateRegistry: migrated (0.0291s) =1080geo: == [advisory_lock_connection] object_id: 87765520, pg_backend_pid: 3281081 creates a new artifact with the trigger1082geo: == [advisory_lock_connection] object_id: 88226600, pg_backend_pid: 3341083== 20180322062741 MigrateCiJobArtifactsToSeparateRegistry: migrating ==========1084== 20180322062741 MigrateCiJobArtifactsToSeparateRegistry: migrated (0.0299s) =1085geo: == [advisory_lock_connection] object_id: 88226600, pg_backend_pid: 3341086 updates a new artifact with the trigger1087geo: == [advisory_lock_connection] object_id: 88762300, pg_backend_pid: 3401088== 20180322062741 MigrateCiJobArtifactsToSeparateRegistry: migrating ==========1089== 20180322062741 MigrateCiJobArtifactsToSeparateRegistry: migrated (0.0297s) =1090geo: == [advisory_lock_connection] object_id: 88762300, pg_backend_pid: 3401091 creates a new artifact using the next ID1092# [RSpecRunTime] RSpec elapsed time: 7 minutes 13.44 seconds. Current RSS: ~1093M. Threads: 2. load average: 1.22 1.12 1.14 1/429 4281093.1094 #down1095geo: == [advisory_lock_connection] object_id: 89185880, pg_backend_pid: 3461096== 20180322062741 MigrateCiJobArtifactsToSeparateRegistry: migrating ==========1097== 20180322062741 MigrateCiJobArtifactsToSeparateRegistry: migrated (0.0317s) =1098geo: == [advisory_lock_connection] object_id: 89185880, pg_backend_pid: 3461099 rolls back data properly1100# [RSpecRunTime] RSpec elapsed time: 7 minutes 15.94 seconds. Current RSS: ~1092M. Threads: 2. load average: 1.20 1.12 1.14 1/429 4291101.1102# [RSpecRunTime] Finishing example group ee/spec/migrations/geo/migrate_ci_job_artifacts_to_separate_registry_spec.rb. It took 16.72 seconds. Expected to take 22.65 seconds.1103# [RSpecRunTime] RSpec elapsed time: 7 minutes 19.46 seconds. Current RSS: ~1089M. Threads: 2. load average: 1.20 1.12 1.14 1/430 4301104.1105# [RSpecRunTime] Starting example group ee/spec/migrations/geo/set_resync_flag_for_retried_projects_spec.rb. Expected to take 9.22 seconds.1106SetResyncFlagForRetriedProjects1107 #up1108geo: == [advisory_lock_connection] object_id: 89976960, pg_backend_pid: 3771109== 20180510223634 SetResyncFlagForRetriedProjects: migrating ==================1110-- execute(" UPDATE project_registry SET resync_repository = 't' WHERE repository_retry_count > 0 AND resync_repository = 'f';\n UPDATE project_registry SET resync_wiki = 't' WHERE wiki_retry_count > 0 AND resync_wiki = 'f';\n")1111 -> 0.0027s1112== 20180510223634 SetResyncFlagForRetriedProjects: migrated (0.0028s) =========1113geo: == [advisory_lock_connection] object_id: 89976960, pg_backend_pid: 3771114 sets resync_repository to true1115geo: == [advisory_lock_connection] object_id: 90371760, pg_backend_pid: 3821116== 20180510223634 SetResyncFlagForRetriedProjects: migrating ==================1117-- execute(" UPDATE project_registry SET resync_repository = 't' WHERE repository_retry_count > 0 AND resync_repository = 'f';\n UPDATE project_registry SET resync_wiki = 't' WHERE wiki_retry_count > 0 AND resync_wiki = 'f';\n")1118 -> 0.0030s1119== 20180510223634 SetResyncFlagForRetriedProjects: migrated (0.0031s) =========1120geo: == [advisory_lock_connection] object_id: 90371760, pg_backend_pid: 3821121 sets resync_wiki to true1122# [RSpecRunTime] RSpec elapsed time: 7 minutes 25.2 seconds. Current RSS: ~1092M. Threads: 2. load average: 1.17 1.11 1.14 1/430 4311123.1124# [RSpecRunTime] Finishing example group ee/spec/migrations/geo/set_resync_flag_for_retried_projects_spec.rb. It took 9.09 seconds. Expected to take 9.22 seconds.1125# [RSpecRunTime] RSpec elapsed time: 7 minutes 28.59 seconds. Current RSS: ~1090M. Threads: 2. load average: 1.17 1.11 1.14 1/430 4321126.1127auto_explain log contains 914 entries for main, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-ee-migration-pg14-single-db-1-2.344.main.ndjson.gz1128took 8.6005516791129[TEST PROF INFO] EventProf results for sql.active_record1130Total time: 03:43.290 of 07:25.129 (50.16%)1131Total events: 1959931132Top 5 slowest suites (by time):1133InsertNewUlti...lPlanIntoPlans (./ee/spec/migrations/20231030154117_insert_new_ultimate_trial_plan_into_plans_spec.rb:7) – 01:19.365 (61042 / 2) of 02:24.842 (54.79%)1134QueueUpdateWo...ConfigVersion3 (./ee/spec/migrations/20240104085448_queue_update_workspaces_config_version3_spec.rb:6) – 01:02.745 (50242 / 1) of 01:42.353 (61.3%)1135QueuePurgeSec...ptyFindingData (./ee/spec/migrations/20240209153920_queue_purge_security_scans_with_empty_finding_data_spec.rb:6) – 00:57.422 (48967 / 6) of 02:28.681 (38.62%)1136ResyncDirectU...tifactRegistry (./ee/spec/migrations/geo/resync_direct_upload_job_artifact_registry_spec.rb:6) – 00:10.664 (15041 / 8) of 00:23.376 (45.62%)1137MigrateCiJobA...parateRegistry (./ee/spec/migrations/geo/migrate_ci_job_artifacts_to_separate_registry_spec.rb:6) – 00:08.348 (13017 / 5) of 00:16.750 (49.84%)1138Knapsack report was generated. Preview:1139{1140 "ee/spec/migrations/20240209153920_queue_purge_security_scans_with_empty_finding_data_spec.rb": 117.0821772750005,1141 "ee/spec/migrations/20231030154117_insert_new_ultimate_trial_plan_into_plans_spec.rb": 91.41792743899896,1142 "ee/spec/migrations/20240104085448_queue_update_workspaces_config_version3_spec.rb": 59.90959461700004,1143 "ee/spec/migrations/geo/resync_direct_upload_job_artifact_registry_spec.rb": 21.18304369500038,1144 "ee/spec/migrations/geo/migrate_ci_job_artifacts_to_separate_registry_spec.rb": 13.33426054300071,1145 "ee/spec/migrations/geo/set_resync_flag_for_retried_projects_spec.rb": 5.8509921060012861146}1147Knapsack global time execution for tests: 05m 08s1148Finished in 7 minutes 37 seconds (files took 1 minute 10.95 seconds to load)114924 examples, 0 failures1150Randomized with seed 288041151[TEST PROF INFO] Time spent in factories: 00:00.071 (0.01% of total time)1152RSpec exited with 0.1153No examples to retry, congrats!1155Running after script...1156$ source scripts/utils.sh1157$ bundle exec gem list gitlab_quality-test_tooling1158gitlab_quality-test_tooling (1.26.0)1159$ section_start "failed-test-issues" "Report test failures" # collapsed multi-line command1162$ section_start "flaky-test-issues" "Report test flakiness" # collapsed multi-line command1165$ section_start "slow-test-issues" "Report test slowness" # collapsed multi-line command1168$ section_start "slow-test-merge-request-report-note" "Report test slowness in MR note" # collapsed multi-line command1172$ section_start "knapsack-report-issues" "Report test files close to timing out" # collapsed multi-line command1176$ tooling/bin/push_job_metrics || true1177[job-metrics] Pushing job metrics file for the CI/CD job.1178[job-metrics] Pushed 4 CI job metric entries to InfluxDB.1180Not uploading cache ruby-gems-debian-bookworm-ruby-3.2-17 due to policy1182Uploading artifacts...1183auto_explain/: found 2 matching artifact files and directories 1184coverage/: found 5 matching artifact files and directories 1185crystalball/: found 2 matching artifact files and directories 1186WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab) 1187knapsack/: found 4 matching artifact files and directories 1188rspec/: found 16 matching artifact files and directories 1189WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab) 1190log/*.log: found 13 matching artifact files and directories 1191WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/6975007956/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com1192WARNING: Retrying... context=artifacts-uploader error=request redirected1193Uploading artifacts as "archive" to coordinator... 201 Created id=6975007956 responseStatus=201 Created token=glcbt-651194Uploading artifacts...1195rspec/rspec-*.xml: found 1 matching artifact files and directories 1196WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/6975007956/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com1197WARNING: Retrying... context=artifacts-uploader error=request redirected1198Uploading artifacts as "junit" to coordinator... 201 Created id=6975007956 responseStatus=201 Created token=glcbt-651200Job succeeded