Skip to content
Snippets Groups Projects

rspec migration pg13 single-db 3/8

Passed Started by
🤖 GitLab Bot 🤖
@gitlab-bot
1Running with gitlab-runner 15.9.0~beta.212.g8ccc65e7 (8ccc65e7)
2 on green-2.private.runners-manager.gitlab.com/gitlab.com/gitlab-org GaSD-S1F, system ID: s_5651e5b5643b
3 feature flags: FF_NETWORK_PER_BUILD:true, FF_USE_FASTZIP:true, FF_USE_IMPROVED_URL_MASKING:true
4 Resolving secrets 00:00
5 Preparing the "docker+machine" executor 00:07
6Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 ...
7Starting service postgres:13 ...
8Pulling docker image postgres:13 ...
9Using docker image sha256:dd421ca1f7f13d81c5c145d77d97d8d84cd0e6f1e045936ee506ce0f50ee397a for postgres:13 with digest postgres@sha256:00f455399f30cc3f2fe4185476601438b7a4959c74653665582d7c313a783d51 ...
10Starting service redis:6.2-alpine ...
11Pulling docker image redis:6.2-alpine ...
12Using docker image sha256:3616f0c0705d2a35d30dde109daf3cbe58ae7284121aafa6f5cfa987db98d1a8 for redis:6.2-alpine with digest redis@sha256:edddbcad5a41d58df2f142d68439922f1860ea902903d016257337c3342f30fc ...
13Waiting for services to be up and running (timeout 30 seconds)...
14Authenticating with credentials from job payload (GitLab Registry)
15Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 ...
16Using docker image sha256:7a1b51158a1ee23b080b514ce6ebbf52ac51585877198fb52709e5cd01805a77 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13@sha256:412d55913d43377094427ced549cb422ed2f2c7223e6a605d0d3e0151cb892b0 ...
17 Preparing environment 00:00
18Running on runner-gasd-s1f-project-278964-concurrent-0 via runner-gasd-s1f-private-1680169856-92073227...
19 Getting source from Git repository 00:27
20$ eval "$CI_PRE_CLONE_SCRIPT"
21Fetching changes with git depth set to 20...
22Initialized empty Git repository in /builds/gitlab-org/gitlab/.git/
23Created fresh repository.
24remote: Enumerating objects: 135903, done.
25remote: Counting objects: 100% (135903/135903), done.
26remote: Compressing objects: 100% (88560/88560), done.
27remote: Total 135903 (delta 58315), reused 94618 (delta 42152), pack-reused 0
28Receiving objects: 100% (135903/135903), 121.35 MiB | 29.91 MiB/s, done.
29Resolving deltas: 100% (58315/58315), done.
30From https://git-us-east1-d.ci-gateway.int.gprd.gitlab.net:8989/gitlab-org/gitlab
31 * [new ref] refs/pipelines/822866544 -> refs/pipelines/822866544
32Checking out 523abdde as detached HEAD (ref is refs/merge-requests/116270/merge)...
33Skipping Git submodules setup
34$ git remote set-url origin "${CI_REPOSITORY_URL}"
35 Restoring cache 00:15
36Checking cache for ruby-gems-debian-bullseye-ruby-3.0-16...
37cache.zip is up to date
38Successfully extracted cache
39Checking cache for gitaly-ruby-gems-debian-bullseye-ruby-3.0-16...
40cache.zip is up to date
41Successfully extracted cache
42 Downloading artifacts 00:20
43Downloading artifacts for compile-test-assets (4031138198)...
44Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4031138198 responseStatus=200 OK token=64_fFD9x
45Downloading artifacts for detect-tests (4031138213)...
46Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4031138213 responseStatus=200 OK token=64_fFD9x
47Downloading artifacts for retrieve-tests-metadata (4031138217)...
48Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4031138217 responseStatus=200 OK token=64_fFD9x
49Downloading artifacts for setup-test-env (4031138204)...
50Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4031138204 responseStatus=200 OK token=64_fFD9x
51 Executing "step_script" stage of the job script 24:32
52Using docker image sha256:7a1b51158a1ee23b080b514ce6ebbf52ac51585877198fb52709e5cd01805a77 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13@sha256:412d55913d43377094427ced549cb422ed2f2c7223e6a605d0d3e0151cb892b0 ...
53$ echo $FOSS_ONLY
54$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
55$ export GOPATH=$CI_PROJECT_DIR/.go
56$ mkdir -p $GOPATH
57$ source scripts/utils.sh
58$ source scripts/prepare_build.sh
59 Installing gems 00:13
709Using decomposed database config (config/database.yml.postgresql)
710Geo DB won't be set up.
711$ setup_db_user_only
712CREATE ROLE
713GRANT
714==> 'setup_db_user_only' succeeded in 0 seconds.
715$ bundle exec rake db:drop db:create db:schema:load db:migrate gitlab:db:lock_writes
716Dropped database 'gitlabhq_test'
717Created database 'gitlabhq_test'
718==> 'bundle exec rake db:drop db:create db:schema:load db:migrate gitlab:db:lock_writes' succeeded in 35 seconds.
719$ setup_db_praefect
720SELECT pg_catalog.set_config('search_path', '', false);
721CREATE DATABASE praefect_test ENCODING 'UTF8';
722==> 'setup_db_praefect' succeeded in 0 seconds.
723$ source ./scripts/rspec_helpers.sh
724$ run_timed_command "gem install knapsack --no-document"
725$ gem install knapsack --no-document
726Successfully installed knapsack-4.0.0
7271 gem installed
728==> 'gem install knapsack --no-document' succeeded in 0 seconds.
729$ echo -e "\e[0Ksection_start:`date +%s`:gitaly-test-spawn[collapsed=true]\r\e[0KStarting Gitaly"
730 Starting Gitaly 00:10
833$ rspec_paralellized_job "--tag ~quarantine --tag ~zoekt"
834SKIP_FLAKY_TESTS_AUTOMATICALLY: false
835RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
836KNAPSACK_GENERATE_REPORT: true
837FLAKY_RSPEC_GENERATE_REPORT: true
838KNAPSACK_TEST_FILE_PATTERN: spec/{migrations}{,/**/}*_spec.rb
839KNAPSACK_LOG_LEVEL: debug
840KNAPSACK_REPORT_PATH: knapsack/rspec_migration_pg13_single-db_3_8_report.json
841FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
842FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec_migration_pg13_single-db_3_8_report.json
843NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec_migration_pg13_single-db_3_8_report.json
844SKIPPED_FLAKY_TESTS_REPORT_PATH: rspec/flaky/skipped_flaky_tests_rspec_migration_pg13_single-db_3_8_report.txt
845CRYSTALBALL:
846Knapsack node specs:
847spec/migrations/sync_new_amount_used_for_ci_project_monthly_usages_spec.rb
848spec/migrations/schedule_purging_stale_security_scans_spec.rb
849spec/migrations/20220106111958_add_insert_or_update_vulnerability_reads_trigger_spec.rb
850spec/migrations/recreate_index_security_ci_builds_on_name_and_id_parser_with_new_features_spec.rb
851spec/migrations/update_application_settings_container_registry_exp_pol_worker_capacity_default_spec.rb
852spec/migrations/remove_wiki_notes_spec.rb
853spec/migrations/20211214012507_backfill_incident_issue_escalation_statuses_spec.rb
854spec/migrations/remove_invalid_integrations_spec.rb
855spec/migrations/20220322132242_update_pages_onboarding_state_spec.rb
856spec/migrations/20220223124428_schedule_merge_topics_with_same_name_spec.rb
857spec/migrations/20220601152916_add_user_id_and_ip_address_success_index_to_authentication_events_spec.rb
858spec/migrations/update_default_scan_method_of_dast_site_profile_spec.rb
859spec/migrations/20220721031446_schedule_disable_legacy_open_source_license_for_one_member_no_repo_projects_spec.rb
860spec/migrations/20220601110011_schedule_remove_self_managed_wiki_notes_spec.rb
861spec/migrations/20220622080547_backfill_project_statistics_with_container_registry_size_spec.rb
862spec/migrations/20220307192610_remove_duplicate_project_tag_releases_spec.rb
863spec/migrations/20220606082910_add_tmp_index_for_potentially_misassociated_vulnerability_occurrences_spec.rb
864spec/migrations/move_security_findings_table_to_gitlab_partitions_dynamic_schema_spec.rb
865spec/migrations/orphaned_invited_members_cleanup_spec.rb
866spec/migrations/queue_backfill_project_feature_package_registry_access_level_spec.rb
867spec/migrations/20220921093355_schedule_backfill_namespace_details_spec.rb
868spec/migrations/20220725150127_update_jira_tracker_data_deployment_type_based_on_url_spec.rb
869spec/migrations/20221101032521_add_default_preferred_language_to_application_settings_spec.rb
870spec/migrations/20221223123019_delete_queued_jobs_for_vulnerabilities_feedback_migration_spec.rb
871spec/migrations/20221110152133_delete_orphans_approval_rules_spec.rb
872spec/migrations/set_email_confirmation_setting_from_soft_email_confirmation_ff_spec.rb
873spec/migrations/recount_epic_cache_counts_v3_spec.rb
874spec/migrations/20230202211434_migrate_redis_slot_keys_spec.rb
875spec/migrations/ensure_timelogs_note_id_bigint_backfill_is_finished_for_gitlab_dot_com_spec.rb
876spec/migrations/20230221093533_add_tmp_partial_index_on_vulnerability_report_types_spec.rb
877spec/migrations/20230306195007_queue_backfill_project_wiki_repositories_spec.rb
878spec/migrations/20230309071242_delete_security_policy_bot_users_spec.rb
879Filter specs:
880Running specs:
881Running all node tests without filter
882spec/migrations/sync_new_amount_used_for_ci_project_monthly_usages_spec.rb
883spec/migrations/schedule_purging_stale_security_scans_spec.rb
884spec/migrations/20220106111958_add_insert_or_update_vulnerability_reads_trigger_spec.rb
885spec/migrations/recreate_index_security_ci_builds_on_name_and_id_parser_with_new_features_spec.rb
886spec/migrations/update_application_settings_container_registry_exp_pol_worker_capacity_default_spec.rb
887spec/migrations/remove_wiki_notes_spec.rb
888spec/migrations/20211214012507_backfill_incident_issue_escalation_statuses_spec.rb
889spec/migrations/remove_invalid_integrations_spec.rb
890spec/migrations/20220322132242_update_pages_onboarding_state_spec.rb
891spec/migrations/20220223124428_schedule_merge_topics_with_same_name_spec.rb
892spec/migrations/20220601152916_add_user_id_and_ip_address_success_index_to_authentication_events_spec.rb
893spec/migrations/update_default_scan_method_of_dast_site_profile_spec.rb
894spec/migrations/20220721031446_schedule_disable_legacy_open_source_license_for_one_member_no_repo_projects_spec.rb
895spec/migrations/20220601110011_schedule_remove_self_managed_wiki_notes_spec.rb
896spec/migrations/20220622080547_backfill_project_statistics_with_container_registry_size_spec.rb
897spec/migrations/20220307192610_remove_duplicate_project_tag_releases_spec.rb
898spec/migrations/20220606082910_add_tmp_index_for_potentially_misassociated_vulnerability_occurrences_spec.rb
899spec/migrations/move_security_findings_table_to_gitlab_partitions_dynamic_schema_spec.rb
900spec/migrations/orphaned_invited_members_cleanup_spec.rb
901spec/migrations/queue_backfill_project_feature_package_registry_access_level_spec.rb
902spec/migrations/20220921093355_schedule_backfill_namespace_details_spec.rb
903spec/migrations/20220725150127_update_jira_tracker_data_deployment_type_based_on_url_spec.rb
904spec/migrations/20221101032521_add_default_preferred_language_to_application_settings_spec.rb
905spec/migrations/20221223123019_delete_queued_jobs_for_vulnerabilities_feedback_migration_spec.rb
906spec/migrations/20221110152133_delete_orphans_approval_rules_spec.rb
907spec/migrations/set_email_confirmation_setting_from_soft_email_confirmation_ff_spec.rb
908spec/migrations/recount_epic_cache_counts_v3_spec.rb
909spec/migrations/20230202211434_migrate_redis_slot_keys_spec.rb
910spec/migrations/ensure_timelogs_note_id_bigint_backfill_is_finished_for_gitlab_dot_com_spec.rb
911spec/migrations/20230221093533_add_tmp_partial_index_on_vulnerability_report_types_spec.rb
912spec/migrations/20230306195007_queue_backfill_project_wiki_repositories_spec.rb
913spec/migrations/20230309071242_delete_security_policy_bot_users_spec.rb
914Running all node tests without filter
915Running all node tests without filter
916Running command: bundle exec rspec -Ispec -rspec_helper --color --failure-exit-code 1 --error-exit-code 2 --format documentation --format RspecJunitFormatter --out rspec/junit_rspec.xml --tag ~quarantine --tag ~zoekt --default-path spec -- spec/migrations/sync_new_amount_used_for_ci_project_monthly_usages_spec.rb spec/migrations/schedule_purging_stale_security_scans_spec.rb spec/migrations/20220106111958_add_insert_or_update_vulnerability_reads_trigger_spec.rb spec/migrations/recreate_index_security_ci_builds_on_name_and_id_parser_with_new_features_spec.rb spec/migrations/update_application_settings_container_registry_exp_pol_worker_capacity_default_spec.rb spec/migrations/remove_wiki_notes_spec.rb spec/migrations/20211214012507_backfill_incident_issue_escalation_statuses_spec.rb spec/migrations/remove_invalid_integrations_spec.rb spec/migrations/20220322132242_update_pages_onboarding_state_spec.rb spec/migrations/20220223124428_schedule_merge_topics_with_same_name_spec.rb spec/migrations/20220601152916_add_user_id_and_ip_address_success_index_to_authentication_events_spec.rb spec/migrations/update_default_scan_method_of_dast_site_profile_spec.rb spec/migrations/20220721031446_schedule_disable_legacy_open_source_license_for_one_member_no_repo_projects_spec.rb spec/migrations/20220601110011_schedule_remove_self_managed_wiki_notes_spec.rb spec/migrations/20220622080547_backfill_project_statistics_with_container_registry_size_spec.rb spec/migrations/20220307192610_remove_duplicate_project_tag_releases_spec.rb spec/migrations/20220606082910_add_tmp_index_for_potentially_misassociated_vulnerability_occurrences_spec.rb spec/migrations/move_security_findings_table_to_gitlab_partitions_dynamic_schema_spec.rb spec/migrations/orphaned_invited_members_cleanup_spec.rb spec/migrations/queue_backfill_project_feature_package_registry_access_level_spec.rb spec/migrations/20220921093355_schedule_backfill_namespace_details_spec.rb spec/migrations/20220725150127_update_jira_tracker_data_deployment_type_based_on_url_spec.rb spec/migrations/20221101032521_add_default_preferred_language_to_application_settings_spec.rb spec/migrations/20221223123019_delete_queued_jobs_for_vulnerabilities_feedback_migration_spec.rb spec/migrations/20221110152133_delete_orphans_approval_rules_spec.rb spec/migrations/set_email_confirmation_setting_from_soft_email_confirmation_ff_spec.rb spec/migrations/recount_epic_cache_counts_v3_spec.rb spec/migrations/20230202211434_migrate_redis_slot_keys_spec.rb spec/migrations/ensure_timelogs_note_id_bigint_backfill_is_finished_for_gitlab_dot_com_spec.rb spec/migrations/20230221093533_add_tmp_partial_index_on_vulnerability_report_types_spec.rb spec/migrations/20230306195007_queue_backfill_project_wiki_repositories_spec.rb spec/migrations/20230309071242_delete_security_policy_bot_users_spec.rbKnapsack report generator started!
917Run options: exclude {:quarantine=>true, :zoekt=>true}
918Test environment set up in 1.977053141 seconds
919SyncNewAmountUsedForCiProjectMonthlyUsages
920 # order random
921main: == 20221011062254 SyncNewAmountUsedForCiProjectMonthlyUsages: migrating =======
922main: == 20221011062254 SyncNewAmountUsedForCiProjectMonthlyUsages: migrated (0.0128s)
923 updates `new_amount_used` with values from `amount_used`
924SchedulePurgingStaleSecurityScans
925 when the migration does not run on GitLab.com or `dev_or_test_env`
926main: == 20220407163559 SchedulePurgingStaleSecurityScans: migrating ================
927main: == 20220407163559 SchedulePurgingStaleSecurityScans: migrated (0.0005s) =======
928 does not run the migration
929 when the migration runs on GitLab.com
930 behaves like schedules the background jobs
931main: == 20220407163559 SchedulePurgingStaleSecurityScans: migrating ================
932main: -- Scheduled 2 PurgeStaleSecurityScans jobs with a maximum of 1 records per batch and an interval of 120 seconds.
933The migration is expected to take at least 240 seconds. Expect all jobs to have completed after 2023-03-30 11:44:56 UTC."
934main: == 20220407163559 SchedulePurgingStaleSecurityScans: migrated (0.0468s) =======
935 creates 2 jobs
936 when the migration runs on dev or test env
937 behaves like schedules the background jobs
938main: == 20220407163559 SchedulePurgingStaleSecurityScans: migrating ================
939main: -- Scheduled 2 PurgeStaleSecurityScans jobs with a maximum of 1 records per batch and an interval of 120 seconds.
940The migration is expected to take at least 240 seconds. Expect all jobs to have completed after 2023-03-30 11:44:57 UTC."
941main: == 20220407163559 SchedulePurgingStaleSecurityScans: migrated (0.0407s) =======
942 creates 2 jobs
943AddInsertOrUpdateVulnerabilityReadsTrigger
944 #up
945 UPDATE trigger
946 when vulnerability_id is updated
947main: == 20220106111958 AddInsertOrUpdateVulnerabilityReadsTrigger: migrating =======
948main: -- execute("CREATE OR REPLACE FUNCTION insert_or_update_vulnerability_reads()\nRETURNS TRIGGER\nLANGUAGE plpgsql\nAS $$\nDECLARE\n severity smallint;\n state smallint;\n report_type smallint;\n resolved_on_default_branch boolean;\nBEGIN\n IF (NEW.vulnerability_id IS NULL AND (TG_OP = 'INSERT' OR TG_OP = 'UPDATE')) THEN\n RETURN NULL;\n END IF;\n\n IF (TG_OP = 'UPDATE' AND OLD.vulnerability_id IS NOT NULL AND NEW.vulnerability_id IS NOT NULL) THEN\n RETURN NULL;\n END IF;\n\n SELECT\n vulnerabilities.severity, vulnerabilities.state, vulnerabilities.report_type, vulnerabilities.resolved_on_default_branch\n INTO\n severity, state, report_type, resolved_on_default_branch\n FROM\n vulnerabilities\n WHERE\n vulnerabilities.id = NEW.vulnerability_id;\n\n INSERT INTO vulnerability_reads (vulnerability_id, project_id, scanner_id, report_type, severity, state, resolved_on_default_branch, uuid, location_image, cluster_agent_id)\n VALUES (NEW.vulnerability_id, NEW.project_id, NEW.scanner_id, report_type, severity, state, resolved_on_default_branch, NEW.uuid::uuid, NEW.location->>'image', NEW.location->'kubernetes_resource'->>'agent_id')\n ON CONFLICT(vulnerability_id) DO NOTHING;\n RETURN NULL;\nEND\n$$;\n")
949main: -> 0.0020s
950main: -- execute("CREATE TRIGGER trigger_insert_or_update_vulnerability_reads_from_occurrences\nAFTER INSERT OR UPDATE ON vulnerability_occurrences\nFOR EACH ROW\nEXECUTE PROCEDURE insert_or_update_vulnerability_reads();\n")
951main: -> 0.0012s
952main: == 20220106111958 AddInsertOrUpdateVulnerabilityReadsTrigger: migrated (0.0034s)
953 creates a new vulnerability_reads row
954 when vulnerability_id is not updated
955main: == 20220106111958 AddInsertOrUpdateVulnerabilityReadsTrigger: migrating =======
956main: -- execute("CREATE OR REPLACE FUNCTION insert_or_update_vulnerability_reads()\nRETURNS TRIGGER\nLANGUAGE plpgsql\nAS $$\nDECLARE\n severity smallint;\n state smallint;\n report_type smallint;\n resolved_on_default_branch boolean;\nBEGIN\n IF (NEW.vulnerability_id IS NULL AND (TG_OP = 'INSERT' OR TG_OP = 'UPDATE')) THEN\n RETURN NULL;\n END IF;\n\n IF (TG_OP = 'UPDATE' AND OLD.vulnerability_id IS NOT NULL AND NEW.vulnerability_id IS NOT NULL) THEN\n RETURN NULL;\n END IF;\n\n SELECT\n vulnerabilities.severity, vulnerabilities.state, vulnerabilities.report_type, vulnerabilities.resolved_on_default_branch\n INTO\n severity, state, report_type, resolved_on_default_branch\n FROM\n vulnerabilities\n WHERE\n vulnerabilities.id = NEW.vulnerability_id;\n\n INSERT INTO vulnerability_reads (vulnerability_id, project_id, scanner_id, report_type, severity, state, resolved_on_default_branch, uuid, location_image, cluster_agent_id)\n VALUES (NEW.vulnerability_id, NEW.project_id, NEW.scanner_id, report_type, severity, state, resolved_on_default_branch, NEW.uuid::uuid, NEW.location->>'image', NEW.location->'kubernetes_resource'->>'agent_id')\n ON CONFLICT(vulnerability_id) DO NOTHING;\n RETURN NULL;\nEND\n$$;\n")
957main: -> 0.0025s
958main: -- execute("CREATE TRIGGER trigger_insert_or_update_vulnerability_reads_from_occurrences\nAFTER INSERT OR UPDATE ON vulnerability_occurrences\nFOR EACH ROW\nEXECUTE PROCEDURE insert_or_update_vulnerability_reads();\n")
959main: -> 0.0014s
960main: == 20220106111958 AddInsertOrUpdateVulnerabilityReadsTrigger: migrated (0.0040s)
961 does not create a new vulnerability_reads row
962 INSERT trigger
963 when vulnerability_id is set
964main: == 20220106111958 AddInsertOrUpdateVulnerabilityReadsTrigger: migrating =======
965main: -- execute("CREATE OR REPLACE FUNCTION insert_or_update_vulnerability_reads()\nRETURNS TRIGGER\nLANGUAGE plpgsql\nAS $$\nDECLARE\n severity smallint;\n state smallint;\n report_type smallint;\n resolved_on_default_branch boolean;\nBEGIN\n IF (NEW.vulnerability_id IS NULL AND (TG_OP = 'INSERT' OR TG_OP = 'UPDATE')) THEN\n RETURN NULL;\n END IF;\n\n IF (TG_OP = 'UPDATE' AND OLD.vulnerability_id IS NOT NULL AND NEW.vulnerability_id IS NOT NULL) THEN\n RETURN NULL;\n END IF;\n\n SELECT\n vulnerabilities.severity, vulnerabilities.state, vulnerabilities.report_type, vulnerabilities.resolved_on_default_branch\n INTO\n severity, state, report_type, resolved_on_default_branch\n FROM\n vulnerabilities\n WHERE\n vulnerabilities.id = NEW.vulnerability_id;\n\n INSERT INTO vulnerability_reads (vulnerability_id, project_id, scanner_id, report_type, severity, state, resolved_on_default_branch, uuid, location_image, cluster_agent_id)\n VALUES (NEW.vulnerability_id, NEW.project_id, NEW.scanner_id, report_type, severity, state, resolved_on_default_branch, NEW.uuid::uuid, NEW.location->>'image', NEW.location->'kubernetes_resource'->>'agent_id')\n ON CONFLICT(vulnerability_id) DO NOTHING;\n RETURN NULL;\nEND\n$$;\n")
966main: -> 0.0026s
967main: -- execute("CREATE TRIGGER trigger_insert_or_update_vulnerability_reads_from_occurrences\nAFTER INSERT OR UPDATE ON vulnerability_occurrences\nFOR EACH ROW\nEXECUTE PROCEDURE insert_or_update_vulnerability_reads();\n")
968main: -> 0.0014s
969main: == 20220106111958 AddInsertOrUpdateVulnerabilityReadsTrigger: migrated (0.0042s)
970 creates a new vulnerability_reads row
971 when vulnerability_id is not set
972main: == 20220106111958 AddInsertOrUpdateVulnerabilityReadsTrigger: migrating =======
973main: -- execute("CREATE OR REPLACE FUNCTION insert_or_update_vulnerability_reads()\nRETURNS TRIGGER\nLANGUAGE plpgsql\nAS $$\nDECLARE\n severity smallint;\n state smallint;\n report_type smallint;\n resolved_on_default_branch boolean;\nBEGIN\n IF (NEW.vulnerability_id IS NULL AND (TG_OP = 'INSERT' OR TG_OP = 'UPDATE')) THEN\n RETURN NULL;\n END IF;\n\n IF (TG_OP = 'UPDATE' AND OLD.vulnerability_id IS NOT NULL AND NEW.vulnerability_id IS NOT NULL) THEN\n RETURN NULL;\n END IF;\n\n SELECT\n vulnerabilities.severity, vulnerabilities.state, vulnerabilities.report_type, vulnerabilities.resolved_on_default_branch\n INTO\n severity, state, report_type, resolved_on_default_branch\n FROM\n vulnerabilities\n WHERE\n vulnerabilities.id = NEW.vulnerability_id;\n\n INSERT INTO vulnerability_reads (vulnerability_id, project_id, scanner_id, report_type, severity, state, resolved_on_default_branch, uuid, location_image, cluster_agent_id)\n VALUES (NEW.vulnerability_id, NEW.project_id, NEW.scanner_id, report_type, severity, state, resolved_on_default_branch, NEW.uuid::uuid, NEW.location->>'image', NEW.location->'kubernetes_resource'->>'agent_id')\n ON CONFLICT(vulnerability_id) DO NOTHING;\n RETURN NULL;\nEND\n$$;\n")
974main: -> 0.0024s
975main: -- execute("CREATE TRIGGER trigger_insert_or_update_vulnerability_reads_from_occurrences\nAFTER INSERT OR UPDATE ON vulnerability_occurrences\nFOR EACH ROW\nEXECUTE PROCEDURE insert_or_update_vulnerability_reads();\n")
976main: -> 0.0012s
977main: == 20220106111958 AddInsertOrUpdateVulnerabilityReadsTrigger: migrated (0.0038s)
978 does not create a new vulnerability_reads row
979 #down
980main: -- execute("CREATE OR REPLACE FUNCTION insert_or_update_vulnerability_reads()\nRETURNS TRIGGER\nLANGUAGE plpgsql\nAS $$\nDECLARE\n severity smallint;\n state smallint;\n report_type smallint;\n resolved_on_default_branch boolean;\nBEGIN\n IF (NEW.vulnerability_id IS NULL AND (TG_OP = 'INSERT' OR TG_OP = 'UPDATE')) THEN\n RETURN NULL;\n END IF;\n\n IF (TG_OP = 'UPDATE' AND OLD.vulnerability_id IS NOT NULL AND NEW.vulnerability_id IS NOT NULL) THEN\n RETURN NULL;\n END IF;\n\n SELECT\n vulnerabilities.severity, vulnerabilities.state, vulnerabilities.report_type, vulnerabilities.resolved_on_default_branch\n INTO\n severity, state, report_type, resolved_on_default_branch\n FROM\n vulnerabilities\n WHERE\n vulnerabilities.id = NEW.vulnerability_id;\n\n INSERT INTO vulnerability_reads (vulnerability_id, project_id, scanner_id, report_type, severity, state, resolved_on_default_branch, uuid, location_image, cluster_agent_id)\n VALUES (NEW.vulnerability_id, NEW.project_id, NEW.scanner_id, report_type, severity, state, resolved_on_default_branch, NEW.uuid::uuid, NEW.location->>'image', NEW.location->'kubernetes_resource'->>'agent_id')\n ON CONFLICT(vulnerability_id) DO NOTHING;\n RETURN NULL;\nEND\n$$;\n")
981main: -> 0.0019s
982main: -- execute("CREATE TRIGGER trigger_insert_or_update_vulnerability_reads_from_occurrences\nAFTER INSERT OR UPDATE ON vulnerability_occurrences\nFOR EACH ROW\nEXECUTE PROCEDURE insert_or_update_vulnerability_reads();\n")
983main: -> 0.0014s
984main: -- execute("DROP TRIGGER IF EXISTS trigger_insert_or_update_vulnerability_reads_from_occurrences ON vulnerability_occurrences")
985main: -> 0.0012s
986main: -- execute("DROP FUNCTION IF EXISTS insert_or_update_vulnerability_reads()")
987main: -> 0.0011s
988 drops the trigger
989RecreateIndexSecurityCiBuildsOnNameAndIdParserWithNewFeatures
990main: -- index_exists?("ci_builds", [:name, :id], {:name=>"index_security_ci_builds_on_name_and_id_parser_features"})
991main: -> 0.0328s
992main: -- index_exists?("ci_builds", [:name, :id], {:name=>"index_security_ci_builds_on_name_and_id_parser_features_old"})
993main: -> 0.0307s
994main: == 20220224204415 RecreateIndexSecurityCiBuildsOnNameAndIdParserWithNewFeatures: migrating
995main: -- rename_index("ci_builds", "index_security_ci_builds_on_name_and_id_parser_features", "index_security_ci_builds_on_name_and_id_parser_features_old")
996main: -> 0.0012s
997main: -- index_exists?("ci_builds", [:name, :id], {:name=>"index_security_ci_builds_on_name_and_id_parser_features", :where=>"(name::text = ANY (ARRAY['container_scanning'::character varying::text,\n 'dast'::character varying::text,\n 'dependency_scanning'::character varying::text,\n 'license_management'::character varying::text,\n 'sast'::character varying::text,\n 'secret_detection'::character varying::text,\n 'coverage_fuzzing'::character varying::text,\n 'license_scanning'::character varying::text,\n 'apifuzzer_fuzz'::character varying::text,\n 'apifuzzer_fuzz_dnd'::character varying::text])\n ) AND type::text = 'Ci::Build'::text", :algorithm=>:concurrently})
998main: -> 0.0303s
999main: -- add_index_options("ci_builds", [:name, :id], {:name=>"index_security_ci_builds_on_name_and_id_parser_features", :where=>"(name::text = ANY (ARRAY['container_scanning'::character varying::text,\n 'dast'::character varying::text,\n 'dependency_scanning'::character varying::text,\n 'license_management'::character varying::text,\n 'sast'::character varying::text,\n 'secret_detection'::character varying::text,\n 'coverage_fuzzing'::character varying::text,\n 'license_scanning'::character varying::text,\n 'apifuzzer_fuzz'::character varying::text,\n 'apifuzzer_fuzz_dnd'::character varying::text])\n ) AND type::text = 'Ci::Build'::text", :algorithm=>:concurrently})
1000main: -> 0.0001s
1001main: == 20220224204415 RecreateIndexSecurityCiBuildsOnNameAndIdParserWithNewFeatures: migrated (0.0489s)
1002main: -- index_exists?("ci_builds", [:name, :id], {:name=>"index_security_ci_builds_on_name_and_id_parser_features"})
1003main: -> 0.0293s
1004main: -- index_exists?("ci_builds", [:name, :id], {:name=>"index_security_ci_builds_on_name_and_id_parser_features_old"})
1005main: -> 0.0294s
1006main: -- index_exists?("ci_builds", [:name, :id], {:name=>"index_security_ci_builds_on_name_and_id_parser_features"})
1007main: -> 0.0309s
1008main: -- index_exists?("ci_builds", [:name, :id], {:name=>"index_security_ci_builds_on_name_and_id_parser_features_old"})
1009main: -> 0.0316s
1010 recreates index
1011UpdateApplicationSettingsContainerRegistryExpPolWorkerCapacityDefault
1012 with no rows in the application_settings table
1013main: == 20220215164709 UpdateApplicationSettingsContainerRegistryExpPolWorkerCapacityDefault: migrating
1014main: -- change_column_default(:application_settings, :container_registry_expiration_policies_worker_capacity, {:from=>0, :to=>4})
1015main: -> 0.1525s
1016main: == 20220215164709 UpdateApplicationSettingsContainerRegistryExpPolWorkerCapacityDefault: migrated (0.1694s)
1017 does not insert a row
1018 with a row in the application_settings table
1019 with container_registry_expiration_policy_worker_capacity set to a value different than 0
1020main: == 20220215164709 UpdateApplicationSettingsContainerRegistryExpPolWorkerCapacityDefault: migrating
1021main: -- change_column_default(:application_settings, :container_registry_expiration_policies_worker_capacity, {:from=>0, :to=>4})
1022main: -> 0.1831s
1023main: == 20220215164709 UpdateApplicationSettingsContainerRegistryExpPolWorkerCapacityDefault: migrated (0.3668s)
1024 does not update the row
1025 with container_registry_expiration_policy_worker_capacity set to 0
1026main: == 20220215164709 UpdateApplicationSettingsContainerRegistryExpPolWorkerCapacityDefault: migrating
1027main: -- change_column_default(:application_settings, :container_registry_expiration_policies_worker_capacity, {:from=>0, :to=>4})
1028main: -> 0.1472s
1029main: == 20220215164709 UpdateApplicationSettingsContainerRegistryExpPolWorkerCapacityDefault: migrated (0.3370s)
1030 updates the existing row
1031RemoveWikiNotes
1032main: == 20220322094410 RemoveWikiNotes: migrating ==================================
1033main: == 20220322094410 RemoveWikiNotes: migrated (0.0060s) =========================
1034 removes all wiki notes
1035 when not staging nor com
1036main: == 20220322094410 RemoveWikiNotes: migrating ==================================
1037main: == 20220322094410 RemoveWikiNotes: migrated (0.0004s) =========================
1038 does not remove notes
1039BackfillIncidentIssueEscalationStatuses
1040 # order random
1041main: == 20211214012507 BackfillIncidentIssueEscalationStatuses: migrating ==========
1042main: == 20211214012507 BackfillIncidentIssueEscalationStatuses: migrated (0.0000s) =
1043 does nothing
1044RemoveInvalidIntegrations
1045 #up
1046main: == 20220607140222 RemoveInvalidIntegrations: migrating ========================
1047main: == 20220607140222 RemoveInvalidIntegrations: migrated (0.0060s) ===============
1048 removes invalid integrations
1049 when there are many invalid integrations
1050main: == 20220607140222 RemoveInvalidIntegrations: migrating ========================
1051main: == 20220607140222 RemoveInvalidIntegrations: migrated (0.0148s) ===============
1052 removes them all
1053The application_settings (main) table has 1226 columns.
1054Recreating the database
1055Dropped database 'gitlabhq_test'
1056Created database 'gitlabhq_test'
1057Databases re-creation done in 6.065742410999519
1058UpdatePagesOnboardingState
1059 #up
1060 sets the onboarding_complete attribute to the value of deployed
1061 #down
1062 sets all onboarding_complete attributes to false
1063ScheduleMergeTopicsWithSameName
1064 #up
1065main: == 20220223124428 ScheduleMergeTopicsWithSameName: migrating ==================
1066main: == 20220223124428 ScheduleMergeTopicsWithSameName: migrated (0.0112s) =========
1067 schedules MergeTopicsWithSameName background jobs
1068AddUserIdAndIpAddressSuccessIndexToAuthenticationEvents
1069main: == 20220601152916 AddUserIdAndIpAddressSuccessIndexToAuthenticationEvents: migrating
1070main: -- view_exists?(:postgres_partitions)
1071main: -> 0.0017s
1072main: -- index_exists?(:authentication_events, [:user_id, :ip_address, :result], {:name=>"index_authentication_events_on_user_and_ip_address_and_result", :algorithm=>:concurrently})
1073main: -> 0.0066s
1074main: -- add_index(:authentication_events, [:user_id, :ip_address, :result], {:name=>"index_authentication_events_on_user_and_ip_address_and_result", :algorithm=>:concurrently})
1075main: -> 0.0021s
1076main: -- view_exists?(:postgres_partitions)
1077main: -> 0.0015s
1078main: -- indexes(:authentication_events)
1079main: -> 0.0069s
1080main: -- remove_index(:authentication_events, {:algorithm=>:concurrently, :name=>"index_authentication_events_on_user_id"})
1081main: -> 0.0015s
1082main: == 20220601152916 AddUserIdAndIpAddressSuccessIndexToAuthenticationEvents: migrated (0.0500s)
1083 correctly migrates up and down
1084UpdateDefaultScanMethodOfDastSiteProfile
1085main: == 20220208171826 UpdateDefaultScanMethodOfDastSiteProfile: migrating =========
1086main: -- execute("UPDATE dast_site_profiles\nSET scan_method = 1\nWHERE id BETWEEN 2 AND 2\n")
1087main: -> 0.0014s
1088main: == 20220208171826 UpdateDefaultScanMethodOfDastSiteProfile: migrated (0.0162s)
1089 updates the scan_method to 1 for profiles with target_type 1
1090ScheduleDisableLegacyOpenSourceLicenseForOneMemberNoRepoProjects
1091 when on gitlab.com
1092 #up
1093main: == 20220721031446 ScheduleDisableLegacyOpenSourceLicenseForOneMemberNoRepoProjects: migrating
1094main: == 20220721031446 ScheduleDisableLegacyOpenSourceLicenseForOneMemberNoRepoProjects: migrated (0.0607s)
1095 schedules background jobs for each batch of projects
1096 #down
1097main: == 20220721031446 ScheduleDisableLegacyOpenSourceLicenseForOneMemberNoRepoProjects: migrating
1098main: == 20220721031446 ScheduleDisableLegacyOpenSourceLicenseForOneMemberNoRepoProjects: migrated (0.0532s)
1099 deletes all batched migration records
1100 when on self-managed instance
1101 #up
1102 does not schedule background job
1103 #down
1104 does not delete background job
1105ScheduleRemoveSelfManagedWikiNotes
1106main: == 20220601110011 ScheduleRemoveSelfManagedWikiNotes: migrating ===============
1107main: == 20220601110011 ScheduleRemoveSelfManagedWikiNotes: migrated (0.0707s) ======
1108 schedules new batched migration
1109 with com? or staging?
1110main: == 20220601110011 ScheduleRemoveSelfManagedWikiNotes: migrating ===============
1111main: == 20220601110011 ScheduleRemoveSelfManagedWikiNotes: migrated (0.0005s) ======
1112 does not schedule new batched migration
1113BackfillProjectStatisticsWithContainerRegistrySize
1114main: == 20220622080547 BackfillProjectStatisticsWithContainerRegistrySize: migrating
1115main: == 20220622080547 BackfillProjectStatisticsWithContainerRegistrySize: migrated (0.0005s)
1116 does not schedule background jobs when Gitlab.com is false
1117main: == 20220622080547 BackfillProjectStatisticsWithContainerRegistrySize: migrating
1118main: == 20220622080547 BackfillProjectStatisticsWithContainerRegistrySize: migrated (0.0512s)
1119 schedules background jobs for each batch of container_repository
1120RemoveDuplicateProjectTagReleases
1121 #up
1122main: == 20220307192610 RemoveDuplicateProjectTagReleases: migrating ================
1123main: == 20220307192610 RemoveDuplicateProjectTagReleases: migrated (0.0144s) =======
1124 correctly removes duplicate tags from the same project
1125AddTmpIndexForPotentiallyMisassociatedVulnerabilityOccurrences
1126main: == 20220606082910 AddTmpIndexForPotentiallyMisassociatedVulnerabilityOccurrences: migrating
1127main: -- index_exists?(:vulnerability_occurrences, [:id, :scanner_id], {:where=>"report_type IN (7,99)", :name=>"tmp_index_vulnerability_occurrences_on_id_and_scanner_id", :algorithm=>:concurrently})
1128main: -> 0.0099s
1129main: -- add_index_options(:vulnerability_occurrences, [:id, :scanner_id], {:where=>"report_type IN (7,99)", :name=>"tmp_index_vulnerability_occurrences_on_id_and_scanner_id", :algorithm=>:concurrently})
1130main: -> 0.0001s
1131main: == 20220606082910 AddTmpIndexForPotentiallyMisassociatedVulnerabilityOccurrences: migrated (0.0282s)
1132 schedules the index
1133The application_settings (main) table has 1232 columns.
1134Recreating the database
1135Dropped database 'gitlabhq_test'
1136Created database 'gitlabhq_test'
1137Databases re-creation done in 4.829997543999525
1138MoveSecurityFindingsTableToGitlabPartitionsDynamicSchema
1139 # order random
1140 #down
1141 when there is a partition
1142main: == 20220902204048 MoveSecurityFindingsTableToGitlabPartitionsDynamicSchema: migrating
1143main: -- execute("LOCK TABLE vulnerability_scanners, security_scans, security_findings IN ACCESS EXCLUSIVE MODE\n")
1144main: -> 0.0015s
1145main: -- execute("SELECT\n pg_get_constraintdef(pg_catalog.pg_constraint.oid)\nFROM\n pg_catalog.pg_constraint\nINNER JOIN pg_class ON pg_class.oid = pg_catalog.pg_constraint.conrelid\nWHERE\n conname = 'check_partition_number' AND\n pg_class.relname = 'security_findings'\n")
1146main: -> 0.0017s
1147main: -- execute("ALTER TABLE security_findings RENAME TO security_findings_1;\n")
1148main: -> 0.0010s
1149main: -- execute("ALTER INDEX security_findings_pkey RENAME TO security_findings_1_pkey;\n")
1150main: -> 0.0010s
1151main: -- execute("CREATE TABLE security_findings (\n LIKE security_findings_1 INCLUDING ALL\n) PARTITION BY LIST (partition_number);\n")
1152main: -> 0.0039s
1153main: -- execute("ALTER SEQUENCE security_findings_id_seq OWNED BY public.security_findings.id;\n")
1154main: -> 0.0009s
1155main: -- execute("ALTER TABLE security_findings\nADD CONSTRAINT fk_rails_729b763a54 FOREIGN KEY (scanner_id) REFERENCES vulnerability_scanners(id) ON DELETE CASCADE;\n")
1156main: -> 0.0013s
1157main: -- execute("ALTER TABLE security_findings\nADD CONSTRAINT fk_rails_bb63863cf1 FOREIGN KEY (scan_id) REFERENCES security_scans(id) ON DELETE CASCADE;\n")
1158main: -> 0.0015s
1159main: -- execute("ALTER TABLE security_findings_1 SET SCHEMA gitlab_partitions_dynamic;\n")
1160main: -> 0.0011s
1161main: -- execute("ALTER TABLE security_findings ATTACH PARTITION gitlab_partitions_dynamic.security_findings_1 FOR VALUES IN (1);\n")
1162main: -> 0.0026s
1163main: -- execute("ALTER TABLE security_findings DROP CONSTRAINT check_partition_number;\n")
1164main: -> 0.0011s
1165main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_unique_columns RENAME TO security_findings_1_uuid_scan_id_partition_number_idx;\n")
1166main: -> 0.0010s
1167main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_confidence RENAME TO security_findings_1_confidence_idx;\n")
1168main: -> 0.0014s
1169main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_project_fingerprint RENAME TO security_findings_1_project_fingerprint_idx;\n")
1170main: -> 0.0010s
1171main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_scan_id_and_deduplicated RENAME TO security_findings_1_scan_id_deduplicated_idx;\n")
1172main: -> 0.0009s
1173main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_scan_id_and_id RENAME TO security_findings_1_scan_id_id_idx;\n")
1174main: -> 0.0009s
1175main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_scanner_id RENAME TO security_findings_1_scanner_id_idx;\n")
1176main: -> 0.0014s
1177main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_severity RENAME TO security_findings_1_severity_idx;\n")
1178main: -> 0.0009s
1179main: == 20220902204048 MoveSecurityFindingsTableToGitlabPartitionsDynamicSchema: migrated (0.0322s)
1180WARNING: Active Record does not support composite primary key.
1181security_findings has composite primary key. Composite primary key is ignored.
1182 creates the original table with the data from the existing partition
1183 when there are more than one partitions
1184main: == 20220902204048 MoveSecurityFindingsTableToGitlabPartitionsDynamicSchema: migrating
1185main: -- execute("LOCK TABLE vulnerability_scanners, security_scans, security_findings IN ACCESS EXCLUSIVE MODE\n")
1186main: -> 0.0010s
1187main: -- execute("SELECT\n pg_get_constraintdef(pg_catalog.pg_constraint.oid)\nFROM\n pg_catalog.pg_constraint\nINNER JOIN pg_class ON pg_class.oid = pg_catalog.pg_constraint.conrelid\nWHERE\n conname = 'check_partition_number' AND\n pg_class.relname = 'security_findings'\n")
1188main: -> 0.0017s
1189main: -- execute("ALTER TABLE security_findings RENAME TO security_findings_1;\n")
1190main: -> 0.0011s
1191main: -- execute("ALTER INDEX security_findings_pkey RENAME TO security_findings_1_pkey;\n")
1192main: -> 0.0009s
1193main: -- execute("CREATE TABLE security_findings (\n LIKE security_findings_1 INCLUDING ALL\n) PARTITION BY LIST (partition_number);\n")
1194main: -> 0.0032s
1195main: -- execute("ALTER SEQUENCE security_findings_id_seq OWNED BY public.security_findings.id;\n")
1196main: -> 0.0010s
1197main: -- execute("ALTER TABLE security_findings\nADD CONSTRAINT fk_rails_729b763a54 FOREIGN KEY (scanner_id) REFERENCES vulnerability_scanners(id) ON DELETE CASCADE;\n")
1198main: -> 0.0013s
1199main: -- execute("ALTER TABLE security_findings\nADD CONSTRAINT fk_rails_bb63863cf1 FOREIGN KEY (scan_id) REFERENCES security_scans(id) ON DELETE CASCADE;\n")
1200main: -> 0.0012s
1201main: -- execute("ALTER TABLE security_findings_1 SET SCHEMA gitlab_partitions_dynamic;\n")
1202main: -> 0.0012s
1203main: -- execute("ALTER TABLE security_findings ATTACH PARTITION gitlab_partitions_dynamic.security_findings_1 FOR VALUES IN (1);\n")
1204main: -> 0.0025s
1205main: -- execute("ALTER TABLE security_findings DROP CONSTRAINT check_partition_number;\n")
1206main: -> 0.0012s
1207main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_unique_columns RENAME TO security_findings_1_uuid_scan_id_partition_number_idx;\n")
1208main: -> 0.0009s
1209main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_confidence RENAME TO security_findings_1_confidence_idx;\n")
1210main: -> 0.0009s
1211main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_project_fingerprint RENAME TO security_findings_1_project_fingerprint_idx;\n")
1212main: -> 0.0009s
1213main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_scan_id_and_deduplicated RENAME TO security_findings_1_scan_id_deduplicated_idx;\n")
1214main: -> 0.0010s
1215main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_scan_id_and_id RENAME TO security_findings_1_scan_id_id_idx;\n")
1216main: -> 0.0010s
1217main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_scanner_id RENAME TO security_findings_1_scanner_id_idx;\n")
1218main: -> 0.0010s
1219main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_severity RENAME TO security_findings_1_severity_idx;\n")
1220main: -> 0.0009s
1221main: == 20220902204048 MoveSecurityFindingsTableToGitlabPartitionsDynamicSchema: migrated (0.0298s)
1222WARNING: Active Record does not support composite primary key.
1223security_findings has composite primary key. Composite primary key is ignored.
1224 creates the original table from the latest existing partition
1225 when there is no partition
1226main: == 20220902204048 MoveSecurityFindingsTableToGitlabPartitionsDynamicSchema: migrating
1227main: -- execute("LOCK TABLE vulnerability_scanners, security_scans, security_findings IN ACCESS EXCLUSIVE MODE\n")
1228main: -> 0.0010s
1229main: -- execute("SELECT\n pg_get_constraintdef(pg_catalog.pg_constraint.oid)\nFROM\n pg_catalog.pg_constraint\nINNER JOIN pg_class ON pg_class.oid = pg_catalog.pg_constraint.conrelid\nWHERE\n conname = 'check_partition_number' AND\n pg_class.relname = 'security_findings'\n")
1230main: -> 0.0017s
1231main: -- execute("ALTER TABLE security_findings RENAME TO security_findings_11;\n")
1232main: -> 0.0013s
1233main: -- execute("ALTER INDEX security_findings_pkey RENAME TO security_findings_11_pkey;\n")
1234main: -> 0.0009s
1235main: -- execute("CREATE TABLE security_findings (\n LIKE security_findings_11 INCLUDING ALL\n) PARTITION BY LIST (partition_number);\n")
1236main: -> 0.0031s
1237main: -- execute("ALTER SEQUENCE security_findings_id_seq OWNED BY public.security_findings.id;\n")
1238main: -> 0.0009s
1239main: -- execute("ALTER TABLE security_findings\nADD CONSTRAINT fk_rails_729b763a54 FOREIGN KEY (scanner_id) REFERENCES vulnerability_scanners(id) ON DELETE CASCADE;\n")
1240main: -> 0.0013s
1241main: -- execute("ALTER TABLE security_findings\nADD CONSTRAINT fk_rails_bb63863cf1 FOREIGN KEY (scan_id) REFERENCES security_scans(id) ON DELETE CASCADE;\n")
1242main: -> 0.0012s
1243main: -- execute("ALTER TABLE security_findings_11 SET SCHEMA gitlab_partitions_dynamic;\n")
1244main: -> 0.0012s
1245main: -- execute("ALTER TABLE security_findings ATTACH PARTITION gitlab_partitions_dynamic.security_findings_11 FOR VALUES IN (11);\n")
1246main: -> 0.0025s
1247main: -- execute("ALTER TABLE security_findings DROP CONSTRAINT check_partition_number;\n")
1248main: -> 0.0012s
1249main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_unique_columns RENAME TO security_findings_1_uuid_scan_id_partition_number_idx;\n")
1250main: -> 0.0009s
1251main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_confidence RENAME TO security_findings_1_confidence_idx;\n")
1252main: -> 0.0009s
1253main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_project_fingerprint RENAME TO security_findings_1_project_fingerprint_idx;\n")
1254main: -> 0.0009s
1255main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_scan_id_and_deduplicated RENAME TO security_findings_1_scan_id_deduplicated_idx;\n")
1256main: -> 0.0010s
1257main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_scan_id_and_id RENAME TO security_findings_1_scan_id_id_idx;\n")
1258main: -> 0.0008s
1259main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_scanner_id RENAME TO security_findings_1_scanner_id_idx;\n")
1260main: -> 0.0008s
1261main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_severity RENAME TO security_findings_1_severity_idx;\n")
1262main: -> 0.0008s
1263main: == 20220902204048 MoveSecurityFindingsTableToGitlabPartitionsDynamicSchema: migrated (0.0293s)
1264 creates the original table
1265 #up
1266main: == 20220902204048 MoveSecurityFindingsTableToGitlabPartitionsDynamicSchema: migrating
1267main: -- execute("LOCK TABLE vulnerability_scanners, security_scans, security_findings IN ACCESS EXCLUSIVE MODE\n")
1268main: -> 0.0013s
1269main: -- execute("SELECT\n pg_get_constraintdef(pg_catalog.pg_constraint.oid)\nFROM\n pg_catalog.pg_constraint\nINNER JOIN pg_class ON pg_class.oid = pg_catalog.pg_constraint.conrelid\nWHERE\n conname = 'check_partition_number' AND\n pg_class.relname = 'security_findings'\n")
1270main: -> 0.0022s
1271main: -- execute("ALTER TABLE security_findings RENAME TO security_findings_1;\n")
1272main: -> 0.0010s
1273main: -- execute("ALTER INDEX security_findings_pkey RENAME TO security_findings_1_pkey;\n")
1274main: -> 0.0010s
1275main: -- execute("CREATE TABLE security_findings (\n LIKE security_findings_1 INCLUDING ALL\n) PARTITION BY LIST (partition_number);\n")
1276main: -> 0.0034s
1277main: -- execute("ALTER SEQUENCE security_findings_id_seq OWNED BY public.security_findings.id;\n")
1278main: -> 0.0010s
1279main: -- execute("ALTER TABLE security_findings\nADD CONSTRAINT fk_rails_729b763a54 FOREIGN KEY (scanner_id) REFERENCES vulnerability_scanners(id) ON DELETE CASCADE;\n")
1280main: -> 0.0013s
1281main: -- execute("ALTER TABLE security_findings\nADD CONSTRAINT fk_rails_bb63863cf1 FOREIGN KEY (scan_id) REFERENCES security_scans(id) ON DELETE CASCADE;\n")
1282main: -> 0.0012s
1283main: -- execute("ALTER TABLE security_findings_1 SET SCHEMA gitlab_partitions_dynamic;\n")
1284main: -> 0.0014s
1285main: -- execute("ALTER TABLE security_findings ATTACH PARTITION gitlab_partitions_dynamic.security_findings_1 FOR VALUES IN (1);\n")
1286main: -> 0.0025s
1287main: -- execute("ALTER TABLE security_findings DROP CONSTRAINT check_partition_number;\n")
1288main: -> 0.0011s
1289main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_unique_columns RENAME TO security_findings_1_uuid_scan_id_partition_number_idx;\n")
1290main: -> 0.0009s
1291main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_confidence RENAME TO security_findings_1_confidence_idx;\n")
1292main: -> 0.0010s
1293main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_project_fingerprint RENAME TO security_findings_1_project_fingerprint_idx;\n")
1294main: -> 0.0009s
1295main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_scan_id_and_deduplicated RENAME TO security_findings_1_scan_id_deduplicated_idx;\n")
1296main: -> 0.0009s
1297main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_scan_id_and_id RENAME TO security_findings_1_scan_id_id_idx;\n")
1298main: -> 0.0009s
1299main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_scanner_id RENAME TO security_findings_1_scanner_id_idx;\n")
1300main: -> 0.0010s
1301main: -- execute("ALTER INDEX gitlab_partitions_dynamic.index_security_findings_on_severity RENAME TO security_findings_1_severity_idx;\n")
1302main: -> 0.0009s
1303main: == 20220902204048 MoveSecurityFindingsTableToGitlabPartitionsDynamicSchema: migrated (0.0313s)
1304 changes the `security_findings` table to be partitioned
1305OrphanedInvitedMembersCleanup
1306 # order random
1307 #up
1308main: == 20220830061704 OrphanedInvitedMembersCleanup: migrating ====================
1309main: == 20220830061704 OrphanedInvitedMembersCleanup: migrated (0.0182s) ===========
1310 removes accepted members with no associated user
1311QueueBackfillProjectFeaturePackageRegistryAccessLevel
1312main: == 20220602070502 QueueBackfillProjectFeaturePackageRegistryAccessLevel: migrating
1313main: == 20220602070502 QueueBackfillProjectFeaturePackageRegistryAccessLevel: migrated (0.0510s)
1314 schedules a new batched migration
1315ScheduleBackfillNamespaceDetails
1316 # order random
1317 when on gitlab.com
1318 #up
1319 schedules background jobs for each batch of projects
1320 #down
1321 deletes all batched migration records
1322UpdateJiraTrackerDataDeploymentTypeBasedOnUrl
1323main: == 20220725150127 UpdateJiraTrackerDataDeploymentTypeBasedOnUrl: migrating ====
1324main: -- Scheduling UpdateJiraTrackerDataDeploymentTypeBasedOnUrl jobs
1325main: == 20220725150127 UpdateJiraTrackerDataDeploymentTypeBasedOnUrl: migrated (0.0457s)
1326 schedules background migration
1327AddDefaultPreferredLanguageToApplicationSettings
1328 # order random
1329 #down
1330main: == 20221101032521 AddDefaultPreferredLanguageToApplicationSettings: migrating =
1331main: -- add_column(:application_settings, :default_preferred_language, :text, {:default=>"en", :null=>false})
1332main: -> 0.0047s
1333main: == 20221101032521 AddDefaultPreferredLanguageToApplicationSettings: migrated (0.0052s)
1334 deletes default_preferred_language field
1335 #up
1336main: == 20221101032521 AddDefaultPreferredLanguageToApplicationSettings: migrating =
1337main: -- add_column(:application_settings, :default_preferred_language, :text, {:default=>"en", :null=>false})
1338main: -> 0.0046s
1339main: == 20221101032521 AddDefaultPreferredLanguageToApplicationSettings: migrated (0.0050s)
1340 allows to read default_preferred_language field
1341DeleteQueuedJobsForVulnerabilitiesFeedbackMigration
1342 # order random
1343 #up
1344 deletes all batched migration records
1345
13461st Try error in ./spec/migrations/20221223123019_delete_queued_jobs_for_vulnerabilities_feedback_migration_spec.rb:25:
1347expected: 1
1348 got: 13
1349(compared using ==)
1350
1351RSpec::Retry: 2nd try ./spec/migrations/20221223123019_delete_queued_jobs_for_vulnerabilities_feedback_migration_spec.rb:25
1352DeleteOrphansApprovalRules
1353 # order random
1354 #up
1355main: == 20221110152133 DeleteOrphansApprovalRules: migrating =======================
1356main: == 20221110152133 DeleteOrphansApprovalRules: migrated (0.0908s) ==============
1357 schedules background migration for both levels of approval rules
1358SetEmailConfirmationSettingFromSoftEmailConfirmationFf
1359 # order random
1360 #down
1361 updates 'email_confirmation_setting' to default value: '0' (off)
1362 #up
1363 when feature gate for `soft_email_confirmation` does not exist
1364 does not update `email_confirmation_setting`
1365 when feature gate for `soft_email_confirmation` does exist
1366 when feature gate value is `false`
1367 does not update `email_confirmation_setting`
1368 when feature gate value is `true`
1369 updates `email_confirmation_setting` to '1' (soft)
1370RecountEpicCacheCountsV3
1371 # order random
1372 #up
1373main: == 20230209131808 RecountEpicCacheCountsV3: migrating =========================
1374main: == 20230209131808 RecountEpicCacheCountsV3: migrated (0.0616s) ================
1375 schedules a batched background migration
1376 #down
1377main: == 20230209131808 RecountEpicCacheCountsV3: migrating =========================
1378main: == 20230209131808 RecountEpicCacheCountsV3: migrated (0.0501s) ================
1379 deletes all batched migration records
1380MigrateRedisSlotKeys
1381 # order random
1382 #up
1383main: == 20230202211434 MigrateRedisSlotKeys: migrating =============================
1384main: == 20230202211434 MigrateRedisSlotKeys: migrated (0.0425s) ====================
1385 rename keys
1386EnsureTimelogsNoteIdBigintBackfillIsFinishedForGitlabDotCom
1387 # order random
1388 #up
1389main: == 20230228021910 EnsureTimelogsNoteIdBigintBackfillIsFinishedForGitlabDotCom: migrating
1390main: == 20230228021910 EnsureTimelogsNoteIdBigintBackfillIsFinishedForGitlabDotCom: migrated (0.0078s)
1391 ensures the migration is completed for GitLab.com, dev, or test
1392main: == 20230228021910 EnsureTimelogsNoteIdBigintBackfillIsFinishedForGitlabDotCom: migrating
1393main: == 20230228021910 EnsureTimelogsNoteIdBigintBackfillIsFinishedForGitlabDotCom: migrated (0.0078s)
1394 skips the check for other instances
1395AddTmpPartialIndexOnVulnerabilityReportTypes
1396 # order random
1397main: == 20230221093533 AddTmpPartialIndexOnVulnerabilityReportTypes: migrating =====
1398main: -- index_exists?(:vulnerability_occurrences, :id, {:where=>"report_type IN (7, 99)", :name=>"tmp_idx_vulnerability_occurrences_on_id_where_report_type_7_99", :algorithm=>:concurrently})
1399main: -> 0.0100s
1400main: -- add_index_options(:vulnerability_occurrences, :id, {:where=>"report_type IN (7, 99)", :name=>"tmp_idx_vulnerability_occurrences_on_id_where_report_type_7_99", :algorithm=>:concurrently})
1401main: -> 0.0001s
1402main: == 20230221093533 AddTmpPartialIndexOnVulnerabilityReportTypes: migrated (0.0379s)
1403 schedules the index
1404QueueBackfillProjectWikiRepositories
1405 # order random
1406main: == 20230306195007 QueueBackfillProjectWikiRepositories: migrating =============
1407main: == 20230306195007 QueueBackfillProjectWikiRepositories: migrated (0.0540s) ====
1408 schedules a new batched migration
1409DeleteSecurityPolicyBotUsers
1410 # order random
1411 #up
1412main: == 20230309071242 DeleteSecurityPolicyBotUsers: migrating =====================
1413main: == 20230309071242 DeleteSecurityPolicyBotUsers: migrated (0.0332s) ============
1414 deletes security_policy_bot users
1415Knapsack report was generated. Preview:
1416{
1417 "spec/migrations/sync_new_amount_used_for_ci_project_monthly_usages_spec.rb": 17.29361126099957,
1418 "spec/migrations/schedule_purging_stale_security_scans_spec.rb": 28.856934370999625,
1419 "spec/migrations/20220106111958_add_insert_or_update_vulnerability_reads_trigger_spec.rb": 34.166721982000126,
1420 "spec/migrations/recreate_index_security_ci_builds_on_name_and_id_parser_with_new_features_spec.rb": 27.436379118000332,
1421 "spec/migrations/update_application_settings_container_registry_exp_pol_worker_capacity_default_spec.rb": 31.211336773999392,
1422 "spec/migrations/remove_wiki_notes_spec.rb": 27.30076886900042,
1423 "spec/migrations/20211214012507_backfill_incident_issue_escalation_statuses_spec.rb": 31.16964683600054,
1424 "spec/migrations/remove_invalid_integrations_spec.rb": 23.69206964300065,
1425 "spec/migrations/20220322132242_update_pages_onboarding_state_spec.rb": 27.597172035999392,
1426 "spec/migrations/20220223124428_schedule_merge_topics_with_same_name_spec.rb": 27.09765739500017,
1427 "spec/migrations/20220601152916_add_user_id_and_ip_address_success_index_to_authentication_events_spec.rb": 23.935907885000233,
1428 "spec/migrations/update_default_scan_method_of_dast_site_profile_spec.rb": 26.334007672000553,
1429 "spec/migrations/20220721031446_schedule_disable_legacy_open_source_license_for_one_member_no_repo_projects_spec.rb": 21.39991790699969,
1430 "spec/migrations/20220601110011_schedule_remove_self_managed_wiki_notes_spec.rb": 23.19252594000045,
1431 "spec/migrations/20220622080547_backfill_project_statistics_with_container_registry_size_spec.rb": 22.77936551199946,
1432 "spec/migrations/20220307192610_remove_duplicate_project_tag_releases_spec.rb": 25.73795042799975,
1433 "spec/migrations/20220606082910_add_tmp_index_for_potentially_misassociated_vulnerability_occurrences_spec.rb": 21.4158906950006,
1434 "spec/migrations/move_security_findings_table_to_gitlab_partitions_dynamic_schema_spec.rb": 20.321838288000436,
1435 "spec/migrations/orphaned_invited_members_cleanup_spec.rb": 16.554490014000294,
1436 "spec/migrations/queue_backfill_project_feature_package_registry_access_level_spec.rb": 21.661158927000542,
1437 "spec/migrations/20220921093355_schedule_backfill_namespace_details_spec.rb": 16.08329683000011,
1438 "spec/migrations/20220725150127_update_jira_tracker_data_deployment_type_based_on_url_spec.rb": 18.815454262999992,
1439 "spec/migrations/20221101032521_add_default_preferred_language_to_application_settings_spec.rb": 16.285674463999385,
1440 "spec/migrations/20221223123019_delete_queued_jobs_for_vulnerabilities_feedback_migration_spec.rb": 11.725018410999837,
1441 "spec/migrations/20221110152133_delete_orphans_approval_rules_spec.rb": 12.892858442000033,
1442 "spec/migrations/set_email_confirmation_setting_from_soft_email_confirmation_ff_spec.rb": 7.324065734999749,
1443 "spec/migrations/recount_epic_cache_counts_v3_spec.rb": 7.447879665000073,
1444 "spec/migrations/20230202211434_migrate_redis_slot_keys_spec.rb": 6.621805548000339,
1445 "spec/migrations/ensure_timelogs_note_id_bigint_backfill_is_finished_for_gitlab_dot_com_spec.rb": 5.92791534800017,
1446 "spec/migrations/20230221093533_add_tmp_partial_index_on_vulnerability_report_types_spec.rb": 5.72176937399945,
1447 "spec/migrations/20230306195007_queue_backfill_project_wiki_repositories_spec.rb": 3.899780706000456,
1448 "spec/migrations/20230309071242_delete_security_policy_bot_users_spec.rb": 3.0747389850002946
1449}
1450Knapsack global time execution for tests: 10m 14s
1451Finished in 22 minutes 35 seconds (files took 46.51 seconds to load)
145258 examples, 0 failures
1453Randomized with seed 50403
1454[TEST PROF INFO] Time spent in factories: 00:00.529 (0.04% of total time)
1455RSpec exited with 0.
1456No examples to retry, congrats!
1457 Saving cache for successful job 00:01
1458Not uploading cache ruby-gems-debian-bullseye-ruby-3.0-16 due to policy
1459Not uploading cache gitaly-ruby-gems-debian-bullseye-ruby-3.0-16 due to policy
1460 Uploading artifacts for successful job 00:05
1461Uploading artifacts...
1462coverage/: found 5 matching artifact files and directories
1463crystalball/: found 2 matching artifact files and directories
1464WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
1465knapsack/: found 3 matching artifact files and directories
1466WARNING: query_recorder/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
1467rspec/: found 14 matching artifact files and directories
1468WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
1469log/*.log: found 13 matching artifact files and directories
1470WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/4031138378/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
1471WARNING: Retrying... context=artifacts-uploader error=request redirected
1472Uploading artifacts as "archive" to coordinator... 201 Created id=4031138378 responseStatus=201 Created token=64_fFD9x
1473Uploading artifacts...
1474rspec/junit_rspec.xml: found 1 matching artifact files and directories
1475WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/4031138378/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
1476WARNING: Retrying... context=artifacts-uploader error=request redirected
1477Uploading artifacts as "junit" to coordinator... 201 Created id=4031138378 responseStatus=201 Created token=64_fFD9x
1478 Cleaning up project directory and file based variables 00:00
1479Job succeeded