GitLab 14.1.2 Upgrade PG::UndefinedTable: ERROR: relation "services_pkey" does not exist
Summary
When upgrading GitLab CE 14.0.5 -> 14.1.2, the upgrade fails with: PG::UndefinedTable: ERROR: relation "services_pkey" does not exist
.
Steps to reproduce
$ sudo apt update
$ sudo apt install gitlab-ce
What is the current bug behavior?
Upgrade fails with error.
What is the expected correct behavior?
Upgrade completes without error.
Relevant logs and/or screenshots
Running handlers:
There was an error running gitlab-ctl reconfigure:
rails_migration[gitlab-rails] (gitlab::database_migrations line 51) had an error: Mixlib::ShellOut::Shell
CommandFailed: bash[migrate gitlab-rails database] (/opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab
/resources/rails_migration.rb line 16) had an error: Mixlib::ShellOut::ShellCommandFailed: Expected proce
ss to exit with [0], but received '1'
---- Begin output of "bash" "/tmp/chef-script20210816-13910-1axghz2" ----
STDOUT: == 20210317210338 AddValidRunnerRegistrars: migrating =========================
-- add_column(:application_settings, :valid_runner_registrars, :string, {:array=>true, :default=>["projec
t", "group"]})
-> 0.0199s
== 20210317210338 AddValidRunnerRegistrars: migrated (0.0200s) ================
== 20210601132134 RemovePartialIndexForHashedStorageMigration: migrating ======
-- transaction_open?()
-> 0.0000s
-- index_exists?(:projects, :id, {:name=>"index_on_id_partial_with_legacy_storage", :algorithm=>:concurre
ntly})
-> 0.0260s
-- execute("SET statement_timeout TO 0")
-> 0.0001s
-- remove_index(:projects, {:name=>"index_on_id_partial_with_legacy_storage", :algorithm=>:concurrently,
:column=>:id})
-> 0.0404s
-- execute("RESET ALL")
-> 0.0004s
== 20210601132134 RemovePartialIndexForHashedStorageMigration: migrated (0.0673s)
== 20210602155056 AddMergeRequestDiffCommitUsers: migrating ===================
-- create_table(:merge_request_diff_commit_users, {:id=>:bigint})
-- quote_column_name(:name)
-> 0.0000s
-- quote_column_name(:email)
-> 0.0000s
-> 0.0659s
-- quote_table_name("check_147358fc42")
-> 0.0000s
-- quote_table_name("check_f5fa206cf7")
-> 0.0000s
-- quote_table_name(:merge_request_diff_commit_users)
-> 0.0000s
-- execute("ALTER TABLE \"merge_request_diff_commit_users\"\nADD CONSTRAINT \"check_147358fc42\" CHECK (c
har_length(\"name\") <= 512),\nADD CONSTRAINT \"check_f5fa206cf7\" CHECK (char_length(\"email\") <= 512)\
n")
-> 0.0053s
-- transaction_open?()
-> 0.0000s
-- current_schema()
-> 0.0003s
-- execute("ALTER TABLE merge_request_diff_commit_users\nADD CONSTRAINT merge_request_diff_commit_users_n
ame_or_email_existence\nCHECK ( (COALESCE(name, '') != '') OR (COALESCE(email, '') != '') )\nNOT VALID;\n
")
-> 0.0007s
-- current_schema()
-> 0.0002s
-- execute("SET statement_timeout TO 0")
-> 0.0003s
-- execute("ALTER TABLE merge_request_diff_commit_users VALIDATE CONSTRAINT merge_request_diff_commit_use
rs_name_or_email_existence;")
-> 0.0030s
-- execute("RESET ALL")
-> 0.0003s
== 20210602155056 AddMergeRequestDiffCommitUsers: migrated (0.0929s) ==========
== 20210602155110 AddMergeRequestDiffCommitUserColumns: migrating =============
-- add_column(:merge_request_diff_commits, :commit_author_id, :bigint)
-> 0.0023s
-- add_column(:merge_request_diff_commits, :committer_id, :bigint)
-> 0.0004s
== 20210602155110 AddMergeRequestDiffCommitUserColumns: migrated (0.0028s) ====
== 20210602164044 ScheduleLatestPipelineIdPopulation: migrating ===============
== 20210602164044 ScheduleLatestPipelineIdPopulation: migrated (0.0000s) ======
== 20210604032738 CreateDastSiteProfilesBuilds: migrating =====================
-- create_table(:dast_site_profiles_builds, {:primary_key=>[:dast_site_profile_id, :ci_build_id], :commen
t=>"{\"owner\":\"group::dynamic analysis\",\"description\":\"Join table between DAST Site Profiles and CI
Builds\"}"})
-> 0.0155s
== 20210604032738 CreateDastSiteProfilesBuilds: migrated (0.0157s) ============
== 20210604034158 AddCiBuildIdFkToDastSiteProfilesBuilds: migrating ===========
-- transaction_open?()
-> 0.0000s
-- foreign_keys(:dast_site_profiles_builds)
-> 0.0093s
-- execute("ALTER TABLE dast_site_profiles_builds\nADD CONSTRAINT fk_a325505e99\nFOREIGN KEY (ci_build_id
)\nREFERENCES ci_builds (id)\nON DELETE CASCADE\nNOT VALID;\n")
-> 0.0111s
-- execute("SET statement_timeout TO 0")
-> 0.0003s
-- execute("ALTER TABLE dast_site_profiles_builds VALIDATE CONSTRAINT fk_a325505e99;")
-> 0.0055s
-- execute("RESET ALL")
-> 0.0003s
== 20210604034158 AddCiBuildIdFkToDastSiteProfilesBuilds: migrated (0.0318s) ==
== 20210604034354 AddDastSiteProfileIdFkToDastSiteProfilesBuilds: migrating ===
-- transaction_open?()
-> 0.0000s
-- foreign_keys(:dast_site_profiles_builds)
-> 0.0070s
-- execute("ALTER TABLE dast_site_profiles_builds\nADD CONSTRAINT fk_94e80df60e\nFOREIGN KEY (dast_site_p
rofile_id)\nREFERENCES dast_site_profiles (id)\nON DELETE CASCADE\nNOT VALID;\n")
-> 0.0047s
-- execute("SET statement_timeout TO 0")
-> 0.0002s
-- execute("ALTER TABLE dast_site_profiles_builds VALIDATE CONSTRAINT fk_94e80df60e;")
-> 0.0071s
-- execute("RESET ALL")
-> 0.0003s
== 20210604034354 AddDastSiteProfileIdFkToDastSiteProfilesBuilds: migrated (0.0247s)
== 20210604051330 CreateDastScannerProfilesBuilds: migrating ==================
-- create_table(:dast_scanner_profiles_builds, {:primary_key=>[:dast_scanner_profile_id, :ci_build_id], :
comment=>"{\"owner\":\"group::dynamic analysis\",\"description\":\"Join table between DAST Scanner Profil
es and CI Builds\"}"})
-> 0.0129s
== 20210604051330 CreateDastScannerProfilesBuilds: migrated (0.0130s) =========
== 20210604051742 AddCiBuildIdFkToDastScannerProfilesBuilds: migrating ========
-- transaction_open?()
-> 0.0000s
-- foreign_keys(:dast_scanner_profiles_builds)
-> 0.0079s
-- execute("ALTER TABLE dast_scanner_profiles_builds\nADD CONSTRAINT fk_e4c49200f8\nFOREIGN KEY (ci_build
_id)\nREFERENCES ci_builds (id)\nON DELETE CASCADE\nNOT VALID;\n")
-> 0.0009s
-- execute("SET statement_timeout TO 0")
-> 0.0002s
-- execute("ALTER TABLE dast_scanner_profiles_builds VALIDATE CONSTRAINT fk_e4c49200f8;")
-> 0.0030s
-- execute("RESET ALL")
-> 0.0002s
== 20210604051742 AddCiBuildIdFkToDastScannerProfilesBuilds: migrated (0.0174s)
== 20210604051917 AddDastScannerProfileIdFkToDastScannerProfilesBuilds: migrating
-- transaction_open?()
-> 0.0000s
-- foreign_keys(:dast_scanner_profiles_builds)
-> 0.0085s
-- execute("ALTER TABLE dast_scanner_profiles_builds\nADD CONSTRAINT fk_5d46286ad3\nFOREIGN KEY (dast_sca
nner_profile_id)\nREFERENCES dast_scanner_profiles (id)\nON DELETE CASCADE\nNOT VALID;\n")
-> 0.0030s
-- execute("SET statement_timeout TO 0")
-> 0.0002s
-- execute("ALTER TABLE dast_scanner_profiles_builds VALIDATE CONSTRAINT fk_5d46286ad3;")
-> 0.0059s
-- execute("RESET ALL")
-> 0.0002s
== 20210604051917 AddDastScannerProfileIdFkToDastScannerProfilesBuilds: migrated (0.0225s)
== 20210604133651 ScheduleMergeRequestDiffUsersBackgroundMigration: migrating =
== 20210604133651 ScheduleMergeRequestDiffUsersBackgroundMigration: migrated (0.0000s)
== 20210609202501 ScheduleBackfillDraftStatusOnMergeRequests: migrating =======
-- transaction_open?()
-> 0.0000s
-- index_exists?(:merge_requests, :id, {:where=>"draft = false AND state_id = 1 AND ((title)::text ~* '^\
\[draft\\]|\\(draft\\)|draft:|draft|\\[WIP\\]|WIP:|WIP'::text)", :name=>"tmp_index_merge_requests_draft_a
nd_status", :algorithm=>:concurrently})
-> 0.0156s
-- execute("SET statement_timeout TO 0")
-> 0.0002s
-- add_index(:merge_requests, :id, {:where=>"draft = false AND state_id = 1 AND ((title)::text ~* '^\\[dr
aft\\]|\\(draft\\)|draft:|draft|\\[WIP\\]|WIP:|WIP'::text)", :name=>"tmp_index_merge_requests_draft_and_s
tatus", :algorithm=>:concurrently})
-> 0.0518s
-- execute("RESET ALL")
-> 0.0003s
-- Scheduled 3 BackfillDraftStatusOnMergeRequests jobs with a maximum of 100 records per batch and an int
erval of 120 seconds.
The migration is expected to take at least 360 seconds. Expect all jobs to have completed after 2021-08-1
6 23:12:37 UTC."
== 20210609202501 ScheduleBackfillDraftStatusOnMergeRequests: migrated (0.4064s)
== 20210610042700 RemoveClustersApplicationsFluentdTable: migrating ===========
-- drop_table(:clusters_applications_fluentd)
-> 0.0398s
== 20210610042700 RemoveClustersApplicationsFluentdTable: migrated (0.0398s) ==
== 20210610153556 DeleteLegacyOperationsFeatureFlags: migrating ===============
-- execute("DELETE FROM operations_feature_flags WHERE version = 1")
-> 0.0050s
== 20210610153556 DeleteLegacyOperationsFeatureFlags: migrated (0.0050s) ======
== 20210611101034 AddDevopsAdoptionSastDast: migrating ========================
-- add_column(:analytics_devops_adoption_snapshots, :sast_enabled_count, :integer)
-> 0.0026s
-- add_column(:analytics_devops_adoption_snapshots, :dast_enabled_count, :integer)
-> 0.0005s
== 20210611101034 AddDevopsAdoptionSastDast: migrated (0.0032s) ===============
== 20210614124111 AddDevopsAdoptionSastDastIndexes: migrating =================NOTICE: identifier "index
_incident_management_pending_alert_escalations_on_schedule_id" will be truncated to "index_incident_manag
ement_pending_alert_escalations_on_schedule"
-- transaction_open?()
-> 0.0000s
-- index_exists?(:ci_job_artifacts, [:project_id, :created_at], {:where=>"file_type = 5", :name=>"index_c
i_job_artifacts_sast_for_devops_adoption", :algorithm=>:concurrently})
-> 0.0062s
-- execute("SET statement_timeout TO 0")
-> 0.0002s
-- add_index(:ci_job_artifacts, [:project_id, :created_at], {:where=>"file_type = 5", :name=>"index_ci_jo
b_artifacts_sast_for_devops_adoption", :algorithm=>:concurrently})
-> 0.2552s
-- execute("RESET ALL")
-> 0.0004s
-- transaction_open?()
-> 0.0000s
-- index_exists?(:ci_job_artifacts, [:project_id, :created_at], {:where=>"file_type = 8", :name=>"index_c
i_job_artifacts_dast_for_devops_adoption", :algorithm=>:concurrently})
-> 0.0034s
-- execute("SET statement_timeout TO 0")
-> 0.0001s
-- add_index(:ci_job_artifacts, [:project_id, :created_at], {:where=>"file_type = 8", :name=>"index_ci_jo
b_artifacts_dast_for_devops_adoption", :algorithm=>:concurrently})
-> 0.2535s
-- execute("RESET ALL")
-> 0.0005s
== 20210614124111 AddDevopsAdoptionSastDastIndexes: migrated (0.5220s) ========
== 20210614142311 AddRunningContainerScanningMaxSizeToPlanLimits: migrating ===
-- add_column(:plan_limits, :ci_max_artifact_size_running_container_scanning, :integer, {:null=>false, :d
efault=>0})
-> 0.0085s
== 20210614142311 AddRunningContainerScanningMaxSizeToPlanLimits: migrated (0.0085s)
== 20210615064342 AddIssueIdToRequirement: migrating ==========================
-- add_column(:requirements, :issue_id, :bigint, {:null=>true})
-> 0.0022s
== 20210615064342 AddIssueIdToRequirement: migrated (0.0046s) =================
== 20210615234935 FixBatchedMigrationsOldFormatJobArguments: migrating ========
== 20210615234935 FixBatchedMigrationsOldFormatJobArguments: migrated (0.0262s)
== 20210616110748 AddIssueIndexToRequirement: migrating =======================
-- transaction_open?()
-> 0.0000s
-- index_exists?(:requirements, :issue_id, {:name=>"index_requirements_on_issue_id", :unique=>true, :algo
rithm=>:concurrently})
-> 0.0039s
-- execute("SET statement_timeout TO 0")
-> 0.0002s
-- add_index(:requirements, :issue_id, {:name=>"index_requirements_on_issue_id", :unique=>true, :algorith
m=>:concurrently})
-> 0.0121s
-- execute("RESET ALL")
-> 0.0003s
== 20210616110748 AddIssueIndexToRequirement: migrated (0.0170s) ==============
== 20210616111311 AddIssueRequirementForeignKey: migrating ====================
-- transaction_open?()
-> 0.0000s
-- foreign_keys(:requirements)
-> 0.0097s
-- execute("ALTER TABLE requirements\nADD CONSTRAINT fk_85044baef0\nFOREIGN KEY (issue_id)\nREFERENCES is
sues (id)\nON DELETE CASCADE\nNOT VALID;\n")
-> 0.0060s
-- execute("SET statement_timeout TO 0")
-> 0.0002s
-- execute("ALTER TABLE requirements VALIDATE CONSTRAINT fk_85044baef0;")
-> 0.0576s
-- execute("RESET ALL")
-> 0.0003s
== 20210616111311 AddIssueRequirementForeignKey: migrated (0.0791s) ===========
== 20210616134905 AddTimestampToSchemaMigration: migrating ====================
-- add_column(:schema_migrations, :finished_at, :timestamptz)
-> 0.0021s
-- change_column_default(:schema_migrations, :finished_at, #<Proc:0x00007fbae2782fe0 /opt/gitlab/embedded
/service/gitlab-rails/db/migrate/20210616134905_add_timestamp_to_schema_migration.rb:9 (lambda)>)
-> 0.0030s
== 20210616134905 AddTimestampToSchemaMigration: migrated (0.0053s) ===========
== 20210616145254 AddPartialIndexForCiBuildsToken: migrating ==================
-- transaction_open?()
-> 0.0000s
-- index_exists?(:ci_builds, :token, {:unique=>true, :where=>"token IS NOT NULL", :name=>"index_ci_builds
_on_token_partial", :algorithm=>:concurrently})
-> 0.0150s
-- execute("SET statement_timeout TO 0")
-> 0.0001s
-- add_index(:ci_builds, :token, {:unique=>true, :where=>"token IS NOT NULL", :name=>"index_ci_builds_on_
token_partial", :algorithm=>:concurrently})
-> 2.0389s
-- execute("RESET ALL")
-> 0.0004s
== 20210616145254 AddPartialIndexForCiBuildsToken: migrated (2.0546s) =========
== 20210616154808 RemoveCiBuildProtectedIndex: migrating ======================
-- transaction_open?()
-> 0.0000s
-- index_exists?(:ci_builds, :protected, {:name=>"index_ci_builds_on_protected", :algorithm=>:concurrentl
y})
-> 0.0158s
-- execute("SET statement_timeout TO 0")
-> 0.0003s
-- remove_index(:ci_builds, {:name=>"index_ci_builds_on_protected", :algorithm=>:concurrently, :column=>:
protected})
-> 0.0251s
-- execute("RESET ALL")
-> 0.0003s
== 20210616154808 RemoveCiBuildProtectedIndex: migrated (0.0420s) =============
== 20210616185947 AddMailgunSettingsToApplicationSetting: migrating ===========
-- add_column(:application_settings, :encrypted_mailgun_signing_key, :binary)
-> 0.0031s
-- add_column(:application_settings, :encrypted_mailgun_signing_key_iv, :binary)
-> 0.0009s
-- add_column(:application_settings, :mailgun_events_enabled, :boolean, {:default=>false, :null=>false})
-> 0.0027s
== 20210616185947 AddMailgunSettingsToApplicationSetting: migrated (0.0069s) ==
== 20210617022324 CreateIncidentManagementPendingAlertEscalations: migrating ==
-- execute("\nCREATE TABLE incident_management_pending_alert_escalations (\n id bigserial NOT NULL,\n r
ule_id bigint,\n alert_id bigint NOT NULL,\n schedule_id bigint NOT NULL,\n process_at timestamp with
time zone NOT NULL,\n created_at timestamp with time zone NOT NULL,\n updated_at timestamp with time zo
ne NOT NULL,\n status smallint NOT NULL,\n PRIMARY KEY (id, process_at)\n) PARTITION BY RANGE (process_
at);\n\nCREATE INDEX index_incident_management_pending_alert_escalations_on_alert_id\n ON incident_manag
ement_pending_alert_escalations USING btree (alert_id);\n\nCREATE INDEX index_incident_management_pending
_alert_escalations_on_rule_id\n ON incident_management_pending_alert_escalations USING btree (rule_id);\
n\nCREATE INDEX index_incident_management_pending_alert_escalations_on_schedule_id\n ON incident_managem
ent_pending_alert_escalations USING btree (schedule_id);\n\nALTER TABLE incident_management_pending_alert
_escalations ADD CONSTRAINT fk_rails_fcbfd9338b\n FOREIGN KEY (schedule_id) REFERENCES incident_manageme
nt_oncall_schedules(id) ON DELETE CASCADE;\n\nALTER TABLE incident_management_pending_alert_escalations A
DD CONSTRAINT fk_rails_057c1e3d87\n FOREIGN KEY (rule_id) REFERENCES incident_management_escalation_rule
s(id) ON DELETE SET NULL;\n\nALTER TABLE incident_management_pending_alert_escalations ADD CONSTRAINT fk_
rails_8d8de95da9\n FOREIGN KEY (alert_id) REFERENCES alert_management_alerts(id) ON DELETE CASCADE;\n")
-> 0.0115s
== 20210617022324 CreateIncidentManagementPendingAlertEscalations: migrated (0.0138s)
== 20210617161348 CascadeDeleteFreezePeriods: migrating =======================
-- transaction_open?()
-> 0.0000s
-- foreign_keys(:ci_freeze_periods)
-> 0.0084s
-- execute("ALTER TABLE ci_freeze_periods\nADD CONSTRAINT fk_2e02bbd1a6\nFOREIGN KEY (project_id)\nREFERE
NCES projects (id)\nON DELETE CASCADE\nNOT VALID;\n")
-> 0.0048s
-- execute("SET statement_timeout TO 0")
-> 0.0002s
-- execute("ALTER TABLE ci_freeze_periods VALIDATE CONSTRAINT fk_2e02bbd1a6;")
-> 0.0046s
-- execute("RESET ALL")
-> 0.0002s
-- foreign_keys(:ci_freeze_periods)
-> 0.0088s
-- remove_foreign_key(:ci_freeze_periods, :projects, {:column=>:project_id, :name=>"fk_rails_2e02bbd1a6"}
)
-> 0.0081s
== 20210617161348 CascadeDeleteFreezePeriods: migrated (0.0400s) ==============
== 20210617180131 MigrateUsagePingSidekiqQueue: migrating =====================
== 20210617180131 MigrateUsagePingSidekiqQueue: migrated (0.0005s) ============
== 20210621043337 RenameServicesToIntegrations: migrating =====================
-- execute("LOCK services IN ACCESS EXCLUSIVE MODE")
-> 0.0005s
-- execute("DROP TRIGGER IF EXISTS trigger_has_external_wiki_on_insert ON services")
-> 0.0005s
-- execute("DROP TRIGGER IF EXISTS trigger_has_external_wiki_on_update ON services")
-> 0.0003s
-- execute("DROP TRIGGER IF EXISTS trigger_has_external_wiki_on_delete ON services")
-> 0.0003s
-- execute("DROP TRIGGER IF EXISTS trigger_has_external_issue_tracker_on_insert ON services")
-> 0.0004s
-- execute("DROP TRIGGER IF EXISTS trigger_has_external_issue_tracker_on_update ON services")rake aborted
!
StandardError: An error has occurred, this and all later migrations canceled:
PG::UndefinedTable: ERROR: relation "services_pkey" does not exist
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/rename_table_helpers.rb:8:in `block in rena
me_table_safely'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:121:in `run_block'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:130:in `block in run_b
lock_with_lock_timeout'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database.rb:405:in `block in transaction'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database.rb:404:in `transaction'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:125:in `run_block_with
_lock_timeout'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:95:in `run'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/schema_helpers.rb:77:in `with_lock_retries'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/rename_table_helpers.rb:7:in `rename_table_
safely'
/opt/gitlab/embedded/service/gitlab-rails/db/migrate/20210621043337_rename_services_to_integrations.rb:36
:in `up'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database.rb:405:in `block in transaction'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database.rb:404:in `transaction'
/opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:61:in `block (3 levels) in <top (requi
red)>'
/opt/gitlab/embedded/bin/bundle:23:in `load'
/opt/gitlab/embedded/bin/bundle:23:in `<main>'
Caused by:
ActiveRecord::StatementInvalid: PG::UndefinedTable: ERROR: relation "services_pkey" does not exist
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/rename_table_helpers.rb:8:in `block in rena
me_table_safely'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:121:in `run_block'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:130:in `block in run_b
lock_with_lock_timeout'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database.rb:405:in `block in transaction'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database.rb:404:in `transaction'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:125:in `run_block_with
_lock_timeout'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:95:in `run'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/schema_helpers.rb:77:in `with_lock_retries'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/rename_table_helpers.rb:7:in `rename_table_
safely'
/opt/gitlab/embedded/service/gitlab-rails/db/migrate/20210621043337_rename_services_to_integrations.rb:36
:in `up'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database.rb:405:in `block in transaction'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database.rb:404:in `transaction'
/opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:61:in `block (3 levels) in <top (requi
red)>'
/opt/gitlab/embedded/bin/bundle:23:in `load'
/opt/gitlab/embedded/bin/bundle:23:in `<main>'
Caused by:
PG::UndefinedTable: ERROR: relation "services_pkey" does not exist
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/rename_table_helpers.rb:8:in `block in rena
me_table_safely'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:121:in `run_block'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:130:in `block in run_b
lock_with_lock_timeout'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database.rb:405:in `block in transaction'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database.rb:404:in `transaction'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:125:in `run_block_with
_lock_timeout'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:95:in `run'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/schema_helpers.rb:77:in `with_lock_retries'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/rename_table_helpers.rb:7:in `rename_table_
safely'
/opt/gitlab/embedded/service/gitlab-rails/db/migrate/20210621043337_rename_services_to_integrations.rb:36
:in `up'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database.rb:405:in `block in transaction'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database.rb:404:in `transaction'
/opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:61:in `block (3 levels) in <top (requi
red)>'
/opt/gitlab/embedded/bin/bundle:23:in `load'
/opt/gitlab/embedded/bin/bundle:23:in `<main>'
Tasks: TOP => db:migrate
(See full trace by running task with --trace)
-> 0.0031s
-- execute("DROP TRIGGER IF EXISTS trigger_has_external_issue_tracker_on_delete ON services")
-> 0.0004s
-- rename_table(:services, :integrations)
STDERR:
---- End output of "bash" "/tmp/chef-script20210816-13910-1axghz2" ----
Ran "bash" "/tmp/chef-script20210816-13910-1axghz2" returned 1
Running handlers complete
Chef Infra Client failed. 21 resources updated in 43 seconds
===
There was an error running gitlab-ctl reconfigure. Please check the output above for more
details.
===
dpkg: error processing package gitlab-ce (--configure):
installed gitlab-ce package post-installation script subprocess returned error exit status 1
Errors were encountered while processing:
gitlab-ce
E: Sub-process /usr/bin/dpkg returned an error code (1)
(For installations with omnibus-gitlab package run and paste the output of:
sudo gitlab-rake gitlab:env:info
)
System information System: Ubuntu 20.04 Current User: git Using RVM: no Ruby Version: 2.7.2p137 Gem Version: 3.1.4 Bundler Version:2.1.4 Rake Version: 13.0.3 Redis Version: 6.0.14 Git Version: 2.32.0 Sidekiq Version:5.2.9 Go Version: unknown GitLab information Version: 14.1.2 Revision: 8c67b499146 Directory: /opt/gitlab/embedded/service/gitlab-rails DB Adapter: PostgreSQL DB Version: 12.6 URL: https://gitlab.economicmodeling.com HTTP Clone URL: https://gitlab.economicmodeling.com/some-group/some-project.git SSH Clone URL: git@gitlab.economicmodeling.com:some-group/some-project.git Using LDAP: yes Using Omniauth: yes Omniauth Providers: GitLab Shell Version: 13.19.1 Repository storage paths: - default: /var/opt/gitlab/git-data/repositories GitLab Shell path: /opt/gitlab/embedded/service/gitlab-shell Git: /opt/gitlab/embedded/bin/git
Results of GitLab application Check
Expand for output related to the GitLab application check
Checking GitLab subtasks ...
Checking GitLab Shell ...
GitLab Shell: ... GitLab Shell version >= 13.19.1 ? ... OK (13.19.1) Running /opt/gitlab/embedded/service/gitlab-shell/bin/check Internal API available: FAILED - Internal API unreachable gitlab-shell self-check failed Try fixing it: Make sure GitLab is running; Check the gitlab-shell configuration file: sudo -u git -H editor /opt/gitlab/embedded/service/gitlab-shell/config.yml Please fix the error above and rerun the checks.
Checking GitLab Shell ... Finished
Checking Gitaly ...
Gitaly: ... default ... OK
Checking Gitaly ... Finished
Checking Sidekiq ...
Sidekiq: ... Running? ... no Try fixing it: sudo -u git -H RAILS_ENV=production bin/background_jobs start For more information see: doc/install/installation.md in section "Install Init Script" see log/sidekiq.log for possible errors Please fix the error above and rerun the checks.
Checking Sidekiq ... Finished
Checking Incoming Email ...
Incoming Email: ... Reply by email is disabled in config/gitlab.yml
Checking Incoming Email ... Finished
Checking LDAP ...
LDAP: ... Server: ldapmain LDAP authentication... Success LDAP users with access to your GitLab server (only showing the first 100 results) User output sanitized. Found 100 users of 100 limit.
Checking LDAP ... Finished
Checking GitLab App ...
Git configured correctly? ... yes Database config exists? ... yes All migrations up? ... yes Database contains orphaned GroupMembers? ... no GitLab config exists? ... yes GitLab config up to date? ... yes Log directory writable? ... yes Tmp directory writable? ... yes Uploads directory exists? ... yes Uploads directory has correct permissions? ... yes Uploads directory tmp has correct permissions? ... yes Init script exists? ... skipped (omnibus-gitlab has no init script) Init script up-to-date? ... skipped (omnibus-gitlab has no init script) Projects have namespace: ... 17/10 ... yes 22/14 ... yes 17/23 ... yes 4/24 ... yes 17/25 ... yes 17/26 ... yes 33/28 ... yes 33/29 ... yes 34/30 ... yes 17/41 ... yes 17/42 ... yes 17/48 ... yes 17/52 ... yes 17/53 ... yes 9/54 ... yes 17/56 ... yes 17/58 ... yes 17/60 ... yes 4/61 ... yes 17/65 ... yes 7/66 ... yes 17/67 ... yes 34/68 ... yes 17/71 ... yes 34/73 ... yes 34/78 ... yes 34/79 ... yes 17/80 ... yes 34/81 ... yes 34/82 ... yes 34/83 ... yes 17/86 ... yes 26/88 ... yes 17/91 ... yes 17/92 ... yes 7/93 ... yes 43/94 ... yes 34/97 ... yes 7/98 ... yes 17/99 ... yes 7/107 ... yes 17/115 ... yes 34/119 ... yes 34/120 ... yes 17/122 ... yes 34/123 ... yes 17/124 ... yes 43/125 ... yes 34/126 ... yes 34/127 ... yes 17/128 ... yes 7/131 ... yes 6/132 ... yes 7/133 ... yes 34/134 ... yes 7/135 ... yes 7/138 ... yes 17/139 ... yes 6/140 ... yes 17/141 ... yes 34/145 ... yes 7/146 ... yes 17/148 ... yes 17/150 ... yes 7/151 ... yes 34/152 ... yes 34/153 ... yes 17/154 ... yes 17/166 ... yes 34/171 ... yes 24/173 ... yes 7/174 ... yes 7/175 ... yes 17/176 ... yes 53/178 ... yes 17/181 ... yes 17/185 ... yes 20/186 ... yes 34/187 ... yes 71/189 ... yes 71/190 ... yes 71/191 ... yes 71/192 ... yes 7/193 ... yes 60/195 ... yes 7/197 ... yes 43/198 ... yes 20/199 ... yes 43/200 ... yes 34/201 ... yes 24/202 ... yes 71/203 ... yes 7/204 ... yes 17/205 ... yes 4/206 ... yes 7/209 ... yes 7/210 ... yes 71/214 ... yes 24/217 ... yes 108/219 ... yes 108/220 ... yes 6/221 ... yes 7/222 ... yes 71/223 ... yes 17/224 ... yes 107/225 ... yes 107/226 ... yes 17/227 ... yes 12/228 ... yes 17/229 ... yes 117/232 ... yes 10/233 ... yes 10/234 ... yes 34/235 ... yes 34/236 ... yes 17/237 ... yes 17/238 ... yes 17/239 ... yes 17/240 ... yes 17/242 ... yes 9/243 ... yes 17/244 ... yes 125/245 ... yes 17/246 ... yes 24/247 ... yes 107/248 ... yes 8/249 ... yes 20/250 ... yes 127/251 ... yes 17/252 ... yes 4/258 ... yes 127/259 ... yes 127/260 ... yes 120/261 ... yes 127/263 ... yes 139/264 ... yes 34/266 ... yes 34/267 ... yes 132/269 ... yes 132/270 ... yes 139/271 ... yes 53/272 ... yes 17/273 ... yes 3/274 ... yes 24/275 ... yes 34/276 ... yes 136/277 ... yes 7/278 ... yes 136/279 ... yes 136/280 ... yes 136/281 ... yes 136/282 ... yes 7/285 ... yes 6/286 ... yes 136/288 ... yes 136/289 ... yes 136/290 ... yes 6/291 ... yes 6/292 ... yes 6/293 ... yes 136/294 ... yes 6/295 ... yes 6/296 ... yes 6/297 ... yes 6/298 ... yes 6/299 ... yes 6/300 ... yes 6/301 ... yes 6/302 ... yes 6/303 ... yes 6/304 ... yes 20/305 ... yes 7/306 ... yes 139/307 ... yes 7/308 ... yes 127/309 ... yes 136/310 ... yes 127/311 ... yes 17/312 ... yes 54/313 ... yes 136/314 ... yes 140/316 ... yes 140/317 ... yes 107/318 ... yes 140/319 ... yes 34/320 ... yes 34/321 ... yes 4/322 ... yes 20/323 ... yes 107/324 ... yes 145/326 ... yes 73/327 ... yes 73/329 ... yes 20/330 ... yes 7/331 ... yes 107/333 ... yes 127/334 ... yes 132/335 ... yes 73/336 ... yes 132/337 ... yes 34/338 ... yes 34/339 ... yes 20/340 ... yes 73/341 ... yes 148/342 ... yes 17/343 ... yes 132/344 ... yes 139/345 ... yes 24/346 ... yes 24/347 ... yes 127/349 ... yes 140/351 ... yes 34/352 ... yes 141/353 ... yes 140/354 ... yes 139/355 ... yes 140/356 ... yes 140/357 ... yes 140/358 ... yes 34/359 ... yes 127/360 ... yes 7/361 ... yes 127/362 ... yes 107/363 ... yes 7/364 ... yes 127/365 ... yes 12/366 ... yes 7/367 ... yes 151/368 ... yes 127/369 ... yes 73/370 ... yes 17/371 ... yes 17/372 ... yes 17/373 ... yes 73/374 ... yes 53/375 ... yes 140/377 ... yes 7/378 ... yes 140/380 ... yes 200/383 ... yes 53/384 ... yes 20/385 ... yes 20/386 ... yes 6/387 ... yes 141/388 ... yes 73/389 ... yes 136/391 ... yes 7/392 ... yes 139/393 ... yes 7/394 ... yes 24/396 ... yes 139/397 ... yes 7/398 ... yes 17/399 ... yes 141/400 ... yes 141/401 ... yes 20/402 ... yes 154/403 ... yes 127/404 ... yes 131/405 ... yes 139/406 ... yes 139/407 ... yes 73/408 ... yes 6/409 ... yes 7/410 ... yes 151/411 ... yes 7/412 ... yes 127/413 ... yes 147/414 ... yes 24/415 ... yes 6/416 ... yes 151/417 ... yes 145/418 ... yes 151/419 ... yes 17/420 ... yes 140/421 ... yes 151/422 ... yes 144/424 ... yes 127/425 ... yes 73/426 ... yes 151/427 ... yes 140/428 ... yes 141/429 ... yes 140/430 ... yes 152/431 ... yes 139/432 ... yes 136/433 ... yes 151/435 ... yes 140/437 ... yes 151/438 ... yes 24/439 ... yes 139/440 ... yes 144/441 ... yes 46/442 ... yes 141/443 ... yes 151/444 ... yes 139/445 ... yes 139/446 ... yes 43/447 ... yes 20/450 ... yes 151/451 ... yes 151/452 ... yes 20/453 ... yes 141/454 ... yes 20/456 ... yes 17/457 ... yes 17/458 ... yes 147/460 ... yes 7/461 ... yes 126/462 ... yes 167/463 ... yes 160/466 ... yes 190/467 ... yes 173/468 ... yes 173/469 ... yes 174/470 ... yes 174/471 ... yes 140/472 ... yes 190/473 ... yes 175/475 ... yes 175/476 ... yes 17/477 ... yes 175/478 ... yes 175/479 ... yes 176/480 ... yes 176/481 ... yes 6/482 ... yes 151/483 ... yes 151/484 ... yes 24/485 ... yes 190/486 ... yes 151/487 ... yes 20/488 ... yes 177/489 ... yes 167/490 ... yes 139/492 ... yes 200/493 ... yes 73/494 ... yes 139/495 ... yes 17/496 ... yes 167/497 ... yes 155/498 ... yes 17/499 ... yes 6/500 ... yes 167/501 ... yes 213/502 ... yes 6/504 ... yes 6/505 ... yes 140/506 ... yes 139/507 ... yes 141/508 ... yes 141/509 ... yes 151/510 ... yes 181/511 ... yes 151/512 ... yes 73/513 ... yes 151/514 ... yes 140/516 ... yes 141/518 ... yes 73/519 ... yes 201/520 ... yes 167/521 ... yes 151/522 ... yes 190/523 ... yes 140/524 ... yes 151/525 ... yes 73/526 ... yes 189/527 ... yes 151/529 ... yes 167/530 ... yes 167/531 ... yes 17/532 ... yes 141/533 ... yes 140/534 ... yes 167/535 ... yes 6/536 ... yes 151/537 ... yes 167/538 ... yes 151/539 ... yes 151/540 ... yes 175/541 ... yes 17/543 ... yes 73/544 ... yes 127/546 ... yes 151/547 ... yes 151/548 ... yes 191/550 ... yes 151/552 ... yes 151/553 ... yes 151/554 ... yes 151/555 ... yes 151/556 ... yes 127/557 ... yes 151/558 ... yes 141/559 ... yes 155/560 ... yes 167/561 ... yes 140/562 ... yes 151/563 ... yes 43/564 ... yes 20/565 ... yes 6/567 ... yes 20/569 ... yes 167/570 ... yes 167/571 ... yes 167/572 ... yes 167/575 ... yes 151/576 ... yes 167/577 ... yes 139/578 ... yes 167/579 ... yes 151/580 ... yes 151/581 ... yes 7/582 ... yes 151/583 ... yes 43/584 ... yes 248/585 ... yes 200/586 ... yes 151/587 ... yes 144/588 ... yes 173/589 ... yes 17/590 ... yes 173/593 ... yes 151/594 ... yes 167/595 ... yes 127/596 ... yes 151/597 ... yes 6/598 ... yes 151/599 ... yes 140/600 ... yes 20/602 ... yes 6/603 ... yes 127/604 ... yes 6/605 ... yes 151/606 ... yes 151/607 ... yes 17/608 ... yes 53/609 ... yes 60/611 ... yes 168/613 ... yes 140/614 ... yes 167/615 ... yes 6/616 ... yes 17/618 ... yes 127/619 ... yes 20/620 ... yes 24/621 ... yes 53/622 ... yes 136/623 ... yes 141/624 ... yes 151/625 ... yes 201/626 ... yes 140/629 ... yes 168/630 ... yes 17/631 ... yes 167/632 ... yes 140/633 ... yes 201/635 ... yes 60/636 ... yes 167/637 ... yes 139/639 ... yes 7/640 ... yes 140/641 ... yes 167/642 ... yes 167/643 ... yes 167/644 ... yes 151/645 ... yes 200/646 ... yes 151/647 ... yes 151/648 ... yes 140/649 ... yes 139/650 ... yes 73/651 ... yes 151/654 ... yes 167/655 ... yes 24/656 ... yes 141/657 ... yes 140/658 ... yes 140/661 ... yes 168/662 ... yes 151/664 ... yes 7/665 ... yes 167/666 ... yes 140/667 ... yes 7/668 ... yes 139/669 ... yes 17/670 ... yes 151/671 ... yes 141/672 ... yes 7/673 ... yes 139/674 ... yes 139/675 ... yes 3/676 ... yes 140/677 ... yes 7/678 ... yes 168/679 ... yes 24/680 ... yes 140/682 ... yes 7/683 ... yes 151/687 ... yes 151/688 ... yes 6/690 ... yes 198/691 ... yes 167/692 ... yes 24/693 ... yes 129/694 ... yes 140/695 ... yes 201/696 ... yes 7/697 ... yes 216/698 ... yes 139/699 ... yes 24/700 ... yes 134/701 ... yes 209/702 ... yes 139/703 ... yes 139/704 ... yes 147/705 ... yes 167/706 ... yes 73/707 ... yes 207/708 ... yes 134/709 ... yes 20/710 ... yes 220/711 ... yes 279/712 ... yes 279/713 ... yes 209/714 ... yes 20/715 ... yes 279/716 ... yes 140/718 ... yes 220/719 ... yes 139/720 ... yes 279/721 ... yes 220/722 ... yes 168/723 ... yes 279/724 ... yes 20/725 ... yes 7/726 ... yes 151/727 ... yes 17/728 ... yes 182/729 ... yes 182/730 ... yes 221/731 ... yes 221/736 ... yes 182/737 ... yes 6/740 ... yes 221/742 ... yes 182/744 ... yes 216/745 ... yes 139/746 ... yes 223/747 ... yes 210/749 ... yes 17/750 ... yes 7/751 ... yes 151/752 ... yes 208/753 ... yes 7/754 ... yes 199/755 ... yes 195/756 ... yes 168/757 ... yes 151/758 ... yes 7/759 ... yes 24/761 ... yes 151/762 ... yes 220/763 ... yes 151/764 ... yes 7/765 ... yes 209/767 ... yes 17/768 ... yes 232/769 ... yes 232/770 ... yes 200/771 ... yes 7/772 ... yes 151/773 ... yes 221/774 ... yes 140/777 ... yes 140/778 ... yes 24/779 ... yes 4/780 ... yes 140/781 ... yes 151/782 ... yes 162/783 ... yes 17/784 ... yes 140/785 ... yes 73/786 ... yes 221/787 ... yes 198/788 ... yes 151/789 ... yes 147/790 ... yes 140/791 ... yes 147/792 ... yes 17/793 ... yes 223/794 ... yes 17/795 ... yes 140/796 ... yes 239/797 ... yes 151/798 ... yes 147/799 ... yes 17/800 ... yes 241/801 ... yes 232/802 ... yes 239/803 ... yes 43/804 ... yes 140/805 ... yes 3/806 ... yes 182/807 ... yes 182/808 ... yes 244/809 ... yes 167/810 ... yes 239/811 ... yes 190/812 ... yes 151/813 ... yes 248/814 ... yes 190/815 ... yes 173/816 ... yes 173/817 ... yes 248/818 ... yes 174/819 ... yes 252/820 ... yes 147/821 ... yes 248/822 ... yes 252/823 ... yes 248/824 ... yes 248/825 ... yes 248/826 ... yes 239/827 ... yes 7/828 ... yes 167/829 ... yes 17/830 ... yes 20/831 ... yes 255/832 ... yes 151/833 ... yes 200/834 ... yes 261/835 ... yes 17/836 ... yes 230/837 ... yes 255/838 ... yes 147/839 ... yes 167/840 ... yes 248/841 ... yes 151/842 ... yes 232/843 ... yes 232/844 ... yes 239/845 ... yes 167/846 ... yes 194/847 ... yes 24/848 ... yes 255/850 ... yes 223/851 ... yes 261/853 ... yes 261/854 ... yes 260/855 ... yes 220/856 ... yes 180/857 ... yes 260/858 ... yes 17/859 ... yes 17/860 ... yes 260/861 ... yes 260/862 ... yes 263/863 ... yes 147/864 ... yes 147/865 ... yes 262/866 ... yes 260/867 ... yes 260/869 ... yes 151/871 ... yes 265/873 ... yes 17/874 ... yes 260/877 ... yes 260/878 ... yes 248/880 ... yes 151/884 ... yes 151/885 ... yes 151/886 ... yes 147/887 ... yes 141/888 ... yes 248/889 ... yes 248/890 ... yes 167/891 ... yes 248/892 ... yes 141/893 ... yes 260/894 ... yes 151/895 ... yes 260/896 ... yes 17/897 ... yes 17/900 ... yes 260/901 ... yes 274/902 ... yes 147/903 ... yes 267/904 ... yes 210/907 ... yes 139/908 ... yes 279/909 ... yes 280/912 ... yes 232/914 ... yes 248/915 ... yes 232/917 ... yes 260/918 ... yes 260/920 ... yes 20/921 ... yes 255/923 ... yes 151/924 ... yes 281/925 ... yes 281/926 ... yes 281/927 ... yes 267/928 ... yes 280/929 ... yes 280/930 ... yes 280/931 ... yes 284/932 ... yes 232/933 ... yes 147/934 ... yes 17/935 ... yes 190/936 ... yes 260/937 ... yes 260/938 ... yes 140/939 ... yes 17/940 ... yes 151/941 ... yes 17/942 ... yes 210/943 ... yes 210/944 ... yes 255/945 ... yes 248/946 ... yes 139/947 ... yes 134/948 ... yes 267/949 ... yes 248/950 ... yes 232/951 ... yes 139/952 ... yes 209/953 ... yes 267/954 ... yes 210/956 ... yes 210/957 ... yes 210/958 ... yes 210/959 ... yes 210/960 ... yes 232/961 ... yes 210/962 ... yes 210/963 ... yes 210/964 ... yes 210/965 ... yes 17/967 ... yes 151/969 ... yes 248/970 ... yes 248/971 ... yes 267/972 ... yes 209/973 ... yes 151/974 ... yes 260/976 ... yes 151/977 ... yes 151/978 ... yes 151/979 ... yes 17/980 ... yes 17/981 ... yes 287/982 ... yes 276/983 ... yes 267/984 ... yes 260/985 ... yes 151/986 ... yes 267/987 ... yes 17/988 ... yes 17/989 ... yes 261/990 ... yes Redis version >= 5.0.0? ... yes Ruby version >= 2.7.2 ? ... yes (2.7.2) Git version >= 2.31.0 ? ... yes (2.32.0) Git user has default SSH configuration? ... yes Active users: ... 131 Is authorized keys file accessible? ... yes GitLab configured to store new projects in hashed storage? ... yes All projects are in hashed storage? ... yes
Checking GitLab App ... Finished
Checking GitLab subtasks ... Finished