Error in sidekiq.log after reconfiguring in Step 1.8 of GitLab Geo database replication while demoting a primary
Error in sidekiq.log after reconfiguring in Step 1.8 of GitLab Geo database replication - Step 1. Configure the primary server while demoting a primary to a secondary:
2018-02-13_18:04:07.07785 2018-02-13T18:04:07.077Z 20307 TID-otgllo3o8 Geo::MetricsUpdateWorker JID-98967cdbbdf32eeb60648067 INFO: fail: 0.166 sec
2018-02-13_18:04:07.07806 2018-02-13T18:04:07.078Z 20307 TID-otgllo3o8 WARN: {"context":"Job raised exception","job":{"queue":"cronjob:geo_metrics_update","args":[],"class":"Geo::MetricsUpdateWorker","retry":false,"queue_namespace":"cronjob","jid":"98967cdbbdf32eeb60648067","created_at":1518545046.911199,"enqueued_at":1518545046.9113762},"jobstr":"{\"queue\":\"cronjob:geo_metrics_update\",\"args\":[],\"class\":\"Geo::MetricsUpdateWorker\",\"retry\":false,\"queue_namespace\":\"cronjob\",\"jid\":\"98967cdbbdf32eeb60648067\",\"created_at\":1518545046.911199,\"enqueued_at\":1518545046.9113762}"}
2018-02-13_18:04:07.07817 2018-02-13T18:04:07.078Z 20307 TID-otgllo3o8 WARN: ActiveRecord::RecordNotUnique: PG::UniqueViolation: ERROR: duplicate key value violates unique constraint "index_geo_node_statuses_on_geo_node_id"
2018-02-13_18:04:07.07820 DETAIL: Key (geo_node_id)=(2) already exists.
2018-02-13_18:04:07.07822 : INSERT INTO "geo_node_statuses" ("geo_node_id", "db_replication_lag_seconds", "repositories_count", "repositories_synced_count", "repositories_failed_count", "lfs_objects_count", "lfs_objects_synced_count", "lfs_objects_failed_count", "attachments_count", "attachments_synced_count", "attachments_failed_count", "last_event_date", "cursor_last_event_id", "cursor_last_event_date", "updated_at", "status_message", "replication_slots_count", "replication_slots_used_count", "replication_slots_max_retained_wal_bytes", "wikis_count", "wikis_synced_count", "wikis_failed_count", "job_artifacts_count", "job_artifacts_synced_count", "job_artifacts_failed_count", "version", "revision", "last_successful_status_check_at", "created_at") VALUES (2, 0, 27, 27, 0, 2, 1, 0, 8, 8, 0, '1970-01-01 00:00:00.000000', 61, '2018-02-13 17:11:46.000000', '2018-02-13 18:04:07.053000', 'Healthy', 0, 0, 0, 27, 27, 0, 23, 23, 0, '10.5.0-pre', '3e9df3a', '2018-02-13 18:04:07.072837', '2018-02-13 18:04:07.074161') RETURNING "id"
2018-02-13_18:04:07.07835 2018-02-13T18:04:07.078Z 20307 TID-otgllo3o8 WARN: /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/peek-pg-1.3.0/lib/peek/views/pg.rb:17:in `async_exec'
2018-02-13_18:04:07.07837 /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/peek-pg-1.3.0/lib/peek/views/pg.rb:17:in `async_exec'
2018-02-13_18:04:07.07838 /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.10/lib/active_record/connection_adapters/postgresql_adapter.rb:592:in `block in exec_no_cache'
<snip>
2018-02-13_18:04:07.07924 /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.10/lib/active_record/persistence.rb:250:in `update'
2018-02-13_18:04:07.07926 /opt/gitlab/embedded/service/gitlab-rails/ee/app/services/geo/metrics_update_service.rb:43:in `update_db_metrics'
2018-02-13_18:04:07.07927 /opt/gitlab/embedded/service/gitlab-rails/ee/app/services/geo/metrics_update_service.rb:36:in `fetch_geo_node_metrics'
2018-02-13_18:04:07.07929 /opt/gitlab/embedded/service/gitlab-rails/ee/app/services/geo/metrics_update_service.rb:18:in `block in fetch_secondary_geo_nodes_metrics'
2018-02-13_18:04:07.07931 /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.10/lib/active_record/relation/batches.rb:51:in `block (2 levels) in find_each'
2018-02-13_18:04:07.07932 /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.10/lib/active_record/relation/batches.rb:51:in `each'
2018-02-13_18:04:07.07934 /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.10/lib/active_record/relation/batches.rb:51:in `block in find_each'
2018-02-13_18:04:07.07936 /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.10/lib/active_record/relation/batches.rb:124:in `find_in_batches'
2018-02-13_18:04:07.07937 /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.10/lib/active_record/relation/batches.rb:50:in `find_each'
2018-02-13_18:04:07.07939 /opt/gitlab/embedded/service/gitlab-rails/ee/app/services/geo/metrics_update_service.rb:18:in `fetch_secondary_geo_nodes_metrics'
2018-02-13_18:04:07.07940 /opt/gitlab/embedded/service/gitlab-rails/ee/app/services/geo/metrics_update_service.rb:9:in `execute'
2018-02-13_18:04:07.07942 /opt/gitlab/embedded/service/gitlab-rails/ee/app/workers/geo/metrics_update_worker.rb:10:in `block in perform'
2018-02-13_18:04:07.07943 /opt/gitlab/embedded/service/gitlab-rails/ee/app/services/concerns/exclusive_lease_guard.rb:22:in `try_obtain_lease'