rails-ro console trying to connect to deleted patroni node
We recently decommissioned patroni-ci-v14-102-db-gprd.c.gitlab-production.internal:
- production#17384 (closed)
- https://ops.gitlab.net/gitlab-com/gl-infra/config-mgmt/-/merge_requests/7572
However, this node is still in use by the console-ro chef role:
As a result, rails-ro teleport access is failing with:
[ gprd ] production> Ci::Pipeline.find(ids)
/opt/gitlab/embedded/lib/ruby/gems/3.1.0/gems/activerecord-7.0.8/lib/active_record/connection_adapters/postgresql_adapter.rb:83:in `rescue in new_client': There is an issue connecting to your database with your username/password, username: gitlab. (ActiveRecord::DatabaseConnectionError)
Please check your database configuration to ensure the username/password are valid.
/opt/gitlab/embedded/lib/ruby/gems/3.1.0/gems/pg-1.5.4/lib/pg/connection.rb:819:in `connect_start': could not translate host name "patroni-ci-v14-102-db-gprd.c.gitlab-production.internal" to address: Name or service not known (PG::ConnectionBad)
Thanks to @sashi_kumar for the report.