postgres on primary nodes won't stop with active geo nodes

Upon trying to restart a gitlab primary node via gitlab-ctl we discovered that the PostgreSQL service was stuck in a shutdown mode where it was not accepting new connections and waiting for remote connections to terminate. As a result, no process could connect to the database and postgres never stopped because the Geo node was holding a connection open.

We resolved the issue by stopping the Geo node, which allowed the DB on the primary node to shut down successfully. We may have been a bit impatient with our process, but needed to run another restart on the primary to get everything in order again. Followed by starting the Geo node again. With a single Geo node, this is not terrible, but it becomes more of an issue as the node count increases.

Is it possible to move the postgres shutdown control to some mode that doesn't wait indefinitely for sessions to end?

Assignee Loading
Time tracking Loading