Why did one read replica queue client connections after a failover?

See https://gitlab.com/gitlab-com/gl-infra/infrastructure/issues/7543.

Placeholder.

added corrective action label

changed the description

mentioned in issue #7543 (closed)

Hi @craigf,

This issue does not appear to have an issue weight set.

As a general guidelines use a weight of 1 for an access request issue or a simple configuration update. Use this as a multiplier for setting the weight. If you are unsure about what weight to set it is better to add a generous estimate and change it later. If the weight on this issue is 8 or larger then it might be a good idea to consider splitting this issue up into smaller pieces.

Thanks for your help!

---

You are welcome to help improve this comment.

marked this issue as related to #7543 (closed)

https://gitlab.com/gitlab-org/gitlab-ce/issues/66074 has a lot of good discussion about this.

That's awesome, I'm going to close this in favour of following that. We can always open infra-specific issues as and when we need them.

closed

@craigf My only concern with closing this issue is that Development has been unable to find any reasoning in the LB code that points to why we didn't properly load balance afterwards. Infrastructure is the best group to determine that as they have access to the production environment (or determine we can't figure out why).

Yeah now that I've actually followed that thread through, I see I might have been too trigger happy closing this. I'm in a "cleaning house" end of the week mood. reopening.

reopened

mentioned in issue #7585 (closed)

mentioned in issue production#1071 (closed)

unassigned @craigf

@craigf , is this still an issue - given how much the DB ecosystem has changed over the last year? Rating it as an S2 for now (pending on your answer).

added severity2 label

@albertoramos I think this is definitely stale, and as far as I know we've not observed this sort of behaviour in a long time. IIRC, the culprit ended up being pgbouncer saturation anyway, but I might be remembering this wrong as it was a long time ago.

Closing.

closed

added workflow-infraDone label