You need to sign in or sign up before continuing.
Mailroom doesn't fail liveness checks when it's unable to connect to redis-sidekiq (and remains in this state after redis is back online)
Summary
(Summarize the bug encountered, concisely as possible)
corrective action for gitlab-com/gl-infra/production#3578 (closed)
Redis-sidekiq was shutdown and as a result mailroom was unable to connect to it. After redis came online, mailroom was still unable to connect to it. Throughout all that time, mailroom was not failing liveness checks (if it was, the pod would be killed which would trigger a restart).
Similar to: #2440 (closed)
Steps to reproduce
(Please provide the steps to reproduce the issue)
Configuration used
(Please provide a sanitized version of the configuration used wrapped in a code block (```yaml))
(Paste sanitized configuration here)
Current behavior
(What you're experiencing happening)
Expected behavior
(What you're expecting to happen)
Versions
- Chart: (tagged version | branch | hash
git rev-parse HEAD
) - Platform:
- Cloud: (GKE | AKS | EKS | ?)
- Self-hosted: (OpenShift | Minikube | Rancher RKE | ?)
- Kubernetes: (
kubectl version
)- Client:
- Server:
- Helm: (
helm version
)- Client:
- Server:
Relevant logs
(Please provide any relevate log snippets you have collected, using code blocks (```) to format)