Grow HAProxy Gameday Process to include Clusters
Currently the HAProxy process is designed to provide tooling to stop traffic to a zone of HAProxy. We should grow this to also allow for controls around clusters like Canary, regional clusters, etc.
During a zonal specific event, being able to control our flow of traffic will help us route around a problem cluster when we may not have fine control over the resources there.
- How can we route traffic around a bad zone while still allowing users of GitLab.com to be productive?
- Can we, or should we, allow deploys when in such a degraded mode?
- Should we add to the HAProxy Gameday template (and change it to be more traffic flow focused), or should we add a clusters specific gameday for altering traffic flow?