Improve visibility of k8s-workloads config changes
Problem Statement
When merging a config change on https://gitlab.com/gitlab-com/gl-infra/k8s-workloads/gitlab-com/ a pipeline is triggered on the ops mirror which is deploying the change to all the affected k8s clusters in all our environments.
Being aware of ongoing config change pipelines and noticing if they succeeded or failed is hard because
- They can take very long to finish, so it is easy to forget to manually check for pipeline success
- Only members of the infrastructure teams have access to those pipelines for security reasons
Proposed solution
We should send slack notifications when a config change pipeline is started and also a notification when the pipeline succeeded or failed.