Listen for resolved Prometheus alerts
In order for GitLab to have a more complete data model of the firing alerts, we should also listen and be notified when an alert has been resolved.
To do this we would need to do two things:
- Ensure we configure Alert Manager to send resolved alert notifications: https://prometheus.io/docs/alerting/configuration/#webhook_config
- Update our webhook listener to properly handle these resolved notifications