Skip to content

Improve saturation alert details

Filipe Santos requested to merge saturation-alert-query into master

When we receive alerts for saturation, it isn't usually obvious what specific instance/project/workload it refers to.

For example GCP quota limits:

image

We only know that it affects the environment gprd, the GCP project is not a label and we don't know what quota is actually being affected.

This MR adds the project label as a resource label to gcp_quota_limit saturation aggregations and most importantly, it updates the overall saturation function/template to include the promql_template_1 query annotation.

The annotation will propagate the promql query to the alert and make it easier to see the metrics by having a Thanos link, like the following:

image

Merge request reports