Disable traffic cessation alerts for specific regional SLIs
What
Right now, regional SLIs include traffic cessation alerts for all regions. When a specific region has intermittent or no traffic (eg asia-northeast3
), it triggers false positive alert. We should consider one or more of the following options:
- Disable traffic cessation alerts entirely
- Increase traffic cessation window from 30m to ?m
- Expand traffic cessation alerts generation to respect per region selectors
- Some novel solution
Why
We should avoid paging EOC.
References
- https://gitlab.slack.com/archives/C101F3796/p1715629529124119
- https://gitlab.com/gitlab-com/runbooks/-/blob/master/metrics-catalog/services/ai-gateway.jsonnet?ref_type=heads
- https://gitlab.com/gitlab-com/runbooks/-/blob/master/libsonnet/service-archetypes/runway-archetype.libsonnet?ref_type=heads#L17