feat: global evaluation for thanos

Andrew Newdigaterequested to merge
thanos-evaluation-of-slis into master

Follow on to !5397 (merged)

Part of https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/14644.

This change moves the evaluation of Thanos SLIs from Prometheus to Thanos.

This is part of the work to improve the self-monitoring of Thanos with Thanos.

How does it work?

A new attribute, dangerouslyThanosEvaluated is added to service definition. This matches the attribute of the same name used within Saturation monitoring.

This moves SLI evaluation for the service from Prometheus to Thanos.

This fixes the problem that is currently occurring following !5397 (merged) where multiple SLIs per environment are being generated.

cc @gitlab-org/reliability/observability @T4cC0re @steveazz @reprazent

Edited by Andrew Newdigate

Merge request reports