2026-02-03: Prometheus scrape failures on patroni-main-v16-106-db-gprd.c.gitlab-production.internal

Prometheus scrape failures on patroni-main-v16-106-db-gprd.c.gitlab-production.internal (Severity 4)

Problem: Prometheus was unable to collect metrics from at least one exporter on patroni-main-v16-106-db-gprd.c.gitlab-production.internal. Metrics collection has since recovered.

Impact: There was no user impact. Monitoring metrics were temporarily unavailable from at least one exporter.

Causes: Exporter pods on the cluster were rotated, likely due to a ScaleDown event affecting several nodes. The exact reason for the pods' recreation is unconfirmed, but this rotation temporarily disrupted metrics collection.

Response strategy: No manual intervention was required. The exporter pods recovered automatically and metrics are now being collected as expected.

This ticket was created to track INC-7039, by incident.io 🔥