Skip to content

[prometheus][gprd] - bump prometheus limits in gprd to 600G

Nick Duff requested to merge nduff/prometheus-limits-gprd into master

What

Increase memory limits in gprd prometheus instances.

Why

We have had a couple of incidents since reducing the limits, which resulted in bad queries managing to OOMKill all our prometheus instances due to thanos running a fan out operation.

Related Issue: gitlab-com/gl-infra/production#17146 (closed)

Merge request reports