a small number of rails logs is being rejected by the ES logging cluster
Summary
a small number of rails logs is being rejected by the ES logging cluster
Timeline
All times UTC.
2020-04-22
- 09:17 - Incident declared from Slack
Details
This is a continuation of https://gitlab.com/gitlab-com/gl-infra/infrastructure/-/issues/8931
Two alerts are firing for this:
- number of pubsubbeat warnings
- ES write rejections
These alerts have been firing for a few weeks now. We either need to fix the underlying problem or adjust the thresholds
Source
Incident declared by mwasilewski in Slack via /incident declare command.
Resources
- If the Situation Zoom room was utilised, recording will be automatically uploaded to Incident room Google Drive folder (private)