2020-05-11: High gitaly request rate on canary
Summary
2020-05-11: High gitlay request rate on canary
Timeline
All times UTC.
2020-05-12
- 14:34 - PostUploadPack requests on canary are rising, leading to high CPU usage on canary gitaly node
- 14:40 - CPU saturation alert for Gitaly in Canary
- 14:42 - request spike stopped
- 14:44 - Incident declared from Slack
- 14:45 - Alert resolved
Details
High gitlay request rate leading to latency issues.
Source
Incident declared by hphilipps in Slack via /incident declare
command.
Resources
- If the Situation Zoom room was utilised, recording will be automatically uploaded to Incident room Google Drive folder (private)
Edited by Henri Philipps