2020-03-08: ci-runners is not meeting its latency SLOs
Summary
For approximately 30 minutes at ~0400UTC, higher than normal latencies were observed for shared runners.
More information will be added as we investigate the issue.
Timeline
All times UTC.
2020-03-08
- 04:09 - ci-runners apdex falls below SLO
- 04:23 - EOC paged
- 04:32 - ci-runners apdex recovers to normal response latencies
Resources
- If the Situation Zoom room was utilised, recording will be automatically uploaded to Incident room Google Drive folder (private)