New: Incident 5
Summary
Start time: 2020-05-18T12:07:25+00:00
Alert Details
receiver: gitlab
status: firing
alerts: [{"status"=>"firing", "labels"=>{"alertname"=>"MinimalAlert"}, "annotations"=>{}, "startsAt"=>"2020-05-18T12:07:20.890578616Z", "endsAt"=>"0001-01-01T00:00:00Z", "generatorURL"=>"http://5033b566eb02:9090/graph?g0.expr=vector%281%29&g0.tab=1", "fingerprint"=>"04bc8cbd81f01b3d"}, {"status"=>"firing", "labels"=>{"alertname"=>"AlertmanagerNotificationsFailing", "pager"=>"pagerduty", "service"=>"alertmanager", "severity"=>"s1"}, "annotations"=>{"description"=>"Alertmanager is seeing errors for integration ", "runbook"=>"troubleshooting/alertmanager-notification-failures.md", "title"=>"Alertmanager is failing sending notifications"}, "startsAt"=>"2020-05-18T12:07:21.421665749Z", "endsAt"=>"0001-01-01T00:00:00Z", "generatorURL"=>"http://5033b566eb02:9090/graph?g0.expr=vector%281%29&g0.tab=1", "fingerprint"=>"bec99b22173e4c06"}, {"status"=>"firing", "labels"=>{"alertname"=>"GitalyFileServerDown", "channel"=>"gitaly", "pager"=>"pagerduty", "severity"=>"s1"}, "annotations"=>{"description"=>"Annotation description\n", "gitlab_incident_markdown"=>"Some inline markdown\n", "runbook"=>"troubleshooting/gitaly-down.md", "title"=>"Gitaly is down on server001"}, "startsAt"=>"2020-05-18T12:07:20.265949279Z", "endsAt"=>"0001-01-01T00:00:00Z", "generatorURL"=>"http://5033b566eb02:9090/graph?g0.expr=vector%281%29&g0.tab=1", "fingerprint"=>"b6ac4d42057c43c1"}]
externalURL: http://639347c61a54:9093
version: 4
groupKey: {}:{}
severity: critical
Summary
Note: For database incidents please use the database incident template
Timeline of events
- YYYY-MM-DD XX:YY UTC: action X taken