OnCall report for period: 2018-03-20 - 2018-03-27
Oncall during this period
Schedule | Username |
---|---|
AMA | Ilya Frolov |
EU | Ahmad Sherif |
EU | John Jarvis |
PagerDuty Incidents
- Number of incidents: 11
Created | Summary |
---|---|
2018-03-20T22:40:40Z | [1414] Firing 1 - prometheus is unreachable |
2018-03-20T23:47:16Z | [1415] Pingdom check GitLab.com master branch is down |
2018-03-21T10:29:02Z | [1416] Pingdom check GitLab.com Pages is down |
2018-03-21T11:31:44Z | [1417] Pingdom check GitLab.com master branch is down |
2018-03-21T16:05:27Z | [1419] Pingdom check GitLab.com new repo is down |
2018-03-22T07:25:42Z | [1420] Pingdom check Dev.gitlab.org issue is down |
2018-03-22T10:28:00Z | [1421] Pingdom check GitLab.com master branch is down |
2018-03-22T10:46:58Z | [1422] Pingdom check GitLab.com Pages is down |
2018-03-23T16:12:27Z | [1423] Pingdom check GitLab Forum is down |
2018-03-23T16:13:34Z | [1424] Pingdom check GitLab Forum is down |
2018-03-26T18:01:56Z | [1427] Pingdom check GitLab.com master branch is down |
Issues
7 Day OnCall Issue Stats
- Oncall issues : 18
- Access Request : 3
- Critical : 1
- Outage : 0
- Corrective Action : 3
Open OnCall Issue Stats
- Oncall issues : 12
- Access Request : 1
- Critical : 1
- Outage : 0
- Corrective Action : 19
Open Oncall Issues
Created | Assignee | Summary |
---|---|---|
27 Mar 18 11:56 UTC | unassigned | Structured logging for gitlab-shell (coming in GitLab 10.7) |
26 Mar 18 09:30 UTC | unassigned | Chef run errors on production environment related to systemd timeout |
24 Mar 18 21:20 UTC | ilyaf | fluentd parse error on nfs-09 for gitaly logs |
24 Mar 18 20:11 UTC | unassigned | AWS Retirement of host used for Gitter.IM |
22 Mar 18 00:37 UTC | unassigned | td-agent is broken on all boxes |
21 Mar 18 16:11 UTC | unassigned | Configure the Container registry for canary |
20 Mar 18 12:12 UTC | unassigned | gitlab-sidekiq alerting generating regular alerts |
16 Mar 18 15:22 UTC | unassigned | Turn on repository verification checksum feature |
16 Mar 18 11:24 UTC | unassigned | nfs-file-07 load spiked up to ~150 |
15 Mar 18 23:47 UTC | nolith | March 15th dev.gitlab.org outage |
15 Mar 18 12:39 UTC | unassigned | Transfer of Gemnasium domains |
12 Feb 18 08:51 UTC | bjk-gitlab | Re-enable NFS metrics collection in node_exporter |
Weekly Ops
Web/Git/API p95 latency
p50 Web latency for 200s
p95 Web latency for 200s
p95 API latency for 200s
p50 Git latency for 200s
Gitaly p95 latency
p95 Git latency for 200s
p50 API latency for 200s
Sidekiq CPU
API CPU
Git CPU
Web CPU
NFS timeouts
This issue was automatically generated using oncall-robot-assistant