Weekly Reliability (SRE) Team Newsletter – On-call Period: 2022-12-13 - 2022-12-20
<!-- This issue was automatically generated by https://gitlab.com/gitlab-com/gl-infra/oncall-robot-assistant. -->
<!-- Announcements common to all the Reliability (SRE) Teams should be placed in this section. -->
# Announcements
#### [Engineering Week in Review](https://docs.google.com/document/d/1JBdCl3MAOSdlgq3kzzRmtzTsFWsTIQ9iQg0RHhMht6E/edit) Highlights:
<!-- Announcements for each individual SRE Team should be made in their respective sections below. -->
# Team Updates
<!-- xxYZzXcV -->
---
# On-Call During This Period
| Schedule | Username |
| -------- | -------- |
| SRE 8-hour Americas | Matt Smiley |
| SRE 8-hour Americas | Nels Nelson |
| SRE 8-hour APAC | Devin Sylva |
| SRE 8-hour APAC | Filipe Santos |
| SRE 8-hour APAC | Nick Duff |
| SRE 8-hour EMEA | Rehab Hassanein |
| SRE 8-hour EMEA | Igor Wiedler |
## PagerDuty Incidents
[See the 1 week report for acknowledged PD pages](https://nonprod-log.gitlab.net/app/dashboards#/view/dacc1d40-1c64-11ec-b8fd-b5d052b1f8cb?_g=(time:(from:'2022-12-13T02:00:00Z',to:'2022-12-20T02:00:00Z'),filters:!((query:(match_phrase:(type.keyword:pagerduty))),(query:(match_phrase:(status.keyword:triggered)))))) ([long-term trend](https://nonprod-log.gitlab.net/goto/a436702d57864666cd0c8867cfaf73e9))
### Alerts Volume
* [Weekly Trend](https://nonprod-log.gitlab.net/goto/4b20cce0-cb91-11ec-b3a6-472d0398dd6e)
* [Monthly Trend](https://nonprod-log.gitlab.net/goto/89e93020-cb91-11ec-b3a6-472d0398dd6e)
* [90 Days Trend by Service](https://nonprod-log.gitlab.net/goto/ed862250-cb91-11ec-b3a6-472d0398dd6e)
### 7 Day Issue Stats
* Oncall issues : **0**
* Access Request : **0**
* Change Issues : **11**
* Incident Issues : **9**
* CorrectiveAction Issues : **0**
#### Change Issues
* 2022-12-16T09:48:46Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8168+
* 2022-12-16T00:44:54Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8166+
* 2022-12-15T19:35:28Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8165+
* 2022-12-15T19:18:54Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8164+
* 2022-12-15T15:46:51Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8163+
* 2022-12-15T15:19:22Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8162+
* 2022-12-13T14:27:37Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8158+
* 2022-12-13T14:02:02Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8157+
* 2022-12-13T05:41:29Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8154+
* 2022-12-13T03:34:38Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8153+
* 2022-12-12T12:45:48Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8151+
#### Incident Issues
* 2022-12-17T16:12:14Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8170+ | reliability~3760141 | ~"Service::Web" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8170`
* 2022-12-16T15:20:58Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8169+ | reliability~3760141 | ~"Service::Thanos" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8169`
* 2022-12-16T05:36:48Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8167+ | reliability~3760141 | ~"Service::Web" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8167`
* 2022-12-15T11:33:18Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8161+ | reliability~3760141 | ~"Service::Sidekiq" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8161`
* 2022-12-15T00:49:17Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8160+ | reliability~3760141 | | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8160`
* 2022-12-14T10:24:54Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8159+ | reliability~3760140 | ~"Service::Sidekiq" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8159`
* 2022-12-13T13:30:12Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8156+ | reliability~3760141 | ~"Service::Postgres" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8156`
* 2022-12-13T07:44:50Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8155+ | reliability~3760142 | ~"Service::Sidekiq" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8155`
* 2022-12-12T19:38:49Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8152+ | reliability~3760141 | ~"Service::Grafana" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8152`
#### CorrectiveAction Issues
* 2022-12-12T15:01:17Z - https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/16964+
### Open Issue Stats
* [Oncall issues](https://gitlab.com/gitlab-com/infrastructure/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=oncall) : **2**
* [Change issues](https://gitlab.com/gitlab-com/production/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=change) : **24**
* [Incident issues](https://gitlab.com/gitlab-com/production/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=incident) : **7**
* [Access Request](https://gitlab.com/gitlab-com/infrastructure/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=access%20request) : **0**
* [CorrectiveAction](https://gitlab.com/gitlab-com/infrastructure/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=corrective%20action) : **91**
#### Open Change Issues
<details>
<summary>Show/Hide Table</summary>
| Created | Summary |
| ------- | ------- |
| 2022-12-15T19:35:28Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8165+ |
| 2022-12-15T19:18:54Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8164+ |
| 2022-12-15T15:19:22Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8162+ |
| 2022-12-13T14:27:37Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8158+ |
| 2022-12-08T10:13:57Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8146+ |
| 2022-12-02T23:30:39Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8120+ |
| 2022-12-01T00:14:18Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8113+ |
| 2022-11-30T19:50:30Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8109+ |
| 2022-11-30T15:54:35Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8106+ |
| 2022-11-30T15:53:34Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8105+ |
| 2022-11-14T23:01:34Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8048+ |
| 2022-10-18T07:03:19Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7893+ |
| 2022-10-18T06:45:39Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7892+ |
| 2022-10-14T03:26:01Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7877+ |
| 2022-10-07T22:14:21Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7848+ |
| 2022-10-06T07:05:45Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7840+ |
| 2022-10-05T00:00:51Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7834+ |
| 2022-09-02T09:37:55Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7681+ |
| 2022-08-25T14:11:48Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7653+ |
| 2022-08-17T19:40:56Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7615+ |
| 2022-08-16T16:43:58Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7607+ |
| 2022-07-22T14:23:23Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7497+ |
| 2022-06-06T15:55:01Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7206+ |
| 2022-05-23T16:22:23Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7117+ |
</details>
#### Open Incident Issues
<details>
<summary>Show/Hide Table</summary>
| Created | Summary |
| ------- | ------- |
</details>
#### Open Oncall Issues
<details>
<summary>Show/Hide Table</summary>
| Created | Summary |
| ------- | ------- |
| 2021-09-17T19:35:34Z | https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/14205+ |
| 2020-12-18T22:29:14Z | https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/12200+ |
</details>
#### Issues for Review during Incident Review Meeting
<details>
If there are any incidents you think would be good to review, please add them to the [Agenda](https://docs.google.com/document/d/1Llm9tXHC2dNt_eercRUUXlUyWmOVw00wmXWQQbWvv2c/edit?usp=sharing) for the next meeting.
</details>
issue