Weekly Reliability (SRE) Team Newsletter – On-call Period: 2022-11-22 - 2022-11-29
<!-- This issue was automatically generated by https://gitlab.com/gitlab-com/gl-infra/oncall-robot-assistant. -->
<!-- Announcements common to all the Reliability (SRE) Teams should be placed in this section. -->
# Announcements
#### [Engineering Week in Review](https://docs.google.com/document/d/1JBdCl3MAOSdlgq3kzzRmtzTsFWsTIQ9iQg0RHhMht6E/edit) Highlights:
<!-- Announcements for each individual SRE Team should be made in their respective sections below. -->
# Team Updates
<!-- xxYZzXcV -->
---
# On-Call During This Period
| Schedule | Username |
| -------- | -------- |
| SRE 8-hour Americas | Nels Nelson |
| SRE 8-hour Americas | Stephanie Jackson |
| SRE 8-hour APAC | Furhan Shabir |
| SRE 8-hour APAC | Gonzalo Servat |
| SRE 8-hour EMEA | Ahmad Sherif |
| SRE 8-hour EMEA | Steve Azzopardi |
## PagerDuty Incidents
[See the 1 week report for acknowledged PD pages](https://nonprod-log.gitlab.net/app/dashboards#/view/dacc1d40-1c64-11ec-b8fd-b5d052b1f8cb?_g=(time:(from:'2022-11-22T02:00:00Z',to:'2022-11-29T02:00:00Z'),filters:!((query:(match_phrase:(type.keyword:pagerduty))),(query:(match_phrase:(status.keyword:triggered)))))) ([long-term trend](https://nonprod-log.gitlab.net/goto/a436702d57864666cd0c8867cfaf73e9))
### Alerts Volume
* [Weekly Trend](https://nonprod-log.gitlab.net/goto/4b20cce0-cb91-11ec-b3a6-472d0398dd6e)
* [Monthly Trend](https://nonprod-log.gitlab.net/goto/89e93020-cb91-11ec-b3a6-472d0398dd6e)
* [90 Days Trend by Service](https://nonprod-log.gitlab.net/goto/ed862250-cb91-11ec-b3a6-472d0398dd6e)
### 7 Day Issue Stats
* Oncall issues : **0**
* Access Request : **0**
* Change Issues : **4**
* Incident Issues : **6**
* CorrectiveAction Issues : **0**
#### Change Issues
* 2022-11-22T19:07:27Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8083+
* 2022-11-22T18:54:06Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8082+
* 2022-11-22T17:41:02Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8081+
* 2022-11-22T01:10:31Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8079+
#### Incident Issues
* 2022-11-27T23:59:05Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8088+ | reliability~3760140 | ~"Service::Customers" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8088`
* 2022-11-26T17:39:10Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8087+ | reliability~3760141 | ~"Service::Web" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8087`
* 2022-11-25T09:49:46Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8086+ | reliability~3760142 | ~"Service::Gitaly" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8086`
* 2022-11-25T06:30:23Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8085+ | reliability~3760140 | ~"Service::Customers" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8085`
* 2022-11-23T02:11:40Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8084+ | reliability~3760141 | ~"Service::Oncall-Tooling" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8084`
* 2022-11-21T19:29:21Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8078+ | reliability~3760141 | ~"Service::Patroni" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8078`
#### CorrectiveAction Issues
### Open Issue Stats
* [Oncall issues](https://gitlab.com/gitlab-com/infrastructure/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=oncall) : **2**
* [Change issues](https://gitlab.com/gitlab-com/production/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=change) : **22**
* [Incident issues](https://gitlab.com/gitlab-com/production/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=incident) : **8**
* [Access Request](https://gitlab.com/gitlab-com/infrastructure/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=access%20request) : **0**
* [CorrectiveAction](https://gitlab.com/gitlab-com/infrastructure/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=corrective%20action) : **88**
#### Open Change Issues
<details>
<summary>Show/Hide Table</summary>
| Created | Summary |
| ------- | ------- |
| 2022-11-22T19:07:27Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8083+ |
| 2022-11-22T18:54:06Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8082+ |
| 2022-11-17T16:41:35Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8066+ |
| 2022-11-14T23:01:34Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8048+ |
| 2022-11-14T17:54:45Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/8046+ |
| 2022-11-01T00:52:47Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7967+ |
| 2022-11-01T00:52:32Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7966+ |
| 2022-10-18T07:03:19Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7893+ |
| 2022-10-18T06:45:39Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7892+ |
| 2022-10-14T03:26:01Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7877+ |
| 2022-10-11T15:17:53Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7862+ |
| 2022-10-07T22:14:21Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7848+ |
| 2022-10-06T07:05:45Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7840+ |
| 2022-10-05T01:45:36Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7836+ |
| 2022-10-05T00:00:51Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7834+ |
| 2022-09-02T09:37:55Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7681+ |
| 2022-08-25T14:11:48Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7653+ |
| 2022-08-17T19:40:56Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7615+ |
| 2022-08-16T16:43:58Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7607+ |
| 2022-07-22T14:23:23Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7497+ |
| 2022-06-06T15:55:01Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7206+ |
| 2022-05-23T16:22:23Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7117+ |
</details>
#### Open Incident Issues
<details>
<summary>Show/Hide Table</summary>
| Created | Summary |
| ------- | ------- |
| 2022-11-02T14:18:07Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7979+ |
| 2022-10-25T20:05:24Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7924+ |
</details>
#### Open Oncall Issues
<details>
<summary>Show/Hide Table</summary>
| Created | Summary |
| ------- | ------- |
| 2021-09-17T19:35:34Z | https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/14205+ |
| 2020-12-18T22:29:14Z | https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/12200+ |
</details>
#### Issues for Review during Incident Review Meeting
<details>
If there are any incidents you think would be good to review, please add them to the [Agenda](https://docs.google.com/document/d/1Llm9tXHC2dNt_eercRUUXlUyWmOVw00wmXWQQbWvv2c/edit?usp=sharing) for the next meeting.
</details>
issue