<!-- This issue was automatically generated by https://gitlab.com/gitlab-com/gl-infra/oncall-robot-assistant. --> <!-- Announcements common to all the Reliability (SRE) Teams should be placed in this section. --> # Announcements #### [Engineering Week in Review](https://docs.google.com/document/d/1JBdCl3MAOSdlgq3kzzRmtzTsFWsTIQ9iQg0RHhMht6E/edit) Highlights: <!-- Announcements for each individual SRE Team should be made in their respective sections below. --> # Team Updates <!-- xxYZzXcV --> --- # On-Call During This Period | Schedule | Username | | -------- | -------- | | SRE 8-hour Americas | Hendrik Meyer | | SRE 8-hour Americas | Nels Nelson | | SRE 8-hour APAC | Filipe Santos | | SRE 8-hour EMEA | Michal Wasilewski | | SRE 8-hour EMEA | Rehab Hassanein | ## PagerDuty Incidents [See the 1 week report for acknowledged PD pages](https://nonprod-log.gitlab.net/app/dashboards#/view/dacc1d40-1c64-11ec-b8fd-b5d052b1f8cb?_g=(time:(from:'2022-08-23T01:00:00Z',to:'2022-08-30T01:00:00Z'),filters:!((query:(match_phrase:(type.keyword:pagerduty))),(query:(match_phrase:(status.keyword:triggered)))))) ([long-term trend](https://nonprod-log.gitlab.net/goto/a436702d57864666cd0c8867cfaf73e9)) ### Alerts Volume * [Weekly Trend](https://nonprod-log.gitlab.net/goto/4b20cce0-cb91-11ec-b3a6-472d0398dd6e) * [Monthly Trend](https://nonprod-log.gitlab.net/goto/89e93020-cb91-11ec-b3a6-472d0398dd6e) * [90 Days Trend by Service](https://nonprod-log.gitlab.net/goto/ed862250-cb91-11ec-b3a6-472d0398dd6e) ### 7 Day Issue Stats * Oncall issues : **0** * Access Request : **0** * Change Issues : **11** * Incident Issues : **14** * CorrectiveAction Issues : **0** #### Change Issues * 2022-08-28T20:22:44Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7660+ * 2022-08-26T14:28:22Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7658+ * 2022-08-25T19:42:41Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7654+ * 2022-08-25T14:11:48Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7653+ * 2022-08-25T13:38:21Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7652+ * 2022-08-25T09:46:49Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7651+ * 2022-08-24T22:04:43Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7649+ * 2022-08-24T12:20:34Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7647+ * 2022-08-23T18:07:40Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7639+ * 2022-08-23T11:49:09Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7637+ * 2022-08-23T10:33:31Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7636+ #### Incident Issues * 2022-08-29T01:44:48Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7661+ | reliability~3760142 | ~"Service::Container Registry" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7661` * 2022-08-27T10:44:00Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7659+ | reliability~3760141 | ~"Service::Grafana" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7659` * 2022-08-26T12:42:51Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7657+ | reliability~3760141 | ~"Service::Logging" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7657` * 2022-08-26T04:44:04Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7656+ | reliability~3760140 | ~"Service::Infrastructure" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7656` * 2022-08-25T22:34:22Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7655+ | reliability~3760141 | | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7655` * 2022-08-25T01:16:45Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7650+ | reliability~3760142 | ~"Service::Prometheus" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7650` * 2022-08-24T08:05:26Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7645+ | reliability~3760142 | | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7645` * 2022-08-24T07:02:44Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7644+ | reliability~3760141 | ~"Service::Postgres" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7644` * 2022-08-24T06:52:33Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7643+ | reliability~3760142 | ~"Service::Gitaly" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7643` * 2022-08-24T06:50:18Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7642+ | | | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7642` * 2022-08-23T21:40:38Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7641+ | reliability~3760142 | ~"Service::Postgres" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7641` * 2022-08-23T14:07:29Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7638+ | reliability~3760139 | ~"Service::License" | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7638` * 2022-08-22T09:18:48Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7635+ | reliability~3760141 | | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7635` * 2022-08-22T09:18:17Z - https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7634+ | reliability~3760141 | | `https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7634` #### CorrectiveAction Issues * 2022-08-24T13:50:27Z - https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/16231+ * 2022-08-24T13:45:49Z - https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/16230+ ### Open Issue Stats * [Oncall issues](https://gitlab.com/gitlab-com/infrastructure/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=oncall) : **2** * [Change issues](https://gitlab.com/gitlab-com/production/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=change) : **29** * [Incident issues](https://gitlab.com/gitlab-com/production/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=incident) : **6** * [Access Request](https://gitlab.com/gitlab-com/infrastructure/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=access%20request) : **0** * [CorrectiveAction](https://gitlab.com/gitlab-com/infrastructure/issues?scope=all&utf8=%E2%9C%93&state=opened&label_name[]=corrective%20action) : **88** #### Open Change Issues <details> <summary>Show/Hide Table</summary> | Created | Summary | | ------- | ------- | | 2022-08-28T20:22:44Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7660+ | | 2022-08-26T14:28:22Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7658+ | | 2022-08-25T14:11:48Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7653+ | | 2022-08-25T13:38:21Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7652+ | | 2022-08-25T09:46:49Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7651+ | | 2022-08-23T10:33:31Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7636+ | | 2022-08-19T20:10:21Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7628+ | | 2022-08-19T12:51:52Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7626+ | | 2022-08-19T08:29:12Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7624+ | | 2022-08-17T19:40:56Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7615+ | | 2022-08-16T16:43:58Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7607+ | | 2022-08-16T14:31:39Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7606+ | | 2022-08-15T10:36:05Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7598+ | | 2022-08-12T15:04:02Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7586+ | | 2022-08-12T14:20:37Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7585+ | | 2022-08-12T13:26:03Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7583+ | | 2022-08-03T14:54:21Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7543+ | | 2022-08-03T14:00:10Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7542+ | | 2022-08-01T08:17:13Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7531+ | | 2022-08-01T08:16:04Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7530+ | | 2022-08-01T08:15:16Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7529+ | | 2022-08-01T08:14:38Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7528+ | | 2022-07-27T14:39:01Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7518+ | | 2022-07-25T16:23:58Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7506+ | | 2022-07-22T14:23:23Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7497+ | | 2022-06-28T16:43:38Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7343+ | | 2022-06-27T14:16:42Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7334+ | | 2022-06-06T15:55:01Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7206+ | | 2022-05-23T16:22:23Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7117+ | </details> #### Open Incident Issues <details> <summary>Show/Hide Table</summary> | Created | Summary | | ------- | ------- | | 2022-08-29T01:44:48Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7661+ | | 2022-08-25T22:34:22Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7655+ | | 2022-08-15T16:40:33Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7601+ | | 2022-08-09T17:31:57Z | https://gitlab.com/gitlab-com/gl-infra/production/-/issues/7570+ | </details> #### Open Oncall Issues <details> <summary>Show/Hide Table</summary> | Created | Summary | | ------- | ------- | | 2021-09-17T19:35:34Z | https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/14205+ | | 2020-12-18T22:29:14Z | https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/12200+ | </details> #### Issues for Review during Incident Review Meeting <details> If there are any incidents you think would be good to review, please add them to the [Agenda](https://docs.google.com/document/d/1Llm9tXHC2dNt_eercRUUXlUyWmOVw00wmXWQQbWvv2c/edit?usp=sharing) for the next meeting. </details>