Deployment Blockers - Week: 2026-06-01-2026-06-07

Overview

Start date End date Production deployments blocked for # of blockers
2026-06-01 2026-06-07 29.0 64

Blocker types overview

Blocker Type Time blocked on gstg Time blocked on gprd
RootCauseFlaky-Test 10.0 10.0
Change-request 6.0 6.0
RootCauseSoftware-Change 6.0 6.0
Total 22.0 22.0

Weekly overview

Issue Blocker type gstg gprd
https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22251+ 6.0 6.0
2026-06-04: QA smoke jobs are failing due to Re... (gitlab-com/gl-infra/production#22243 - closed) RootCauseSoftware-Change 6.0 6.0
2026-06-05: The loadbalancer SLI of the ci-runn... (gitlab-com/gl-infra/production#22256 - closed) 3.0 3.0
2026-06-03: Duo Agent Platform workflows fail t... (gitlab-com/gl-infra/production#22241 - closed) 2.0 2.0
Upgrade Postgres to 17 on dev.gitlab.org (gitlab-com/gl-infra/production#22234 - closed) Change-request 2.0 2.0
[GPRD]: Route main traffic away from NGINX Change-request 4.0 4.0
QA failure: qa/specs/features/api/10_software_s... (#26785 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#26786 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#26788 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/10_sof... (#26790 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/10_sof... (#26794 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#26798 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gprd-cny (#26801 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#26802 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#26814 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#26815 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gprd-cny (#26820 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/api/3_create/merg... (#26830 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/9_tena... (#26838 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#26839 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/4_veri... (#26761 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#26783 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: (#26764 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#26773 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gprd-cny (#26779 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/ee/api/2_plan/epi... (#26768 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#26812 - closed) 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26770+ 0.0 0.0
QA failure: qa/specs/features/browser_ui/9_tena... (#26817 - closed) 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26818+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26769+ 0.0 0.0
QA failures on gstg-cny (#26821 - closed) 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26822+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26823+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26824+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26825+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26827+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26767+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26833+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26834+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26766+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26836+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26840+ 0.0 0.0
QA failure: qa/specs/features/ee/api/2_plan/epi... (#26784 - closed) 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26787+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26789+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26782+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26791+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26781+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26795+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26777+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26799+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26800+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26776+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26775+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26803+ 0.0 0.0
QA failures on gstg-cny (#26804 - closed) 0.0 0.0
QA failure: qa/specs/features/browser_ui/3_crea... (#26805 - closed) 0.0 0.0
QA failure: qa/specs/features/browser_ui/3_crea... (#26807 - closed) 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26774+ 0.0 0.0
QA failure: qa/specs/features/browser_ui/3_crea... (#26808 - closed) 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26809+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26810+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/26811+ 0.0 0.0
Total 29.0 29.0

Additional incidents

Below is a list of production incidents created last week.

Click to expand
Issue
2026-06-07: Grafana datasources error rate for ... (gitlab-com/gl-infra/production#22266 - closed)
https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22265+
2026-06-07: Scheduled GCP snapshots missing for... (gitlab-com/gl-infra/production#22264 - closed)
https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22263+
2026-06-07: server_code_completions apdex SLO v... (gitlab-com/gl-infra/production#22262 - closed)
2026-06-06: Sidekiq job execution duration SLO ... (gitlab-com/gl-infra/production#22261 - closed)
2026-06-05: Workflows failing with usage quota ... (gitlab-com/gl-infra/production#22259 - closed)
2026-06-05: auto-deploy blocked due to canonica... (gitlab-com/gl-infra/production#22258 - closed)
2026-06-04: Cluster autoscaler scaleup error ra... (gitlab-com/gl-infra/production#22253 - closed)
2026-06-04: Low apdex for api service workhorse... (gitlab-com/gl-infra/production#22250 - closed)
2026-06-04: No traffic reported by pubsub_subsc... (gitlab-com/gl-infra/production#22245 - closed)
2026-06-04: HTTP 502 Bad Gateway error on gitla... (gitlab-com/gl-infra/production#22242 - closed)
2026-06-02: The runner_api_requests SLI of the ... (gitlab-com/gl-infra/production#22236 - closed)
https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22235+

Instructions

  • Review the Additional incidents list and add the Deploys-blocked and RootCause labels if required.
  • Retrigger this pipeline job to update this report and metrics with the updated values. Consider this will discard any manual changes added.
  • Update the "weekly overview" table of this issue to also include:
    • any blocking CRs
  • Update the Deployments metric review epic.
    • Add a new row to the Overview section: Copy and paste the information from the Overview section in this issue and link to this issue in the Breakdown of blockers column.
    • Update the Graph: Update the data on the spreadsheet and then update the graph on the Deployments metric review epic.

📣 The deployment blockers per week can now be visualized in the Deployment Blockers Dashboard.

Edited by Manjunath Bhadrannavar