Deployment Blockers - Week: 2026-10-26-2026-11-01

Overview

Start date End date Production deployments blocked for # of blockers
2026-10-26 2026-11-01 27.5 75

Blocker types overview

Blocker Type Time blocked on gstg Time blocked on gprd
Change-request 2.0 2.0
RootCauseFlaky-Test 16.5 16.5
RootCauseIndeterminate 9.0 9.0
Total 27.5 27.5

Weekly overview

Issue Blocker type gstg gprd
2026-10-30: Deployment failing to staging due t... (gitlab-com/gl-infra/production#23365 - closed) RootCauseIndeterminate 9.0 9.0
[CR] [C3] Test package size limits on auto-buil... (gitlab-com/gl-infra/production#23281 - closed) Change-request 2.0 2.0
QA failure: qa/specs/features/browser_ui/3_crea... (#28199 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28205 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/2_plan... (#28207 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#28216 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28217 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28222 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28228 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/9_tena... (#28229 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28230 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: (#28231 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#28232 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28233 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#28234 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28235 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28237 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28239 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28240 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/4_veri... (#28241 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28242 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#28243 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/api/10_software_s... (#28244 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28245 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28179 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28176 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/api/10_software_s... (#28188 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: (#28184 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28172 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28194 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28170 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: (#28169 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: (#28168 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: (#28167 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/ee/browser_ui/3_c... (#28166 - closed) RootCauseFlaky-Test 0.5 0.5
QA failures on gstg-cny (#28195 - closed) 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28225+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28226+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28227+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28182+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28181+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28180+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28178+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28177+ 0.0 0.0
https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/23362+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28236+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28175+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28174+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28238+ 0.0 0.0
https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/23366+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28171+ 0.0 0.0
2026-10-27: PDM is failing on CellsDev (gitlab-com/gl-infra/production#23342 - closed) 0.0 0.0
2026-10-27: CI workloads impacted by GCP mainte... (gitlab-com/gl-infra/production#23343 - closed) 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28196+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28197+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28198+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28200+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28201+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28202+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28189+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28206+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28211+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28212+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28213+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28214+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28215+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28187+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28186+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28218+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28219+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28220+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28221+ 0.0 0.0
QA failures on gprd-cny (#28185 - closed) 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28223+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/28224+ 0.0 0.0
Total 27.5 27.5

Additional incidents

Below is a list of production incidents created last week.

Click to expand
Issue
2026-11-01: Probe availability for advisories.g... (gitlab-com/gl-infra/production#23380)
2026-10-31: CloudSQL CustomersDot CPU saturatio... (gitlab-com/gl-infra/production#23379 - closed)
2026-10-30: CloudSQL CustomersDot memory utiliz... (gitlab-com/gl-infra/production#23373)
2026-10-30: pulp_app_api error rate 1.445% viol... (gitlab-com/gl-infra/production#23368 - closed)
2026-10-29: Exact Code Search (Zoekt) Returning... (gitlab-com/gl-infra/production#23360)
https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/23358+
https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/23356+
2026-10-28: Concurrency limit queue growing for... (gitlab-com/gl-infra/production#23355 - closed)
2026-10-27: vault istio_internal_ingress apdex ... (gitlab-com/gl-infra/production#23351 - closed)
2026-10-27: goserver error rate on gitaly-07-st... (gitlab-com/gl-infra/production#23350)
2026-10-27: Sidekiq queueing apdex violation on... (gitlab-com/gl-infra/production#23349)
2026-10-26: Ci::ExecuteBuildHooksWorker concurr... (gitlab-com/gl-infra/production#23348)
2026-10-27: gate-sandbox.com unavailable after ... (gitlab-com/gl-infra/production#23341 - closed)
2026-10-26: grafana_datasources error rate at 2... (gitlab-com/gl-infra/production#23340 - closed)
https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/23338+
2026-10-26: Merge train in gitlab-org/gitlab is... (gitlab-com/gl-infra/production#23332 - closed)

Instructions

  • Review the Additional incidents list and add the Deploys-blocked and RootCause labels if required.
  • Retrigger this pipeline job to update this report and metrics with the updated values. Consider this will discard any manual changes added.
  • Update the "weekly overview" table of this issue to also include:
    • any blocking CRs
  • The Deployments metric review epic is updated automatically from the report issues. Retrigger the pipeline job above if the values change. Each year needs a new epic: set DEPLOYMENTS_METRIC_REVIEW_EPIC_IID on the ops schedule, or the update is skipped.

📣 The deployment blockers per week can now be visualized in the Deployment Blockers Dashboard.

Edited by GitLab Release Tools Bot