Deployment Blockers - Week: 2026-06-15-2026-06-21

Overview

Start date End date Production deployments blocked for # of blockers
2026-06-15 2026-06-21 32.0 48

Blocker types overview

Blocker Type Time blocked on gstg Time blocked on gprd
RootCauseKnown-Software-Issue 1.0 1.0
RootCauseFlaky-Test 10.0 10.0
RootCauseConfig-Change 9.5 9.5
RootCauseMalicious-Traffic 4.0 4.0
RootCauseSoftware-Change 7.5 7.5
Total 32.0 32.0

Weekly overview

Issue Blocker type gstg gprd
2026-06-18: Sidekiq job execution error rate SL... (gitlab-com/gl-infra/production#22335 - closed) RootCauseSoftware-Change 6.0 6.0
https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22324+ RootCauseConfig-Change 6.0 6.0
2026-06-17: Broken master (gitlab-com/gl-infra/production#22331 - closed) RootCauseMalicious-Traffic 4.0 4.0
2026-06-15: Deployment failure in `gstg` and `g... (gitlab-com/gl-infra/production#22312 - closed) RootCauseConfig-Change 3.0 3.0
2026-06-19: SAML SSO namespace access with IP r... (gitlab-com/gl-infra/production#22343 - closed) RootCauseSoftware-Change 1.0 1.0
QA failures on gstg-cny (#27006 - closed) RootCauseKnown-Software-Issue 1.0 1.0
QA failure: qa/specs/features/browser_ui/8_moni... (#27161 - closed) RootCauseFlaky-Test 0.5 0.5
2026-06-19: Foundational Duo flows failing (gitlab-com/gl-infra/production#22342 - closed) RootCauseSoftware-Change 0.5 0.5
QA failure: qa/specs/features/ee/browser_ui/2_p... (#27158 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/9_tena... (#27157 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/2_plan... (#27173 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: (#27154 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/2_plan... (#27140 - closed) RootCauseFlaky-Test 0.5 0.5
2026-06-18: Autodeploy pipeline blocked due to ... (gitlab-com/gl-infra/production#22339 - closed) RootCauseConfig-Change 0.5 0.5
QA failure: qa/specs/features/browser_ui/6_depl... (#27186 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/2_plan... (#27109 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/10_sof... (#27107 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/ee/api/2_plan/epi... (#27100 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: (#27073 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#27052 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: (#27046 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: (#27080 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#27083 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/10_sof... (#27086 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/10_sof... (#27092 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/9_tena... (#27013 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/api/3_create/merg... (#27095 - closed) RootCauseFlaky-Test 0.5 0.5
QA failure: qa/specs/features/browser_ui/3_crea... (#27098 - closed) RootCauseFlaky-Test 0.5 0.5
https://gitlab.com/gitlab-org/release/tasks/-/issues/27014+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27178+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27172+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27171+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27038+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27043+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27181+ 0.0 0.0
QA failures on gstg-cny (#27007 - closed) 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27153+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27152+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27151+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27150+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27147+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27146+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27143+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27136+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27108+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27104+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27102+ 0.0 0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/27096+ 0.0 0.0
Total 32.0 32.0

Additional incidents

Below is a list of production incidents created last week.

Click to expand
Issue
2026-06-20: The ci_runner_jobs SLI of the ci-ru... (gitlab-com/gl-infra/production#22347 - closed)
2026-06-19: Gitaly active node available space ... (gitlab-com/gl-infra/production#22346 - closed)
2026-06-17: Blackbox probe failures for livenes... (gitlab-com/gl-infra/production#22332 - closed)
2026-06-17: lint_chart job is failing on dev fo... (gitlab-com/gl-infra/production#22329 - closed)
2026-06-16: release-environments-qa failing blo... (gitlab-com/gl-infra/production#22328 - closed)
2026-06-16: `test-storybook` job failing on Git... (gitlab-com/gl-infra/production#22320 - closed)
2026-06-16: Cluster autoscaler scaleup error ra... (gitlab-com/gl-infra/production#22319 - closed)
2026-06-15: Open file descriptor saturation in ... (gitlab-com/gl-infra/production#22318 - closed)
2026-06-15: Workhorse web requests apdex SLO vi... (gitlab-com/gl-infra/production#22315 - closed)
https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22314+
2026-06-15: Open file descriptor utilization ne... (gitlab-com/gl-infra/production#22313 - closed)

Instructions

  • Review the Additional incidents list and add the Deploys-blocked and RootCause labels if required.
  • Retrigger this pipeline job to update this report and metrics with the updated values. Consider this will discard any manual changes added.
  • Update the "weekly overview" table of this issue to also include:
    • any blocking CRs
  • Update the Deployments metric review epic.
    • Add a new row to the Overview section: Copy and paste the information from the Overview section in this issue and link to this issue in the Breakdown of blockers column.
    • Update the Graph: Update the data on the spreadsheet and then update the graph on the Deployments metric review epic.

📣 The deployment blockers per week can now be visualized in the Deployment Blockers Dashboard.

Edited by Mawreen Dela Cruz