Deployment Blockers - Week: 2026-01-05-2026-01-11

Overview

Start date	End date	Production deployments blocked for	# of blockers
2026-01-05	2026-01-11	29.0	23

Blocker types overview

Blocker Type	Time blocked on gstg	Time blocked on gprd
Change-request	8.0	8.0
RootCauseFlaky-Test	2.5	2.5
RootCauseDB-Migration	8.0	8.0
RootCauseSoftware-Change	10.0	10.0
RootCauseFeature-Flag	0.5	0.5
Total	29.0	29.0

Weekly overview

Issue	Blocker type	gstg	gprd
2026-01-08: Rollout Ruby 3.3 to Production (gitlab-com/gl-infra/production#20969 - closed)	Change-request	8.0	8.0
QA failure: qa/specs/features/ee/browser_ui/2_p... (#22902 - closed)	RootCauseFlaky-Test	0.5	0.5
QA failure: qa/specs/features/browser_ui/2_plan... (#22904 - closed)		0.0	0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/22907+		0.0	0.0
QA failure: (#22908 - closed)	RootCauseFlaky-Test	0.5	0.5
QA failures on gprd-cny (#22909 - closed)		0.0	0.0
2026-01-06: Sidekiq queueing SLO violation on u... (gitlab-com/gl-infra/production#21046 - closed)	RootCauseDB-Migration	2.0	2.0
QA failures on gprd-cny (#22911 - closed)		0.0	0.0
QA failure: (#22914 - closed)	RootCauseFlaky-Test	0.5	0.5
https://gitlab.com/gitlab-org/release/tasks/-/issues/22916+		0.0	0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/22917+		0.0	0.0
2026-01-06: gitlab-migrations fails on Staging ... (gitlab-com/gl-infra/production#21048 - closed)	RootCauseDB-Migration	1.0	1.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/22924+		0.0	0.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/22925+		0.0	0.0
2026-01-07: Post Deploy Migration fails on Staging (gitlab-com/gl-infra/production#21053 - closed)	RootCauseDB-Migration	3.0	3.0
2026-01-07: Prod Post-deployment migration failed (gitlab-com/gl-infra/production#21054 - closed)	RootCauseDB-Migration	2.0	2.0
https://gitlab.com/gitlab-org/release/tasks/-/issues/22926+		0.0	0.0
2026-01-08: Deployments blocked due to broken m... (gitlab-com/gl-infra/production#21058 - closed)	RootCauseSoftware-Change	10.0	10.0
2026-01-08: Duo agentic chat in the Web doesn't... (gitlab-com/gl-infra/production#21060 - closed)	RootCauseFeature-Flag	0.5	0.5
QA failures on gstg-cny (#22931 - closed)		0.0	0.0
QA failures on gstg-cny (#22935 - closed)	RootCauseFlaky-Test	0.5	0.5
https://gitlab.com/gitlab-org/release/tasks/-/issues/22939+		0.0	0.0
QA failure: (#22941 - closed)	RootCauseFlaky-Test	0.5	0.5
Total		29.0	29.0

Additional incidents

Below is a list of production incidents created last week.

Click to expand

Issue
2026-01-09: No runner jobs traffic for ci_runne... (gitlab-com/gl-infra/production#21063 - closed)
2026-01-08: Highly flakey smoke tests for batch... (gitlab-com/gl-infra/production#21062 - closed)
2026-01-08: Sidekiq queueing apdex SLO violatio... (gitlab-com/gl-infra/production#21061 - closed)
2026-01-08: Classic Duo Chat does not work when... (gitlab-com/gl-infra/production#21059 - closed)
2026-01-07: Manifest read requests on registry ... (gitlab-com/gl-infra/production#21056 - closed)
2026-01-07: Sidekiq queueing apdex SLO violatio... (gitlab-com/gl-infra/production#21052 - closed)
2026-01-06: Error rate for pulp_nginx in pulp s... (gitlab-com/gl-infra/production#21050 - closed)
2026-01-06: Websocket error in executing Duo Ag... (gitlab-com/gl-infra/production#21047 - closed)

Instructions

• Review the Additional incidents list and add the Deploys-blocked and RootCause labels if required.
• Retrigger this pipeline job to update this report and metrics with the updated values. Consider this will discard any manual changes added.
• Update the "weekly overview" table of this issue to also include:
  • any blocking CRs
• Update the Deployments metric review epic.
  • Add a new row to the Overview section: Copy and paste the information from the Overview section in this issue and link to this issue in the Breakdown of blockers column.
  • Update the Graph: Update the data on the spreadsheet and then update the graph on the Deployments metric review epic.

📣 The deployment blockers per week can now be visualized in the Deployment Blockers Dashboard.