[Feature flags] Group runner denormalized queuing queries rollout
Summary
This issue is to rollout feature flags added in !70162 (merged):
ci_pending_builds_maintain_namespace_traversal_ids
ci_queueing_denormalize_namespace_traversal_ids
Owners
- Team: grouppipeline execution
- Most appropriate slack channel to reach out to:
#g_pipeline-execution
- Best individual to reach out to: @grzesiek
- PM: @cheryl.li
Stakeholders
Are there any other stages or teams involved that need to be kept in the loop?
- Name of a PM: @jreporter
The Rollout Plan
- Full rollout on Staging
- Incremental rollout on GitLab.com
The ci_pending_builds_maintain_namespace_traversal_ids
needs to be enabled first for a couple of days before we can proceed with the rollout.
Expectations
What are we expecting to happen?
CI runners apdex is healthy, builds are being processed as usual.
What might happen if this goes wrong?
Builds for group runners are not being picked.
What can we monitor to detect problems with this?
Rollout Steps
ci_pending_builds_maintain_namespace_traversal_ids
-
Enable ci_pending_builds_maintain_namespace_traversal_ids
feature globally on staging. -
Confirm the feature flag is enabled on staging
without incident -
Enable ci_pending_builds_maintain_namespace_traversal_ids
feature globally on gitlab.com. -
Announce on the feature issue that the feature has been globally enabled.
ci_queueing_denormalize_namespace_traversal_ids
After min 24 and completion of denormalization consistency maintaining features.
-
All required denormalization consistency-related features are deployed to production -
Enable ci_queueing_denormalize_namespace_traversal_ids
feature globally on staging. -
Confirm the feature flag is enabled on staging
without incident -
Incrementally roll out the feature. -
5% -
25% -
50% -
100%
-
-
Verify the change has the desired outcome with the limited rollout before enabling the feature globally on production. -
Enable the feature globally on production environment. -
Announce on the feature issue that the feature has been globally enabled.
Rollback Steps
Fully disable feature flags.
Edited by Grzegorz Bizon