Part of https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/15449
Depends on https://ops.gitlab.net/gitlab-com/gl-infra/config-mgmt/-/merge_requests/3700