Wednesday 2025-07-30 04:22 UTC - gitlab/gitlab-ee
broken master
with rspec:feature-flags, rspec-ee system pg16 16/16, rspec-ee system pg16 15/16, rspec-ee system pg16 14/16, rspec-ee system pg16 13/16, rspec-ee system pg16 12/16, rspec-ee system pg...
gitlab/gitlab-ee pipeline #393592 failed
Pipeline ID | Branch | Commit | Merge request | Source | Duration | Triggered by |
---|---|---|---|---|---|---|
393592 |
master |
Merge branch 'release-tools/update-kas' into 'master' | N/A | push |
72.5 minutes | GitLab mirror push bot |
Failed jobs (47):
-
rspec:feature-flags Job ID:
29436055
(retry with@gitlab-bot retry_job 29436055
) -
rspec-ee system pg16 16/16 Job ID:
29436047
(retry with@gitlab-bot retry_job 29436047
) -
rspec-ee system pg16 15/16 Job ID:
29436046
(retry with@gitlab-bot retry_job 29436046
) -
rspec-ee system pg16 14/16 Job ID:
29436045
(retry with@gitlab-bot retry_job 29436045
) -
rspec-ee system pg16 13/16 Job ID:
29436044
(retry with@gitlab-bot retry_job 29436044
) -
rspec-ee system pg16 12/16 Job ID:
29436043
(retry with@gitlab-bot retry_job 29436043
) -
rspec-ee system pg16 11/16 Job ID:
29436042
(retry with@gitlab-bot retry_job 29436042
) -
rspec-ee system pg16 10/16 Job ID:
29436041
(retry with@gitlab-bot retry_job 29436041
) -
rspec-ee system pg16 9/16 Job ID:
29436040
(retry with@gitlab-bot retry_job 29436040
) -
rspec-ee system pg16 8/16 Job ID:
29436039
(retry with@gitlab-bot retry_job 29436039
) -
rspec-ee system pg16 7/16 Job ID:
29436038
(retry with@gitlab-bot retry_job 29436038
) -
rspec-ee system pg16 6/16 Job ID:
29436037
(retry with@gitlab-bot retry_job 29436037
) -
rspec-ee system pg16 5/16 Job ID:
29436036
(retry with@gitlab-bot retry_job 29436036
) -
rspec-ee system pg16 4/16 Job ID:
29436035
(retry with@gitlab-bot retry_job 29436035
) -
rspec-ee system pg16 3/16 Job ID:
29436034
(retry with@gitlab-bot retry_job 29436034
) -
rspec-ee system pg16 2/16 Job ID:
29436033
(retry with@gitlab-bot retry_job 29436033
) -
rspec-ee system pg16 1/16 Job ID:
29436032
(retry with@gitlab-bot retry_job 29436032
) -
rspec-ee integration pg16 9/9 Job ID:
29436031
(retry with@gitlab-bot retry_job 29436031
) -
rspec-ee integration pg16 8/9 Job ID:
29436030
(retry with@gitlab-bot retry_job 29436030
) -
rspec-ee integration pg16 7/9 Job ID:
29436029
(retry with@gitlab-bot retry_job 29436029
) -
rspec-ee integration pg16 6/9 Job ID:
29436028
(retry with@gitlab-bot retry_job 29436028
) -
rspec-ee integration pg16 5/9 Job ID:
29436027
(retry with@gitlab-bot retry_job 29436027
) -
rspec-ee integration pg16 4/9 Job ID:
29436026
(retry with@gitlab-bot retry_job 29436026
) -
rspec-ee integration pg16 3/9 Job ID:
29436025
(retry with@gitlab-bot retry_job 29436025
) -
rspec-ee integration pg16 2/9 Job ID:
29436024
(retry with@gitlab-bot retry_job 29436024
) -
rspec-ee integration pg16 1/9 Job ID:
29436023
(retry with@gitlab-bot retry_job 29436023
) -
rspec-ee unit pg16 39/39 Job ID:
29436022
(retry with@gitlab-bot retry_job 29436022
) -
rspec-ee unit pg16 38/39 Job ID:
29436021
(retry with@gitlab-bot retry_job 29436021
) -
rspec-ee unit pg16 37/39 Job ID:
29436020
(retry with@gitlab-bot retry_job 29436020
) -
rspec-ee unit pg16 35/39 Job ID:
29436018
(retry with@gitlab-bot retry_job 29436018
) -
rspec-ee unit pg16 34/39 Job ID:
29436017
(retry with@gitlab-bot retry_job 29436017
) -
rspec-ee unit pg16 33/39 Job ID:
29436016
(retry with@gitlab-bot retry_job 29436016
) -
rspec-ee unit pg16 32/39 Job ID:
29436015
(retry with@gitlab-bot retry_job 29436015
) -
rspec-ee unit pg16 31/39 Job ID:
29436014
(retry with@gitlab-bot retry_job 29436014
) -
rspec-ee unit pg16 30/39 Job ID:
29436013
(retry with@gitlab-bot retry_job 29436013
) -
rspec-ee unit pg16 28/39 Job ID:
29436011
(retry with@gitlab-bot retry_job 29436011
) -
rspec-ee unit pg16 27/39 Job ID:
29436010
(retry with@gitlab-bot retry_job 29436010
) -
rspec-ee unit pg16 25/39 Job ID:
29436008
(retry with@gitlab-bot retry_job 29436008
) -
rspec-ee unit pg16 21/39 Job ID:
29436004
(retry with@gitlab-bot retry_job 29436004
) -
rspec-ee unit pg16 8/39 Job ID:
29435991
(retry with@gitlab-bot retry_job 29435991
) -
rspec-ee unit pg16 7/39 Job ID:
29435990
(retry with@gitlab-bot retry_job 29435990
) -
rspec-ee unit pg16 6/39 Job ID:
29435989
(retry with@gitlab-bot retry_job 29435989
) -
rspec-ee unit pg16 4/39 Job ID:
29435987
(retry with@gitlab-bot retry_job 29435987
) -
rspec-ee unit pg16 3/39 Job ID:
29435986
(retry with@gitlab-bot retry_job 29435986
) -
rspec-ee unit pg16 2/39 Job ID:
29435985
(retry with@gitlab-bot retry_job 29435985
) -
rspec-ee unit pg16 1/39 Job ID:
29435984
(retry with@gitlab-bot retry_job 29435984
) -
rspec-ee background_migration pg16 3/3 Job ID:
29435983
(retry with@gitlab-bot retry_job 29435983
)
General guidelines
A broken master
branch on dev prevents monthly releases from being built.
Fixing the pipeline is a priority to prevent any delays in releases.
The process in the Broken master
handbook guide can be referenced since much of that process also applies here.
Investigation
Be sure to fill the Timeline
for this incident.
- If the failure is new, and looks like a potential flaky failure, you can retry the failing job.
Make sure to mention the retry in the
Timeline
and leave a link to the retried job. - Search for similar master-broken issues in https://gitlab.com/gitlab-org/quality/engineering-productivity/master-broken-incidents/-/issues
- If one exists, ask the DRI of the master-broken issue to cherry-pick any resulting merge requests into the stable branch
If the merge request author or maintainer is not available, this can be escalated using the dev-on-call process in the #dev-escalation slack channel.
Pre-resolution
If you believe that there's an easy resolution by either:
- Reverting a particular merge request.
- Making a quick fix (for example, one line or a few similar simple changes in a few lines).
You can create a merge request, assign to any available maintainer, and ping people that were involved/related to the introduction of the failure.
Additionally, a message can be posted in
#backend_maintainers
or#frontend_maintainers
to get a maintainer take a look at the fix ASAP. - Cherry picking a change that was used to fix a similar master-broken issue.
Resolution
Add a comment to this issue describing how this incident could have been prevented earlier in the Merge Request pipeline (rather than the merge commit pipeline).