Thursday 2023-12-21 03:37 UTC - `gitlab-org/gitlab` broken `master` with rspec-ee unit pg15 1/18, rspec-ee unit pg15 opensearch1 1/18, rspec-ee unit pg14 opensearch2 15/18, rspec unit pg15 23/28, rspec unit pg14-as-if-foss single-db 25/28, rspec unit p...
gitlab-org/gitlab pipeline #1115058176 failed
Project | Pipeline ID | Branch | Commit | Merge request | Source | Duration | Triggered by |
---|---|---|---|---|---|---|---|
gitlab-org/gitlab | 1115058176 |
master |
Merge branch '280597-update-milestone-events-when-promoting' into 'master' | Update milestone events when promoting milestones | schedule |
141.62 minutes |
Failed jobs (11):
-
rspec-ee unit pg15 1/18 Job ID:
5798989535
(retry with@gitlab-bot retry_job 5798989535
) -
rspec-ee unit pg15 opensearch1 1/18 Job ID:
5798989452
(retry with@gitlab-bot retry_job 5798989452
) -
rspec-ee unit pg14 opensearch2 15/18 Job ID:
5798989404
(retry with@gitlab-bot retry_job 5798989404
) -
rspec unit pg15 23/28 Job ID:
5798989148
(retry with@gitlab-bot retry_job 5798989148
) -
rspec unit pg14-as-if-foss single-db 25/28 Job ID:
5798988450
(retry with@gitlab-bot retry_job 5798988450
) -
rspec unit pg14 single-redis 28/28 Job ID:
5798988003
(retry with@gitlab-bot retry_job 5798988003
) -
rspec unit pg14 single-redis 3/28 Job ID:
5798987961
(retry with@gitlab-bot retry_job 5798987961
) -
rspec unit pg14 15/24 Job ID:
5798987946
(retry with@gitlab-bot retry_job 5798987946
) -
rspec unit pg14 13/24 Job ID:
5798987944
(retry with@gitlab-bot retry_job 5798987944
) -
rspec unit pg14 9/24 Job ID:
5798987939
(retry with@gitlab-bot retry_job 5798987939
) -
rspec unit pg14 2/24 Job ID:
5798987926
(retry with@gitlab-bot retry_job 5798987926
)
General guidelines
Follow the Broken master
handbook guide.
Attribution
If RSpec tests failed, the group having most of the failing tests is assigned to the incident.
Please note that if the assigned group is wrong, the tests may be tagged with the wrong feature_category metadata. You can follow the guide to update it so future incidents will be labelled with the correct group.
Engineering Productivity will be added if no group label is identified.
-
groupacquisition Category:Measurement and Locking ./ee/spec/workers/namespaces/free_user_cap/group_over_limit_notification_worker_spec.rb[1:1:5:2:1]
-
groupacquisition Category:Measurement and Locking ./ee/spec/workers/namespaces/free_user_cap/group_over_limit_notification_worker_spec.rb[1:1:5:2:1]
-
groupthreat insights groupthreat insights ./ee/spec/serializers/sbom/sbom_entity_spec.rb[1:1]
-
groupthreat insights groupthreat insights ./ee/spec/serializers/sbom/sbom_entity_spec.rb[1:2]
-
groupthreat insights groupthreat insights ./ee/spec/serializers/sbom/sbom_entity_spec.rb[1:1]
-
groupthreat insights groupthreat insights ./ee/spec/serializers/sbom/sbom_entity_spec.rb[1:2]
-
groupanalytics instrumentation Category:Service Ping ./spec/scripts/internal_events/cli_spec.rb[1:2:10:2]
-
missing product_group_label ~"missing feature_category label" ./spec/models/lfs_download_object_spec.rb[1:1]
-
missing product_group_label ~"missing feature_category label" ./spec/models/lfs_download_object_spec.rb[1:5:1]
-
missing product_group_label ~"missing feature_category label" ./spec/models/lfs_download_object_spec.rb[1:5:1]
-
missing product_group_label ~"missing feature_category label" ./spec/models/lfs_download_object_spec.rb[1:1]
-
missing product_group_label ~"missing feature_category label" ./spec/models/packages/maven/metadatum_spec.rb[1:1]
-
missing product_group_label ~"missing feature_category label" ./spec/models/packages/maven/metadatum_spec.rb[1:3:1]
-
missing product_group_label ~"missing feature_category label" ./spec/models/packages/maven/metadatum_spec.rb[1:3:1]
-
missing product_group_label ~"missing feature_category label" ./spec/models/packages/maven/metadatum_spec.rb[1:1]
-
groupcode review Category:Code Review Workflow ./spec/services/draft_notes/publish_service_spec.rb[1:2:7:3]
Investigation
Please capture your investigation steps in the Investigation Steps
thread.
- If the failure is new, and looks like a potential flaky failure, you can retry the failing jobs with
@gitlab-bot retry_pipeline 1115058176
. - If the failure looks like a broken
master
, communicate the brokenmaster
in Slack using the "Broadcast Master Broken" workflow:
- Click the Shortcut lightning bolt icon in the
#master-broken
channel and select "Broadcast Master Broken". - Click "Continue the broadcast" after the automated message in
#master-broken
.
Root Cause Analysis
- It is important to categorize the incident by its root cause to identify corrective actions and to track data for furture references.
- Root cause labels can be found in the Broken
master
handbook guide. Search forPlease set the appropriate ~master-broken:* label from the list below
.
Pre-resolution
If you believe that there's an easy resolution by either:
- Reverting a particular merge request.
- Making a quick fix (for example, one line or a few similar simple changes in a few lines).
You can create a merge request, assign to any available maintainer, and ping people that were involved/related to the introduction of the failure.
Additionally, a message can be posted in
#backend_maintainers
or#frontend_maintainers
to get a maintainer take a look at the fix ASAP.
In both cases, make sure to add the pipeline:expedite label, and master:broken
or master:foss-broken
label, to speed up the master
-fixing pipelines.