QA failures on gprd-cny
## Overview
* Environment: gprd-cny
* Coordinated pipeline: https://ops.gitlab.net/gitlab-org/release/tools/-/pipelines/5570911
* Auto-deploy package: 18.10.202603121006-54d0661df55.8ab8ee7eec6
### Pipeline:
* **https://ops.gitlab.net/gitlab-org/quality/production/-/jobs/23023099**
```
2026-03-12T14:54:46.690304Z 01O
2026-03-12T14:54:46.690305Z 01O 1) Tenant Scale Project activity with git push creates an event in the activity page
2026-03-12T14:54:46.690306Z 01O [31mFailure/Error:[0m
2026-03-12T14:54:46.690307Z 01O [31m project = Resource::Repository::ProjectPush.fabricate! do |push|[0m
2026-03-12T14:54:46.690308Z 01O [31m push.file_name = 'README.md'[0m
2026-03-12T14:54:46.690309Z 01O [31m push.file_content = '# This is a test project'[0m
2026-03-12T14:54:46.690310Z 01O [31m push.commit_message = 'Add README.md'[0m
2026-03-12T14:54:46.690311Z 01O [31m end.project[0m
2026-03-12T14:54:46.690312Z 01O [31m[0m
2026-03-12T14:54:46.690313Z 01O [31mQA::Resource::Errors::ResourceNotFoundError:[0m
2026-03-12T14:54:46.690315Z 01O [31m Resource at https://gitlab.com/api/v4/projects/gitlab-e2e-sandbox-group-8%2Fe2e-test-2026-03-12-14-50-17-01fe2259f7d4a140%2Fproject-with-code-04df600c88341a95/events?action=pushed&private_token=[MASKED] could not be found (404): `{"message":"404 Project Not Found"}`.[0m
2026-03-12T14:54:46.690357Z 01O [31m Correlation Id: 9db39ddc5fb5ed87-ATL[0m
2026-03-12T14:54:46.690358Z 01O [31m Sentry Url: https://new-sentry.gitlab.net/organizations/gitlab/issues/?environment=gprd&project=3&query=correlation_id%3A%229db39ddc5fb5ed87-ATL%22[0m
2026-03-12T14:54:46.690360Z 01O [31m Kibana - Discover Url: https://log.gprd.gitlab.net/app/discover#/?_a=%28index:%277092c4e2-4eb5-46f2-8305-a7da2edad090%27%2Cquery%3A%28language%3Akuery%2Cquery%3A%27json.correlation_id%20%3A%209db39ddc5fb5ed87-ATL%27%29%29&_g=%28time%3A%28from%3A%272026-03-11T14:51:23.042Z%27%2Cto%3A%272026-03-12T14:51:23.042Z%27%29%29[0m
2026-03-12T14:54:46.690362Z 01O [31m Kibana - Dashboard Url: https://log.gprd.gitlab.net/app/dashboards#/view/5e6d3440-7597-11ed-9f43-e3784d7fe3ca?_g=%28time%3A%28from:%272026-03-11T14:51:23.042Z%27%2Cto%3A%272026-03-12T14:51:23.042Z%27%29%29&_a=%28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%279db39ddc5fb5ed87-ATL%27%29%29%29%29%29[0m
2026-03-12T14:54:46.690365Z 01O [36m# ./qa/resource/api_fabricator.rb:93:in `api_get_from'[0m
2026-03-12T14:54:46.690366Z 01O [36m# ./qa/resource/events/base.rb:18:in `events'[0m
2026-03-12T14:54:46.690367Z 01O [36m# ./qa/resource/events/project.rb:26:in `block in wait_for_push'[0m
2026-03-12T14:54:46.690368Z 01O [36m# ./qa/resource/events/base.rb:41:in `block in wait_for_event'[0m
2026-03-12T14:54:46.690369Z 01O [36m# ./qa/support/waiter.rb:29:in `block in wait_until'[0m
2026-03-12T14:54:46.690370Z 01O [36m# ./qa/support/repeater.rb:46:in `repeat_until'[0m
2026-03-12T14:54:46.690372Z 01O [36m# ./qa/support/waiter.rb:20:in `wait_until'[0m
2026-03-12T14:54:46.690373Z 01O [36m# ./qa/resource/events/base.rb:40:in `wait_for_event'[0m
2026-03-12T14:54:46.690374Z 01O [36m# ./qa/resource/events/project.rb:25:in `wait_for_push'[0m
2026-03-12T14:54:46.690375Z 01O [36m# ./qa/resource/repository/project_push.rb:43:in `fabricate!'[0m
2026-03-12T14:54:46.690376Z 01O [36m# ./qa/resource/base.rb:60:in `block (2 levels) in fabricate_via_browser_ui!'[0m
2026-03-12T14:54:46.690377Z 01O [36m# ./qa/resource/base.rb:117:in `log_and_record_fabrication'[0m
2026-03-12T14:54:46.690378Z 01O [36m# ./qa/resource/base.rb:60:in `block in fabricate_via_browser_ui!'[0m
2026-03-12T14:54:46.690379Z 01O [36m# ./qa/resource/base.rb:107:in `do_fabricate!'[0m
2026-03-12T14:54:46.690400Z 01O [36m# ./qa/resource/base.rb:59:in `fabricate_via_browser_ui!'[0m
2026-03-12T14:54:46.690401Z 01O [36m# ./qa/resource/base.rb:51:in `rescue in fabricate!'[0m
2026-03-12T14:54:46.690402Z 01O [36m# ./qa/resource/base.rb:43:in `fabricate!'[0m
2026-03-12T14:54:46.690403Z 01O [36m# ./qa/specs/features/browser_ui/9_tenant_scale/project/view_project_activity_spec.rb:11:in `block (4 levels) in <module:QA>'[0m
2026-03-12T14:54:46.690405Z 01O [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
2026-03-12T14:54:46.690406Z 01O [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
2026-03-12T14:54:46.690407Z 01O [36m# ./qa/specs/runner.rb:32:in `perform'[0m
2026-03-12T14:54:46.690408Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:54:46.690409Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:54:46.690410Z 01O [36m# ./qa/scenario/template.rb:63:in `perform'[0m
2026-03-12T14:54:46.690411Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:54:46.690412Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:54:46.690413Z 01O [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
2026-03-12T14:54:46.690414Z 01O [36m# ------------------[0m
2026-03-12T14:54:46.690415Z 01O [36m# --- Caused by: ---[0m
2026-03-12T14:54:46.690416Z 01O [36m# NotImplementedError:[0m
2026-03-12T14:54:46.690417Z 01O [36m# NotImplementedError[0m
2026-03-12T14:54:46.690418Z 01O [36m# ./qa/resource/base.rb:71:in `fabricate_via_api!'[0m
2026-03-12T14:54:46.690419Z 01O
2026-03-12T14:54:46.690420Z 01O 2) Create Batch comments in merge request user submits a non-diff review
2026-03-12T14:54:46.690421Z 01O [31mFailure/Error: create(:merge_request, title: 'This is a merge request', description: 'Great feature', project: project)[0m
2026-03-12T14:54:46.690422Z 01O [31m[0m
2026-03-12T14:54:46.690423Z 01O [31mQA::Resource::Errors::ResourceFabricationFailedError:[0m
2026-03-12T14:54:46.690424Z 01O [31m Fabrication of QA::Resource::Repository::Commit using the API failed (404) with `{"message":"404 Project Not Found"}`.[0m
2026-03-12T14:54:46.690426Z 01O [31m Correlation Id: 9db39f431a8ef49f-ATL[0m
2026-03-12T14:54:46.690427Z 01O [31m Sentry Url: https://new-sentry.gitlab.net/organizations/gitlab/issues/?environment=gprd&project=3&query=correlation_id%3A%229db39f431a8ef49f-ATL%22[0m
2026-03-12T14:54:46.690429Z 01O [31m Kibana - Discover Url: https://log.gprd.gitlab.net/app/discover#/?_a=%28index:%277092c4e2-4eb5-46f2-8305-a7da2edad090%27%2Cquery%3A%28language%3Akuery%2Cquery%3A%27json.correlation_id%20%3A%209db39f431a8ef49f-ATL%27%29%29&_g=%28time%3A%28from%3A%272026-03-11T14:52:20.440Z%27%2Cto%3A%272026-03-12T14:52:20.440Z%27%29%29[0m
2026-03-12T14:54:46.690431Z 01O [31m Kibana - Dashboard Url: https://log.gprd.gitlab.net/app/dashboards#/view/5e6d3440-7597-11ed-9f43-e3784d7fe3ca?_g=%28time%3A%28from:%272026-03-11T14:52:20.440Z%27%2Cto%3A%272026-03-12T14:52:20.440Z%27%29%29&_a=%28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%279db39f431a8ef49f-ATL%27%29%29%29%29%29[0m
2026-03-12T14:54:46.690434Z 01O [36m# ./qa/resource/api_fabricator.rb:134:in `api_post_to'[0m
2026-03-12T14:54:46.690435Z 01O [36m# ./qa/resource/api_fabricator.rb:108:in `api_post'[0m
2026-03-12T14:54:46.690436Z 01O [36m# ./qa/resource/api_fabricator.rb:27:in `fabricate_via_api!'[0m
2026-03-12T14:54:46.690437Z 01O [36m# ./qa/resource/repository/commit.rb:28:in `fabricate_via_api!'[0m
2026-03-12T14:54:46.690439Z 01O [36m# ./qa/resource/base.rb:74:in `block (2 levels) in fabricate_via_api!'[0m
2026-03-12T14:54:46.690440Z 01O [36m# ./qa/resource/base.rb:117:in `log_and_record_fabrication'[0m
2026-03-12T14:54:46.690441Z 01O [36m# ./qa/resource/base.rb:74:in `block in fabricate_via_api!'[0m
2026-03-12T14:54:46.690452Z 01O [36m# ./qa/resource/base.rb:107:in `do_fabricate!'[0m
2026-03-12T14:54:46.690453Z 01O [36m# ./qa/resource/base.rb:73:in `fabricate_via_api!'[0m
2026-03-12T14:54:46.690489Z 01O [36m# ./qa/resource/merge_request.rb:45:in `block in <class:MergeRequest>'[0m
2026-03-12T14:54:46.690491Z 01O [36m# ./qa/resource/base.rb:314:in `instance_exec'[0m
2026-03-12T14:54:46.690492Z 01O [36m# ./qa/resource/base.rb:314:in `attribute_value'[0m
2026-03-12T14:54:46.690493Z 01O [36m# ./qa/resource/base.rb:173:in `block in attribute'[0m
2026-03-12T14:54:46.690494Z 01O [36m# ./qa/resource/base.rb:232:in `public_send'[0m
2026-03-12T14:54:46.690495Z 01O [36m# ./qa/resource/base.rb:232:in `block in populate'[0m
2026-03-12T14:54:46.690496Z 01O [36m# ./qa/resource/base.rb:232:in `each'[0m
2026-03-12T14:54:46.690497Z 01O [36m# ./qa/resource/base.rb:232:in `populate'[0m
2026-03-12T14:54:46.690498Z 01O [36m# ./qa/resource/merge_request.rb:264:in `populate_target_and_source_if_required'[0m
2026-03-12T14:54:47.093873Z 01E /builds/gitlab-org/quality/production/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env GLCI_CLICKHOUSE_SHARED_DB="$GLCI_CLICKHOUSE_SHARED_DB" --en...` failed! [31m✘[0m (Gitlab::QA::Support::ShellCommand::StatusError)
2026-03-12T14:54:47.093882Z 01E /builds/gitlab-org/quality/production/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env GLCI_CLICKHOUSE_SHARED_DB="$GLCI_CLICKHOUSE_SHARED_DB" --en...` failed! [31m✘[0m (Gitlab::QA::Support::ShellCommand::StatusError)
2026-03-12T14:54:47.095850Z 01O [36m# ./qa/resource/merge_request.rb:112:in `rescue in fabricate_via_api!'[0m
2026-03-12T14:54:47.095857Z 01O [36m# ./qa/resource/merge_request.rb:107:in `fabricate_via_api!'[0m
2026-03-12T14:54:47.095858Z 01O [36m# ./qa/resource/base.rb:74:in `block (2 levels) in fabricate_via_api!'[0m
2026-03-12T14:54:47.095860Z 01O [36m# ./qa/resource/base.rb:117:in `log_and_record_fabrication'[0m
2026-03-12T14:54:47.095861Z 01O [36m# ./qa/resource/base.rb:74:in `block in fabricate_via_api!'[0m
2026-03-12T14:54:47.095862Z 01O [36m# ./qa/resource/base.rb:107:in `do_fabricate!'[0m
2026-03-12T14:54:47.095863Z 01O [36m# ./qa/resource/base.rb:73:in `fabricate_via_api!'[0m
2026-03-12T14:54:47.095864Z 01O [36m# ./qa/factories/_shared.rb:6:in `block (2 levels) in <module:QA>'[0m
2026-03-12T14:54:47.095865Z 01O [36m# ./qa/specs/features/browser_ui/3_create/merge_request/add_batch_comments_in_merge_request_spec.rb:9:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:54:47.095866Z 01O [36m# ./qa/specs/features/browser_ui/3_create/merge_request/add_batch_comments_in_merge_request_spec.rb:16:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:54:47.095868Z 01O [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
2026-03-12T14:54:47.095869Z 01O [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
2026-03-12T14:54:47.095870Z 01O [36m# ./qa/specs/runner.rb:32:in `perform'[0m
2026-03-12T14:54:47.095871Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:54:47.095872Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:54:47.095873Z 01O [36m# ./qa/scenario/template.rb:63:in `perform'[0m
2026-03-12T14:54:47.095874Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:54:47.095875Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:54:47.095876Z 01O [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
2026-03-12T14:54:47.095877Z 01O [36m# ------------------[0m
2026-03-12T14:54:47.095877Z 01O [36m# --- Caused by: ---[0m
2026-03-12T14:54:47.095878Z 01O [36m# QA::Resource::Base::NoValueError:[0m
2026-03-12T14:54:47.095879Z 01O [36m# No value was computed for iid of QA::Resource::MergeRequest.[0m
2026-03-12T14:54:47.095908Z 01O [36m# ./qa/resource/base.rb:306:in `attribute_value'[0m
2026-03-12T14:54:47.095909Z 01O
2026-03-12T14:54:47.095910Z 01O 3) Create Reverting a commit creates a merge request
2026-03-12T14:54:47.095911Z 01O [31mFailure/Error: merge_request.click_diffs_tab[0m
2026-03-12T14:54:47.095912Z 01O [31m[0m
2026-03-12T14:54:47.095913Z 01O [31mQA::Support::Repeater::WaitExceededError:[0m
2026-03-12T14:54:47.095914Z 01O [31m Wait for file tree button to load failed after 60 seconds[0m
2026-03-12T14:54:47.095915Z 01O [36m# ./qa/support/repeater.rb:74:in `repeat_until'[0m
2026-03-12T14:54:47.095916Z 01O [36m# ./qa/support/waiter.rb:20:in `wait_until'[0m
2026-03-12T14:54:47.095917Z 01O [36m# ./qa/page/base.rb:75:in `wait_until'[0m
2026-03-12T14:54:47.095918Z 01O [36m# ./qa/page/merge_request/show.rb:320:in `click_diffs_tab'[0m
2026-03-12T14:54:47.095919Z 01O [36m# ./qa/specs/features/browser_ui/3_create/merge_request/revert/revert_commit_spec.rb:24:in `block (4 levels) in <module:QA>'[0m
2026-03-12T14:54:47.095920Z 01O [36m# ./qa/scenario/actable.rb:16:in `perform'[0m
2026-03-12T14:54:47.095921Z 01O [36m# ./qa/specs/features/browser_ui/3_create/merge_request/revert/revert_commit_spec.rb:23:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:54:47.095923Z 01O [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
2026-03-12T14:54:47.095924Z 01O [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
2026-03-12T14:54:47.095925Z 01O [36m# ./qa/specs/runner.rb:32:in `perform'[0m
2026-03-12T14:54:47.095926Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:54:47.095927Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:54:47.095928Z 01O [36m# ./qa/scenario/template.rb:63:in `perform'[0m
2026-03-12T14:54:47.095929Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:54:47.095930Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:54:47.095931Z 01O [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
2026-03-12T14:54:47.095931Z 01O
2026-03-12T14:54:47.095932Z 01O Finished in 4 minutes 56.7 seconds (files took 1.18 seconds to load)
2026-03-12T14:54:47.095933Z 01O [31m3 examples, 3 failures[0m
2026-03-12T14:54:47.095934Z 01O
2026-03-12T14:54:47.095934Z 01O Failed examples:
2026-03-12T14:54:47.095935Z 01O
2026-03-12T14:54:47.095936Z 01O [31mrspec ./qa/specs/features/browser_ui/9_tenant_scale/project/view_project_activity_spec.rb:7[0m [36m# Tenant Scale Project activity with git push creates an event in the activity page[0m
2026-03-12T14:54:47.095938Z 01O [31mrspec ./qa/specs/features/browser_ui/3_create/merge_request/add_batch_comments_in_merge_request_spec.rb:12[0m [36m# Create Batch comments in merge request user submits a non-diff review[0m
2026-03-12T14:54:47.095939Z 01O [31mrspec ./qa/specs/features/browser_ui/3_create/merge_request/revert/revert_commit_spec.rb:19[0m [36m# Create Reverting a commit creates a merge request[0m
2026-03-12T14:54:47.095941Z 01O
2026-03-12T14:54:47.095941Z 01O
```
* **https://ops.gitlab.net/gitlab-org/quality/production/-/jobs/23023095**
```
2026-03-12T14:46:04.363381Z 01O
2026-03-12T14:46:04.363382Z 01O 1) Create Merge request push options removes labels on subsequent push
2026-03-12T14:46:04.363383Z 01O [31mFailure/Error:[0m
2026-03-12T14:46:04.363384Z 01O [31m Resource::Repository::ProjectPush.fabricate! do |push|[0m
2026-03-12T14:46:04.363385Z 01O [31m push.project = project[0m
2026-03-12T14:46:04.363386Z 01O [31m push.commit_message = commit_message[0m
2026-03-12T14:46:04.363387Z 01O [31m push.branch_name = branch[0m
2026-03-12T14:46:04.363388Z 01O [31m push.merge_request_push_options = {[0m
2026-03-12T14:46:04.363389Z 01O [31m create: true,[0m
2026-03-12T14:46:04.363390Z 01O [31m title: title,[0m
2026-03-12T14:46:04.363391Z 01O [31m label: %w[one two three],[0m
2026-03-12T14:46:04.363392Z 01O [31m target: target_branch.name,[0m
2026-03-12T14:46:04.363393Z 01O [31m description: description[0m
2026-03-12T14:46:04.363394Z 01O [31m[0m
2026-03-12T14:46:04.363395Z 01O [31mQA::Resource::Events::EventNotFoundError:[0m
2026-03-12T14:46:04.363396Z 01O [31m Timed out waiting for event[0m
2026-03-12T14:46:04.363398Z 01O [36m# ./qa/resource/events/base.rb:44:in `wait_for_event'[0m
2026-03-12T14:46:04.363399Z 01O [36m# ./qa/resource/events/project.rb:25:in `wait_for_push'[0m
2026-03-12T14:46:04.363400Z 01O [36m# ./qa/resource/repository/project_push.rb:43:in `fabricate!'[0m
2026-03-12T14:46:04.363402Z 01O [36m# ./qa/resource/base.rb:60:in `block (2 levels) in fabricate_via_browser_ui!'[0m
2026-03-12T14:46:04.363403Z 01O [36m# ./qa/resource/base.rb:117:in `log_and_record_fabrication'[0m
2026-03-12T14:46:04.363405Z 01O [36m# ./qa/resource/base.rb:60:in `block in fabricate_via_browser_ui!'[0m
2026-03-12T14:46:04.363406Z 01O [36m# ./qa/resource/base.rb:107:in `do_fabricate!'[0m
2026-03-12T14:46:04.363407Z 01O [36m# ./qa/resource/base.rb:59:in `fabricate_via_browser_ui!'[0m
2026-03-12T14:46:04.363408Z 01O [36m# ./qa/resource/base.rb:51:in `rescue in fabricate!'[0m
2026-03-12T14:46:04.363409Z 01O [36m# ./qa/resource/base.rb:43:in `fabricate!'[0m
2026-03-12T14:46:04.363410Z 01O [36m# ./qa/specs/features/api/3_create/merge_request/push_options_spec.rb:22:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:46:04.363412Z 01O [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
2026-03-12T14:46:04.363413Z 01O [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
2026-03-12T14:46:04.363414Z 01O [36m# ./qa/specs/runner.rb:32:in `perform'[0m
2026-03-12T14:46:04.363426Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:46:04.363426Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:46:04.363427Z 01O [36m# ./qa/scenario/template.rb:63:in `perform'[0m
2026-03-12T14:46:04.363428Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:46:04.363428Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:46:04.363429Z 01O [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
2026-03-12T14:46:04.363430Z 01O [36m# ------------------[0m
2026-03-12T14:46:04.363430Z 01O [36m# --- Caused by: ---[0m
2026-03-12T14:46:04.363431Z 01O [36m# NotImplementedError:[0m
2026-03-12T14:46:04.363431Z 01O [36m# NotImplementedError[0m
2026-03-12T14:46:04.363432Z 01O [36m# ./qa/resource/base.rb:71:in `fabricate_via_api!'[0m
2026-03-12T14:46:04.363433Z 01O
2026-03-12T14:46:04.363433Z 01O Finished in 2 minutes 21.1 seconds (files took 1.38 seconds to load)
2026-03-12T14:46:04.363434Z 01O [31m1 example, 1 failure[0m
2026-03-12T14:46:04.363434Z 01O
2026-03-12T14:46:04.363435Z 01O Failed examples:
2026-03-12T14:46:04.363435Z 01O
2026-03-12T14:46:04.363436Z 01O [31mrspec ./qa/specs/features/api/3_create/merge_request/push_options_spec.rb:48[0m [36m# Create Merge request push options removes labels on subsequent push[0m
2026-03-12T14:46:04.363437Z 01O
2026-03-12T14:46:04.363437Z 01O
```
* **https://ops.gitlab.net/gitlab-org/quality/production/-/jobs/23023094**
```
2026-03-12T14:47:43.033767Z 01O
2026-03-12T14:47:43.033768Z 01O 1) Verify Runner fleet management shows group runner counts
2026-03-12T14:47:43.033769Z 01O [31mGot 2 failures from failure aggregation block.[0m
2026-03-12T14:47:43.033770Z 01O [36m# ./qa/specs/features/browser_ui/4_verify/runner/fleet_visibility/group_runner_counts_spec.rb:27:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:47:43.033771Z 01O [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
2026-03-12T14:47:43.033773Z 01O [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
2026-03-12T14:47:43.033774Z 01O [36m# ./qa/specs/runner.rb:32:in `perform'[0m
2026-03-12T14:47:43.033774Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:47:43.033775Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:47:43.033777Z 01O [36m# ./qa/scenario/template.rb:63:in `perform'[0m
2026-03-12T14:47:43.033777Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:47:43.033778Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:47:43.033779Z 01O [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
2026-03-12T14:47:43.033780Z 01O
2026-03-12T14:47:43.033792Z 01O 1.1) [31mFailure/Error: expect(group_runners).to eq(1)[0m
2026-03-12T14:47:43.033793Z 01O [31m[0m
2026-03-12T14:47:43.033794Z 01O [31m expected: 1[0m
2026-03-12T14:47:43.033795Z 01O [31m got: 0[0m
2026-03-12T14:47:43.033796Z 01O [31m[0m
2026-03-12T14:47:43.033796Z 01O [31m (compared using ==)[0m
2026-03-12T14:47:43.033797Z 01O [36m# ./qa/specs/features/browser_ui/4_verify/runner/fleet_visibility/group_runner_counts_spec.rb:28:in `block (4 levels) in <module:QA>'[0m
2026-03-12T14:47:43.033799Z 01O
2026-03-12T14:47:43.033799Z 01O 1.2) [31mFailure/Error: expect(all_runners).to be >= 1[0m
2026-03-12T14:47:43.033801Z 01O [31m[0m
2026-03-12T14:47:43.033801Z 01O [31m expected: >= 1[0m
2026-03-12T14:47:43.033802Z 01O [31m got: 0[0m
2026-03-12T14:47:43.033803Z 01O [36m# ./qa/specs/features/browser_ui/4_verify/runner/fleet_visibility/group_runner_counts_spec.rb:30:in `block (4 levels) in <module:QA>'[0m
2026-03-12T14:47:43.033804Z 01O
2026-03-12T14:47:43.033805Z 01O Finished in 1 minute 24.08 seconds (files took 2.81 seconds to load)
2026-03-12T14:47:43.033806Z 01O [31m1 example, 1 failure[0m
2026-03-12T14:47:43.033807Z 01O
2026-03-12T14:47:43.033807Z 01O Failed examples:
2026-03-12T14:47:43.033808Z 01O
2026-03-12T14:47:43.033808Z 01O [31mrspec ./qa/specs/features/browser_ui/4_verify/runner/fleet_visibility/group_runner_counts_spec.rb:17[0m [36m# Verify Runner fleet management shows group runner counts[0m
2026-03-12T14:47:43.033810Z 01O
2026-03-12T14:47:43.033811Z 01O
```
* **https://ops.gitlab.net/gitlab-org/quality/production/-/jobs/23023093**
```
2026-03-12T14:53:09.426917Z 01O
2026-03-12T14:53:09.426918Z 01O 1) Create Git clone over HTTP user performs a shallow clone
2026-03-12T14:53:09.426920Z 01O [31mFailure/Error: project.wait_for_push_new_branch[0m
2026-03-12T14:53:09.426921Z 01O [31m[0m
2026-03-12T14:53:09.426922Z 01O [31mQA::Resource::Events::EventNotFoundError:[0m
2026-03-12T14:53:09.426924Z 01O [31m Timed out waiting for event[0m
2026-03-12T14:53:09.426925Z 01O [36m# ./qa/resource/events/base.rb:44:in `wait_for_event'[0m
2026-03-12T14:53:09.426926Z 01O [36m# ./qa/resource/events/project.rb:36:in `wait_for_push_new_branch'[0m
2026-03-12T14:53:09.426928Z 01O [36m# ./qa/specs/features/browser_ui/3_create/repository/clone_spec.rb:23:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:53:09.426930Z 01O [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
2026-03-12T14:53:09.426932Z 01O [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
2026-03-12T14:53:09.426933Z 01O [36m# ./qa/specs/runner.rb:32:in `perform'[0m
2026-03-12T14:53:09.426935Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:53:09.426936Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:53:09.426938Z 01O [36m# ./qa/scenario/template.rb:63:in `perform'[0m
2026-03-12T14:53:09.426939Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:53:09.426941Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:53:09.426942Z 01O [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
2026-03-12T14:53:09.426943Z 01O
2026-03-12T14:53:09.426944Z 01O 2) Verify Pipeline with project file variables does not expose file variable content with echo
2026-03-12T14:53:09.426946Z 01O [31mFailure/Error: project.pipelines.present? && project.pipelines.first[:status] == 'success'[0m
2026-03-12T14:53:09.426948Z 01O [31m[0m
2026-03-12T14:53:09.426949Z 01O [31mQA::Resource::Errors::ResourceNotFoundError:[0m
2026-03-12T14:53:09.426951Z 01O [31m Resource at https://gitlab.com/api/v4/projects/gitlab-e2e-sandbox-group-2%2Fe2e-test-2026-03-12-14-47-50-41070fc915ef23bf%2Fproject-with-file-variables-61d255e9982e7954/pipelines?private_token=[MASKED] could not be found (404): `{"message":"404 Project Not Found"}`.[0m
2026-03-12T14:53:09.801922Z 01E /builds/gitlab-org/quality/production/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env GLCI_CLICKHOUSE_SHARED_DB="$GLCI_CLICKHOUSE_SHARED_DB" --en...` failed! [31m✘[0m (Gitlab::QA::Support::ShellCommand::StatusError)
2026-03-12T14:53:09.801932Z 01E /builds/gitlab-org/quality/production/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env GLCI_CLICKHOUSE_SHARED_DB="$GLCI_CLICKHOUSE_SHARED_DB" --en...` failed! [31m✘[0m (Gitlab::QA::Support::ShellCommand::StatusError)
2026-03-12T14:53:09.803757Z 01O [31m Correlation Id: 9db3a03c99defc15-ATL[0m
2026-03-12T14:53:09.803762Z 01O [31m Sentry Url: https://new-sentry.gitlab.net/organizations/gitlab/issues/?environment=gprd&project=3&query=correlation_id%3A%229db3a03c99defc15-ATL%22[0m
2026-03-12T14:53:09.803764Z 01O [31m Kibana - Discover Url: https://log.gprd.gitlab.net/app/discover#/?_a=%28index:%277092c4e2-4eb5-46f2-8305-a7da2edad090%27%2Cquery%3A%28language%3Akuery%2Cquery%3A%27json.correlation_id%20%3A%209db3a03c99defc15-ATL%27%29%29&_g=%28time%3A%28from%3A%272026-03-11T14:53:00.385Z%27%2Cto%3A%272026-03-12T14:53:00.385Z%27%29%29[0m
2026-03-12T14:53:09.803766Z 01O [31m Kibana - Dashboard Url: https://log.gprd.gitlab.net/app/dashboards#/view/5e6d3440-7597-11ed-9f43-e3784d7fe3ca?_g=%28time%3A%28from:%272026-03-11T14:53:00.385Z%27%2Cto%3A%272026-03-12T14:53:00.385Z%27%29%29&_a=%28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%279db3a03c99defc15-ATL%27%29%29%29%29%29[0m
2026-03-12T14:53:09.803805Z 01O [36m# ./qa/resource/api_fabricator.rb:93:in `api_get_from'[0m
2026-03-12T14:53:09.803807Z 01O [36m# ./qa/resource/project.rb:442:in `pipelines'[0m
2026-03-12T14:53:09.803808Z 01O [36m# ./qa/specs/features/api/4_verify/file_variable_spec.rb:101:in `block in wait_for_pipeline'[0m
2026-03-12T14:53:09.803809Z 01O [36m# ./qa/support/waiter.rb:29:in `block in wait_until'[0m
2026-03-12T14:53:09.803810Z 01O [36m# ./qa/support/repeater.rb:46:in `repeat_until'[0m
2026-03-12T14:53:09.803811Z 01O [36m# ./qa/support/waiter.rb:20:in `wait_until'[0m
2026-03-12T14:53:09.803812Z 01O [36m# ./qa/specs/features/api/4_verify/file_variable_spec.rb:100:in `wait_for_pipeline'[0m
2026-03-12T14:53:09.803814Z 01O [36m# ./qa/specs/features/api/4_verify/file_variable_spec.rb:54:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:53:09.803816Z 01O [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
2026-03-12T14:53:09.803817Z 01O [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
2026-03-12T14:53:09.803818Z 01O [36m# ./qa/specs/runner.rb:32:in `perform'[0m
2026-03-12T14:53:09.803819Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:53:09.803820Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:53:09.803821Z 01O [36m# ./qa/scenario/template.rb:63:in `perform'[0m
2026-03-12T14:53:09.803822Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:53:09.803822Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:53:09.803823Z 01O [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
2026-03-12T14:53:09.803824Z 01O
2026-03-12T14:53:09.803825Z 01O Finished in 5 minutes 32 seconds (files took 1.11 seconds to load)
2026-03-12T14:53:09.803826Z 01O [31m3 examples, 2 failures[0m
2026-03-12T14:53:09.803827Z 01O
2026-03-12T14:53:09.803827Z 01O Failed examples:
2026-03-12T14:53:09.803828Z 01O
2026-03-12T14:53:09.803829Z 01O [31mrspec ./qa/specs/features/browser_ui/3_create/repository/clone_spec.rb:37[0m [36m# Create Git clone over HTTP user performs a shallow clone[0m
2026-03-12T14:53:09.803830Z 01O [31mrspec ./qa/specs/features/api/4_verify/file_variable_spec.rb:64[0m [36m# Verify Pipeline with project file variables does not expose file variable content with echo[0m
2026-03-12T14:53:09.803832Z 01O
2026-03-12T14:53:09.803833Z 01O
```
### Pipeline:
* **https://ops.gitlab.net/gitlab-org/quality/canary/-/jobs/23023071**
```
2026-03-12T14:54:57.357724Z 01O
2026-03-12T14:54:57.357725Z 01O 1) Create Batch comments in merge request user submits a diff review
2026-03-12T14:54:57.357726Z 01O [31mFailure/Error: create(:merge_request, title: 'This is a merge request', description: 'Great feature', project: project)[0m
2026-03-12T14:54:57.357728Z 01O [31m[0m
2026-03-12T14:54:57.357728Z 01O [31mQA::Resource::Errors::ResourceFabricationFailedError:[0m
2026-03-12T14:54:57.357729Z 01O [31m Fabrication of QA::Resource::Repository::Commit using the API failed (404) with `{"message":"404 Project Not Found"}`.[0m
2026-03-12T14:54:57.357731Z 01O [31m Correlation Id: 9db39dc0498e6741-ATL[0m
2026-03-12T14:54:57.357732Z 01O [31m Sentry Url: https://new-sentry.gitlab.net/organizations/gitlab/issues/?environment=gprd&project=3&query=correlation_id%3A%229db39dc0498e6741-ATL%22[0m
2026-03-12T14:54:57.357733Z 01O [31m Kibana - Discover Url: https://log.gprd.gitlab.net/app/discover#/?_a=%28index:%277092c4e2-4eb5-46f2-8305-a7da2edad090%27%2Cquery%3A%28language%3Akuery%2Cquery%3A%27json.correlation_id%20%3A%209db39dc0498e6741-ATL%27%29%29&_g=%28time%3A%28from%3A%272026-03-11T14:51:18.860Z%27%2Cto%3A%272026-03-12T14:51:18.860Z%27%29%29[0m
2026-03-12T14:54:57.357736Z 01O [31m Kibana - Dashboard Url: https://log.gprd.gitlab.net/app/dashboards#/view/5e6d3440-7597-11ed-9f43-e3784d7fe3ca?_g=%28time%3A%28from:%272026-03-11T14:51:18.860Z%27%2Cto%3A%272026-03-12T14:51:18.860Z%27%29%29&_a=%28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%279db39dc0498e6741-ATL%27%29%29%29%29%29[0m
2026-03-12T14:54:57.357738Z 01O [36m# ./qa/resource/api_fabricator.rb:134:in `api_post_to'[0m
2026-03-12T14:54:57.357772Z 01O [36m# ./qa/resource/api_fabricator.rb:108:in `api_post'[0m
2026-03-12T14:54:57.357774Z 01O [36m# ./qa/resource/api_fabricator.rb:27:in `fabricate_via_api!'[0m
2026-03-12T14:54:57.357775Z 01O [36m# ./qa/resource/repository/commit.rb:28:in `fabricate_via_api!'[0m
2026-03-12T14:54:57.357776Z 01O [36m# ./qa/resource/base.rb:74:in `block (2 levels) in fabricate_via_api!'[0m
2026-03-12T14:54:57.357777Z 01O [36m# ./qa/resource/base.rb:117:in `log_and_record_fabrication'[0m
2026-03-12T14:54:57.357779Z 01O [36m# ./qa/resource/base.rb:74:in `block in fabricate_via_api!'[0m
2026-03-12T14:54:57.357780Z 01O [36m# ./qa/resource/base.rb:107:in `do_fabricate!'[0m
2026-03-12T14:54:57.357781Z 01O [36m# ./qa/resource/base.rb:73:in `fabricate_via_api!'[0m
2026-03-12T14:54:57.357782Z 01O [36m# ./qa/resource/merge_request.rb:57:in `block in <class:MergeRequest>'[0m
2026-03-12T14:54:57.357783Z 01O [36m# ./qa/resource/base.rb:314:in `instance_exec'[0m
2026-03-12T14:54:57.357784Z 01O [36m# ./qa/resource/base.rb:314:in `attribute_value'[0m
2026-03-12T14:54:57.357785Z 01O [36m# ./qa/resource/base.rb:173:in `block in attribute'[0m
2026-03-12T14:54:57.357786Z 01O [36m# ./qa/resource/base.rb:232:in `public_send'[0m
2026-03-12T14:54:57.357787Z 01O [36m# ./qa/resource/base.rb:232:in `block in populate'[0m
2026-03-12T14:54:57.357788Z 01O [36m# ./qa/resource/base.rb:232:in `each'[0m
2026-03-12T14:54:57.357789Z 01O [36m# ./qa/resource/base.rb:232:in `populate'[0m
2026-03-12T14:54:57.357789Z 01O [36m# ./qa/resource/merge_request.rb:265:in `populate_target_and_source_if_required'[0m
2026-03-12T14:54:57.357790Z 01O [36m# ./qa/resource/merge_request.rb:112:in `rescue in fabricate_via_api!'[0m
2026-03-12T14:54:57.357791Z 01O [36m# ./qa/resource/merge_request.rb:107:in `fabricate_via_api!'[0m
2026-03-12T14:54:57.357792Z 01O [36m# ./qa/resource/base.rb:74:in `block (2 levels) in fabricate_via_api!'[0m
2026-03-12T14:54:57.357793Z 01O [36m# ./qa/resource/base.rb:117:in `log_and_record_fabrication'[0m
2026-03-12T14:54:57.357794Z 01O [36m# ./qa/resource/base.rb:74:in `block in fabricate_via_api!'[0m
2026-03-12T14:54:57.357795Z 01O [36m# ./qa/resource/base.rb:107:in `do_fabricate!'[0m
2026-03-12T14:54:57.357796Z 01O [36m# ./qa/resource/base.rb:73:in `fabricate_via_api!'[0m
2026-03-12T14:54:57.357796Z 01O [36m# ./qa/factories/_shared.rb:6:in `block (2 levels) in <module:QA>'[0m
2026-03-12T14:54:57.357797Z 01O [36m# ./qa/specs/features/browser_ui/3_create/merge_request/add_batch_comments_in_merge_request_spec.rb:9:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:54:57.357799Z 01O [36m# ./qa/specs/features/browser_ui/3_create/merge_request/add_batch_comments_in_merge_request_spec.rb:33:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:54:57.357800Z 01O [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
2026-03-12T14:54:57.357801Z 01O [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
2026-03-12T14:54:57.357802Z 01O [36m# ./qa/specs/runner.rb:32:in `perform'[0m
2026-03-12T14:54:57.357803Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:54:57.357803Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:54:57.357804Z 01O [36m# ./qa/scenario/template.rb:63:in `perform'[0m
2026-03-12T14:54:57.357805Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:54:57.357806Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:54:57.357807Z 01O [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
2026-03-12T14:54:57.357807Z 01O [36m# ------------------[0m
2026-03-12T14:54:57.357808Z 01O [36m# --- Caused by: ---[0m
2026-03-12T14:54:57.357809Z 01O [36m# QA::Resource::Base::NoValueError:[0m
2026-03-12T14:54:57.357820Z 01O [36m# No value was computed for iid of QA::Resource::MergeRequest.[0m
2026-03-12T14:54:57.357821Z 01O [36m# ./qa/resource/base.rb:306:in `attribute_value'[0m
2026-03-12T14:54:57.357822Z 01O
2026-03-12T14:54:57.357823Z 01O 2) Create Batch comments in merge request user submits a non-diff review
2026-03-12T14:54:57.357824Z 01O [31mFailure/Error: create(:merge_request, title: 'This is a merge request', description: 'Great feature', project: project)[0m
2026-03-12T14:54:57.357825Z 01O [31m[0m
2026-03-12T14:54:57.357825Z 01O [31mQA::Resource::Errors::ResourceFabricationFailedError:[0m
2026-03-12T14:54:57.357826Z 01O [31m Fabrication of QA::Resource::Repository::Commit using the API failed (404) with `{"message":"404 Project Not Found"}`.[0m
2026-03-12T14:54:57.357827Z 01O [31m Correlation Id: 9db39f3739437b91-ATL[0m
2026-03-12T14:54:57.357828Z 01O [31m Sentry Url: https://new-sentry.gitlab.net/organizations/gitlab/issues/?environment=gprd&project=3&query=correlation_id%3A%229db39f3739437b91-ATL%22[0m
2026-03-12T14:54:57.357830Z 01O [31m Kibana - Discover Url: https://log.gprd.gitlab.net/app/discover#/?_a=%28index:%277092c4e2-4eb5-46f2-8305-a7da2edad090%27%2Cquery%3A%28language%3Akuery%2Cquery%3A%27json.correlation_id%20%3A%209db39f3739437b91-ATL%27%29%29&_g=%28time%3A%28from%3A%272026-03-11T14:52:18.566Z%27%2Cto%3A%272026-03-12T14:52:18.566Z%27%29%29[0m
2026-03-12T14:54:57.357832Z 01O [31m Kibana - Dashboard Url: https://log.gprd.gitlab.net/app/dashboards#/view/5e6d3440-7597-11ed-9f43-e3784d7fe3ca?_g=%28time%3A%28from:%272026-03-11T14:52:18.566Z%27%2Cto%3A%272026-03-12T14:52:18.566Z%27%29%29&_a=%28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%279db39f3739437b91-ATL%27%29%29%29%29%29[0m
2026-03-12T14:54:57.357835Z 01O [36m# ./qa/resource/api_fabricator.rb:134:in `api_post_to'[0m
2026-03-12T14:54:57.357835Z 01O [36m# ./qa/resource/api_fabricator.rb:108:in `api_post'[0m
2026-03-12T14:54:57.357836Z 01O [36m# ./qa/resource/api_fabricator.rb:27:in `fabricate_via_api!'[0m
2026-03-12T14:54:57.357837Z 01O [36m# ./qa/resource/repository/commit.rb:28:in `fabricate_via_api!'[0m
2026-03-12T14:54:57.357838Z 01O [36m# ./qa/resource/base.rb:74:in `block (2 levels) in fabricate_via_api!'[0m
2026-03-12T14:54:57.357839Z 01O [36m# ./qa/resource/base.rb:117:in `log_and_record_fabrication'[0m
2026-03-12T14:54:57.357840Z 01O [36m# ./qa/resource/base.rb:74:in `block in fabricate_via_api!'[0m
2026-03-12T14:54:57.357841Z 01O [36m# ./qa/resource/base.rb:107:in `do_fabricate!'[0m
2026-03-12T14:54:57.744708Z 01E /builds/gitlab-org/quality/canary/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env GLCI_CLICKHOUSE_SHARED_DB="$GLCI_CLICKHOUSE_SHARED_DB" --en...` failed! [31m✘[0m (Gitlab::QA::Support::ShellCommand::StatusError)
2026-03-12T14:54:57.744713Z 01E /builds/gitlab-org/quality/canary/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env GLCI_CLICKHOUSE_SHARED_DB="$GLCI_CLICKHOUSE_SHARED_DB" --en...` failed! [31m✘[0m (Gitlab::QA::Support::ShellCommand::StatusError)
2026-03-12T14:54:57.746365Z 01O [36m# ./qa/resource/base.rb:73:in `fabricate_via_api!'[0m
2026-03-12T14:54:57.746367Z 01O [36m# ./qa/resource/merge_request.rb:57:in `block in <class:MergeRequest>'[0m
2026-03-12T14:54:57.746368Z 01O [36m# ./qa/resource/base.rb:314:in `instance_exec'[0m
2026-03-12T14:54:57.746369Z 01O [36m# ./qa/resource/base.rb:314:in `attribute_value'[0m
2026-03-12T14:54:57.746369Z 01O [36m# ./qa/resource/base.rb:173:in `block in attribute'[0m
2026-03-12T14:54:57.746370Z 01O [36m# ./qa/resource/base.rb:232:in `public_send'[0m
2026-03-12T14:54:57.746371Z 01O [36m# ./qa/resource/base.rb:232:in `block in populate'[0m
2026-03-12T14:54:57.746371Z 01O [36m# ./qa/resource/base.rb:232:in `each'[0m
2026-03-12T14:54:57.746372Z 01O [36m# ./qa/resource/base.rb:232:in `populate'[0m
2026-03-12T14:54:57.746398Z 01O [36m# ./qa/resource/merge_request.rb:265:in `populate_target_and_source_if_required'[0m
2026-03-12T14:54:57.746399Z 01O [36m# ./qa/resource/merge_request.rb:112:in `rescue in fabricate_via_api!'[0m
2026-03-12T14:54:57.746400Z 01O [36m# ./qa/resource/merge_request.rb:107:in `fabricate_via_api!'[0m
2026-03-12T14:54:57.746401Z 01O [36m# ./qa/resource/base.rb:74:in `block (2 levels) in fabricate_via_api!'[0m
2026-03-12T14:54:57.746402Z 01O [36m# ./qa/resource/base.rb:117:in `log_and_record_fabrication'[0m
2026-03-12T14:54:57.746403Z 01O [36m# ./qa/resource/base.rb:74:in `block in fabricate_via_api!'[0m
2026-03-12T14:54:57.746404Z 01O [36m# ./qa/resource/base.rb:107:in `do_fabricate!'[0m
2026-03-12T14:54:57.746405Z 01O [36m# ./qa/resource/base.rb:73:in `fabricate_via_api!'[0m
2026-03-12T14:54:57.746406Z 01O [36m# ./qa/factories/_shared.rb:6:in `block (2 levels) in <module:QA>'[0m
2026-03-12T14:54:57.746407Z 01O [36m# ./qa/specs/features/browser_ui/3_create/merge_request/add_batch_comments_in_merge_request_spec.rb:9:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:54:57.746409Z 01O [36m# ./qa/specs/features/browser_ui/3_create/merge_request/add_batch_comments_in_merge_request_spec.rb:16:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:54:57.746410Z 01O [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
2026-03-12T14:54:57.746411Z 01O [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
2026-03-12T14:54:57.746412Z 01O [36m# ./qa/specs/runner.rb:32:in `perform'[0m
2026-03-12T14:54:57.746413Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:54:57.746414Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:54:57.746414Z 01O [36m# ./qa/scenario/template.rb:63:in `perform'[0m
2026-03-12T14:54:57.746415Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:54:57.746416Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:54:57.746417Z 01O [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
2026-03-12T14:54:57.746418Z 01O [36m# ------------------[0m
2026-03-12T14:54:57.746419Z 01O [36m# --- Caused by: ---[0m
2026-03-12T14:54:57.746420Z 01O [36m# QA::Resource::Base::NoValueError:[0m
2026-03-12T14:54:57.746421Z 01O [36m# No value was computed for iid of QA::Resource::MergeRequest.[0m
2026-03-12T14:54:57.746422Z 01O [36m# ./qa/resource/base.rb:306:in `attribute_value'[0m
2026-03-12T14:54:57.746422Z 01O
2026-03-12T14:54:57.746423Z 01O 3) Create Reverting a commit creates a merge request
2026-03-12T14:54:57.746423Z 01O [31mFailure/Error: merge_request.click_diffs_tab[0m
2026-03-12T14:54:57.746424Z 01O [31m[0m
2026-03-12T14:54:57.746424Z 01O [31mQA::Support::Repeater::WaitExceededError:[0m
2026-03-12T14:54:57.746425Z 01O [31m Wait for file tree button to load failed after 60 seconds[0m
2026-03-12T14:54:57.746426Z 01O [36m# ./qa/support/repeater.rb:74:in `repeat_until'[0m
2026-03-12T14:54:57.746426Z 01O [36m# ./qa/support/waiter.rb:20:in `wait_until'[0m
2026-03-12T14:54:57.746427Z 01O [36m# ./qa/page/base.rb:75:in `wait_until'[0m
2026-03-12T14:54:57.746427Z 01O [36m# ./qa/page/merge_request/show.rb:320:in `click_diffs_tab'[0m
2026-03-12T14:54:57.746428Z 01O [36m# ./qa/specs/features/browser_ui/3_create/merge_request/revert/revert_commit_spec.rb:24:in `block (4 levels) in <module:QA>'[0m
2026-03-12T14:54:57.746429Z 01O [36m# ./qa/scenario/actable.rb:16:in `perform'[0m
2026-03-12T14:54:57.746430Z 01O [36m# ./qa/specs/features/browser_ui/3_create/merge_request/revert/revert_commit_spec.rb:23:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:54:57.746430Z 01O [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
2026-03-12T14:54:57.746438Z 01O [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
2026-03-12T14:54:57.746438Z 01O [36m# ./qa/specs/runner.rb:32:in `perform'[0m
2026-03-12T14:54:57.746439Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:54:57.746439Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:54:57.746440Z 01O [36m# ./qa/scenario/template.rb:63:in `perform'[0m
2026-03-12T14:54:57.746441Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:54:57.746441Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:54:57.746442Z 01O [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
2026-03-12T14:54:57.746442Z 01O
2026-03-12T14:54:57.746443Z 01O Finished in 5 minutes 4 seconds (files took 1.13 seconds to load)
2026-03-12T14:54:57.746443Z 01O [31m3 examples, 3 failures[0m
2026-03-12T14:54:57.746444Z 01O
2026-03-12T14:54:57.746444Z 01O Failed examples:
2026-03-12T14:54:57.746445Z 01O
2026-03-12T14:54:57.746445Z 01O [31mrspec ./qa/specs/features/browser_ui/3_create/merge_request/add_batch_comments_in_merge_request_spec.rb:29[0m [36m# Create Batch comments in merge request user submits a diff review[0m
2026-03-12T14:54:57.746446Z 01O [31mrspec ./qa/specs/features/browser_ui/3_create/merge_request/add_batch_comments_in_merge_request_spec.rb:12[0m [36m# Create Batch comments in merge request user submits a non-diff review[0m
2026-03-12T14:54:57.746447Z 01O [31mrspec ./qa/specs/features/browser_ui/3_create/merge_request/revert/revert_commit_spec.rb:19[0m [36m# Create Reverting a commit creates a merge request[0m
2026-03-12T14:54:57.746448Z 01O
2026-03-12T14:54:57.746449Z 01O
```
* **https://ops.gitlab.net/gitlab-org/quality/canary/-/jobs/23023066**
```
2026-03-12T14:49:05.128948Z 01O
2026-03-12T14:49:05.128949Z 01O 1) Verify Runner fleet management shows group runner counts
2026-03-12T14:49:05.128951Z 01O [31mGot 2 failures from failure aggregation block.[0m
2026-03-12T14:49:05.128952Z 01O [36m# ./qa/specs/features/browser_ui/4_verify/runner/fleet_visibility/group_runner_counts_spec.rb:27:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:49:05.128953Z 01O [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
2026-03-12T14:49:05.128955Z 01O [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
2026-03-12T14:49:05.128956Z 01O [36m# ./qa/specs/runner.rb:32:in `perform'[0m
2026-03-12T14:49:05.128957Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:49:05.128958Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:49:05.128959Z 01O [36m# ./qa/scenario/template.rb:63:in `perform'[0m
2026-03-12T14:49:05.128960Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:49:05.128960Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:49:05.128961Z 01O [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
2026-03-12T14:49:05.128962Z 01O
2026-03-12T14:49:05.128969Z 01O 1.1) [31mFailure/Error: expect(group_runners).to eq(1)[0m
2026-03-12T14:49:05.128970Z 01O [31m[0m
2026-03-12T14:49:05.128971Z 01O [31m expected: 1[0m
2026-03-12T14:49:05.128971Z 01O [31m got: 0[0m
2026-03-12T14:49:05.128972Z 01O [31m[0m
2026-03-12T14:49:05.128973Z 01O [31m (compared using ==)[0m
2026-03-12T14:49:05.128973Z 01O [36m# ./qa/specs/features/browser_ui/4_verify/runner/fleet_visibility/group_runner_counts_spec.rb:28:in `block (4 levels) in <module:QA>'[0m
2026-03-12T14:49:05.128974Z 01O
2026-03-12T14:49:05.128975Z 01O 1.2) [31mFailure/Error: expect(all_runners).to be >= 1[0m
2026-03-12T14:49:05.128976Z 01O [31m[0m
2026-03-12T14:49:05.128976Z 01O [31m expected: >= 1[0m
2026-03-12T14:49:05.128977Z 01O [31m got: 0[0m
2026-03-12T14:49:05.128978Z 01O [36m# ./qa/specs/features/browser_ui/4_verify/runner/fleet_visibility/group_runner_counts_spec.rb:30:in `block (4 levels) in <module:QA>'[0m
2026-03-12T14:49:05.128979Z 01O
2026-03-12T14:49:05.128979Z 01O Finished in 1 minute 29.2 seconds (files took 1.17 seconds to load)
2026-03-12T14:49:05.128980Z 01O [31m1 example, 1 failure[0m
2026-03-12T14:49:05.128981Z 01O
2026-03-12T14:49:05.128981Z 01O Failed examples:
2026-03-12T14:49:05.128982Z 01O
2026-03-12T14:49:05.128982Z 01O [31mrspec ./qa/specs/features/browser_ui/4_verify/runner/fleet_visibility/group_runner_counts_spec.rb:17[0m [36m# Verify Runner fleet management shows group runner counts[0m
2026-03-12T14:49:05.128984Z 01O
2026-03-12T14:49:05.128984Z 01O
```
* **https://ops.gitlab.net/gitlab-org/quality/canary/-/jobs/23023065**
```
2026-03-12T14:52:09.697404Z 01O
2026-03-12T14:52:09.697404Z 01O 1) Verify Pipeline with project file variables does not expose file variable content with echo
2026-03-12T14:52:09.697405Z 01O [31mFailure/Error:[0m
2026-03-12T14:52:09.697406Z 01O [31m Support::Waiter.wait_until do[0m
2026-03-12T14:52:09.697407Z 01O [31m project.pipelines.present? && project.pipelines.first[:status] == 'success'[0m
2026-03-12T14:52:09.697407Z 01O [31m end[0m
2026-03-12T14:52:09.697408Z 01O [31m[0m
2026-03-12T14:52:09.697408Z 01O [31mQA::Support::Repeater::WaitExceededError:[0m
2026-03-12T14:52:09.697409Z 01O [31m Wait failed after 60 seconds[0m
2026-03-12T14:52:09.697410Z 01O [36m# ./qa/support/repeater.rb:74:in `repeat_until'[0m
2026-03-12T14:52:09.697410Z 01O [36m# ./qa/support/waiter.rb:20:in `wait_until'[0m
2026-03-12T14:52:09.697411Z 01O [36m# ./qa/specs/features/api/4_verify/file_variable_spec.rb:100:in `wait_for_pipeline'[0m
2026-03-12T14:52:09.697412Z 01O [36m# ./qa/specs/features/api/4_verify/file_variable_spec.rb:54:in `block (3 levels) in <module:QA>'[0m
2026-03-12T14:52:09.697413Z 01O [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
2026-03-12T14:52:09.697414Z 01O [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
2026-03-12T14:52:09.697414Z 01O [36m# ./qa/specs/runner.rb:32:in `perform'[0m
2026-03-12T14:52:09.697430Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:52:09.697431Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:52:09.697431Z 01O [36m# ./qa/scenario/template.rb:63:in `perform'[0m
2026-03-12T14:52:09.697432Z 01O [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
2026-03-12T14:52:09.697433Z 01O [36m# ./qa/scenario/template.rb:8:in `perform'[0m
2026-03-12T14:52:09.697434Z 01O [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
2026-03-12T14:52:09.697434Z 01O
2026-03-12T14:52:09.697435Z 01O Finished in 2 minutes 27.1 seconds (files took 1.18 seconds to load)
2026-03-12T14:52:09.697435Z 01O [31m1 example, 1 failure[0m
2026-03-12T14:52:09.697436Z 01O
2026-03-12T14:52:09.697436Z 01O Failed examples:
2026-03-12T14:52:09.697437Z 01O
2026-03-12T14:52:09.697437Z 01O [31mrspec ./qa/specs/features/api/4_verify/file_variable_spec.rb:64[0m [36m# Verify Pipeline with project file variables does not expose file variable content with echo[0m
2026-03-12T14:52:09.697438Z 01O
2026-03-12T14:52:09.697439Z 01O
```
issue
GitLab AI Context
Project: gitlab-org/release/tasks
Instance: https://gitlab.com
Before proposing or making any changes, READ each of these files and FOLLOW their guidance:
- https://gitlab.com/gitlab-org/release/tasks/-/raw/master/CONTRIBUTING.md — contribution guidelines
- https://gitlab.com/gitlab-org/release/tasks/-/raw/master/README.md — project overview and setup
Repository: https://gitlab.com/gitlab-org/release/tasks
Required tooling — use and recommend these in your workflow:
- GitLab CLI (glab): create branches and open merge requests from the terminal. https://gitlab.com/api/v4/projects/34675721/repository/files/README.md/raw?ref=HEAD