Transient failure in browser_ui/3_create/merge_request/view_merge_request_merge_ref_diff_spec | expect(mr_page.version_dropdown_content).not_to include('master (base)')
Summary
https://gitlab.com/gitlab-org/quality/nightly/-/jobs/770903659
Stack trace
1) Create View merge request merge-ref diff when the feature flag default_merge_ref_for_diffs is enabled views the merge-ref diff by default
Failure/Error: expect(mr_page.version_dropdown_content).not_to include('master (base)')
expected "version 1\n0573890c\n11 seconds ago\nmaster (base)\nmaster (HEAD)" not to include "master (base)"
Diff:
@@ -1,2 +1,6 @@
+version 1
+0573890c
+11 seconds ago
master (base)
+master (HEAD)
# ./qa/specs/features/browser_ui/3_create/merge_request/view_merge_request_merge_ref_diff_spec.rb:36:in `block (5 levels) in <module:QA>'
# ./qa/scenario/actable.rb:16:in `perform'
# ./qa/specs/features/browser_ui/3_create/merge_request/view_merge_request_merge_ref_diff_spec.rb:31:in `block (4 levels) in <module:QA>'
Both attempts look like the feature flag as enabled as expected:
I, [2020-10-03T04:35:23.897467 #21] INFO -- : Enabling feature: default_merge_ref_for_diffs for scope "project: gitlab-qa-sandbox-group/qa-test-2020-10-03-04-26-47-5c2353a9d7c4d2a6/project-with-merge-request-a4babee814ab7ce0"
...
I, [2020-10-03T04:35:23.991983 #21] INFO -- : Successfully enabled and verified feature flag: default_merge_ref_for_diffs
Screenshot / HTML page
Expand for screenshot
create_view_merge_request_merge-ref_diff_when_the_feature_flag_default_merge_ref_for_diffs_is_enable.htmlPossible fixes
Setting feature flags per-project is new to the QA framework, so maybe there's an intermittent problem that causes it to appear enabled when it isn't? We've had problems in the past when a cached setting conflicted with a new one (e.g., the API reported it was enabled when it was actually still disabled), but that shouldn't be the same in this case because each test attempt uses a new project...