Multiple timeout failures on end to end tests
Summary
The following tests are failing with 60 second timeout errors: ./qa/specs/features/browser_ui/3_create/merge_request/create_merge_request_spec.rb ./qa/specs/features/browser_ui/3_create/merge_request/merge_merge_request_from_fork_spec.rb ./qa/specs/features/browser_ui/7_configure/auto_devops/create_project_with_auto_devops_spec.rb ./qa/specs/features/browser_ui/3_create/merge_request/create_merge_request_spec.rb ./qa/specs/features/browser_ui/3_create/merge_request/create_merge_request_spec.rb ./qa/specs/features/browser_ui/3_create/merge_request/merge_merge_request_from_fork_spec.rb ./qa/specs/features/ee/browser_ui/6_release/pipelines_for_merged_results_and_merge_trains_spec.rb
As happened in these jobs:
- https://ops.gitlab.net/gitlab-org/quality/staging/-/jobs/1383841
- https://ops.gitlab.net/gitlab-org/quality/staging/-/jobs/1383862
- https://ops.gitlab.net/gitlab-org/quality/preprod/-/jobs/1382734
The discussion in the qa-preprod channel indicated it was likely due to a sidekiq issue (https://gitlab.slack.com/archives/CR7QH0RV1/p1593715719023800?thread_ts=1593712153.022600&cid=CR7QH0RV1)
I then asked about it in infrastructure-lounge and was told to group the issues together in a single ticket (https://gitlab.slack.com/archives/CB3LSMEJV/p1593737279128100?thread_ts=1593734524.127900&cid=CB3LSMEJV)
Tried to reproduce the issue locally and could not.
Stack trace
Failure/Error:
merge_request = Resource::MergeRequestFromFork.fabricate_via_browser_ui! do |merge_request|
merge_request.fork_branch = 'feature-branch'
end
QA::Support::Repeater::WaitExceededError:
Wait condition not met after 60 seconds
# ./qa/support/repeater.rb:44:in `repeat_until'
# ./qa/support/waiter.rb:23:in `wait_until'
# ./qa/page/base.rb:48:in `wait_until'
# ./qa/page/project/show.rb:135:in `new_merge_request'
# ./qa/scenario/actable.rb:16:in `perform'
# ./qa/resource/merge_request_from_fork.rb:28:in `fabricate!'
# ./qa/resource/base.rb:30:in `block (2 levels) in fabricate_via_browser_ui!'
# ./qa/resource/base.rb:135:in `log_fabrication'
# ./qa/resource/base.rb:30:in `block in fabricate_via_browser_ui!'
# ./qa/resource/base.rb:118:in `do_fabricate!'
# ./qa/resource/base.rb:29:in `fabricate_via_browser_ui!'
# ./qa/specs/features/browser_ui/3_create/merge_request/merge_merge_request_from_fork_spec.rb:9:in `block (3 levels) in <module:QA>'
# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:123:in `block in run'
# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `loop'
# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `run'
# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec_ext/rspec_ext.rb:12:in `run_with_retry'
# ./spec/spec_helper.rb:69:in `block (2 levels) in <top (required)>'
# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:123:in `block in run'
# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `loop'
# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `run'
# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec_ext/rspec_ext.rb:12:in `run_with_retry'
# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:37:in `block (2 levels) in setup'
# ./qa/specs/runner.rb:71:in `perform'
# ./qa/scenario/template.rb:10:in `block in perform'
# ./qa/scenario/template.rb:8:in `tap'
# ./qa/scenario/template.rb:8:in `perform'
# ./qa/scenario/template.rb:33:in `perform'
# ./qa/scenario/template.rb:10:in `block in perform'
# ./qa/scenario/template.rb:8:in `tap'
# ./qa/scenario/template.rb:8:in `perform'
# ./qa/scenario/bootable.rb:28:in `launch!'