Flaky test: `Restored gitlab instance Should have at least 1 runner registered`
Summary
I'm noticing multiple failures of a specific test that are always fixed on retry.
Example: https://gitlab.com/gitlab-org/charts/gitlab/-/jobs/6174862357
Failures:
1) Restoring a backup Restored gitlab instance Should have at least 1 runner registered
Failure/Error: expect(response.collect { |item| item["status"] }).to have_content('online', minimum: 1)
expected to find text "online" at least 1 time but found 0 times in "[]"
# ./spec/features/backups_spec.rb:79:in `block (3 levels) in <top (required)>'
# ./gems/ruby/3.1.0/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:123:in `block in run'
# ./gems/ruby/3.1.0/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `loop'
# ./gems/ruby/3.1.0/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `run'
# ./gems/ruby/3.1.0/gems/rspec-retry-0.6.1/lib/rspec_ext/rspec_ext.rb:12:in `run_with_retry'
# ./gems/ruby/3.1.0/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:37:in `block (2 levels) in setup'
Acceptance criteria
-
Test is quarantined until it is reliable