Skip to content

Transient failure in qa/specs/features/api/3_create/repository/project_archive_compare_spec.rb

Summary

The test fails after signing in as gitlab-qa-user2, and sometimes after signing in as gitlab-qa-user1.

I don't know how far back the failures go.

The same thing also happens in qa/specs/features/ee/browser_ui/3_create/merge_request/approval_rules_spec.rb.

This is not likely to be related to the 500 errors that were happening on Canary/Prod. Those involved user gitlab-qa, affected almost every test, and they were consistent. This seems to affect only a few tests (2 so far), only seem to involve gitlab-qa-user1 and gitlab-qa-user2, and the failures are intermittent.

Stack trace

   1) Create Compare archives of different user projects with the same name and check they're different download archives of each user project then check they are different
      Failure/Error: user_info[:api_client].personal_access_token
      
      QA::Page::Validatable::PageValidationError:
        navbar did not appear on QA::Page::Main::Menu as expected
      # ./qa/page/validatable.rb:15:in `block in validate_elements_present!'
      # ./qa/page/validatable.rb:11:in `each'
      # ./qa/page/validatable.rb:11:in `validate_elements_present!'
      # ./qa/page/base.rb:120:in `click_element'
      # ./qa/support/page/logging.rb:81:in `click_element'
      # ./qa/page/main/login.rb:166:in `sign_in_using_gitlab_credentials'
      # ./qa/page/main/login.rb:61:in `block in sign_in_using_credentials'
      # /usr/local/bundle/gems/capybara-3.29.0/lib/capybara/session.rb:782:in `block in using_wait_time'
      # /usr/local/bundle/gems/capybara-3.29.0/lib/capybara.rb:300:in `using_wait_time'
      # /usr/local/bundle/gems/capybara-3.29.0/lib/capybara/session.rb:782:in `using_wait_time'
      # /usr/local/bundle/gems/capybara-3.29.0/lib/capybara/dsl.rb:28:in `using_wait_time'
      # ./qa/page/main/login.rb:53:in `sign_in_using_credentials'
      # ./qa/flow/login.rb:26:in `block in sign_in'
      # ./qa/scenario/actable.rb:16:in `perform'
      # ./qa/flow/login.rb:26:in `sign_in'
      # ./qa/flow/login.rb:34:in `sign_in_unless_signed_in'
      # ./qa/runtime/api/client.rb:70:in `create_personal_access_token'
      # ./qa/runtime/api/client.rb:24:in `personal_access_token'
      # ./qa/specs/features/api/3_create/repository/project_archive_compare_spec.rb:22:in `block (4 levels) in <module:QA>'
      # ./qa/specs/features/api/3_create/repository/project_archive_compare_spec.rb:19:in `each'
      # ./qa/specs/features/api/3_create/repository/project_archive_compare_spec.rb:19:in `block (3 levels) in <module:QA>'

The logs suggest that it got past the sign in screen (was able to click the sign in button), but then failed to validate the next page (because it showed error 500 instead of the expected UI).

D, [2020-01-23T16:54:05.369802 #22] DEBUG -- : filling :login_field with "gitlab-qa-user2"
D, [2020-01-23T16:54:05.369827 #22] DEBUG -- : finding :login_field with args {}
D, [2020-01-23T16:54:05.369860 #22] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 0.1; raise_on_failure: false 
D, [2020-01-23T16:54:05.381030 #22] DEBUG -- : ended wait_until
D, [2020-01-23T16:54:05.400734 #22] DEBUG -- : found :login_field
D, [2020-01-23T16:54:05.483757 #22] DEBUG -- : filling :password_field with "*****"
D, [2020-01-23T16:54:05.483839 #22] DEBUG -- : finding :password_field with args {}
D, [2020-01-23T16:54:05.483879 #22] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 0.1; raise_on_failure: false 
D, [2020-01-23T16:54:05.495848 #22] DEBUG -- : ended wait_until
D, [2020-01-23T16:54:05.515813 #22] DEBUG -- : found :password_field
D, [2020-01-23T16:54:05.685665 #22] DEBUG -- : clicking :sign_in_button , expecting to be at Class with args {}
D, [2020-01-23T16:54:05.685784 #22] DEBUG -- : finding :sign_in_button with args {:text=>nil, :wait=>0}
D, [2020-01-23T16:54:05.685844 #22] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 0.1; raise_on_failure: false 
D, [2020-01-23T16:54:05.699379 #22] DEBUG -- : ended wait_until
D, [2020-01-23T16:54:05.720994 #22] DEBUG -- : found :sign_in_button
D, [2020-01-23T16:54:07.357266 #22] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 0.1; raise_on_failure: false 
D, [2020-01-23T16:54:07.367267 #22] DEBUG -- : ended wait_until
D, [2020-01-23T16:55:07.382629 #22] DEBUG -- : has_element? :navbar (wait: 60) returned: false

Screenshot / HTML page

Screenshot just shows error 500

Edited by Mark Lapierre