Multiple failures in staging due to a quarantined 2FA test

Job: https://ops.gitlab.net/gitlab-org/quality/staging/-/jobs/668976

rspec ./qa/specs/features/ee/browser_ui/1_manage/project/project_templates_spec.rb:157 # manage Project templates group level successfully imports the project using template
rspec './qa/specs/features/ee/browser_ui/1_manage/group/group_audit_logs_2_spec.rb[1:1:5:1:1]' # Manage Group audit logs Change project creation level behaves like group audit event logs logs audit events
rspec './qa/specs/features/ee/browser_ui/1_manage/group/group_audit_logs_2_spec.rb[1:1:2:1:1]' # Manage Group audit logs Enable and disable LFS behaves like group audit event logs logs audit events
rspec './qa/specs/features/ee/browser_ui/1_manage/group/group_audit_logs_2_spec.rb[1:1:3:1:1]' # Manage Group audit logs Enable and disable allow user request access behaves like group audit event logs logs audit events
rspec './qa/specs/features/ee/browser_ui/1_manage/project/project_audit_logs_spec.rb[1:1:1:1:1]' # Manage Project audit logs Add project behaves like project audit event logs logs audit events for UI operations
rspec './qa/specs/features/ee/browser_ui/1_manage/project/project_audit_logs_spec.rb[1:1:2:1:1]' # Manage Project audit logs Add user access as guest behaves like project audit event logs logs audit events for UI operations
rspec './qa/specs/features/ee/browser_ui/1_manage/project/project_audit_logs_spec.rb[1:1:3:1:1]' # Manage Project audit logs Add deploy key behaves like project audit event logs logs audit events for UI operations
rspec './qa/specs/features/ee/browser_ui/1_manage/project/project_audit_logs_spec.rb[1:1:4:1:1]' # Manage Project audit logs Change visibility behaves like project audit event logs logs audit events for UI operations
rspec './qa/specs/features/ee/browser_ui/1_manage/project/project_audit_logs_spec.rb[1:1:5:1:1]' # Manage Project audit logs Export file download behaves like project audit event logs logs audit events for UI operations
rspec './qa/specs/features/ee/browser_ui/1_manage/project/project_audit_logs_spec.rb[1:1:6:1:1]' # Manage Project audit logs Project archive and unarchive behaves like project audit event logs logs audit events for UI operations
rspec ./qa/specs/features/ee/browser_ui/1_manage/group/restrict_by_ip_address_spec.rb:33 # Manage Group access when restricted by another ip address denies access
rspec ./qa/specs/features/ee/browser_ui/1_manage/group/restrict_by_ip_address_spec.rb:61 # Manage Group access when restricted by user's ip address allows access
rspec './qa/specs/features/ee/browser_ui/1_manage/group/group_audit_logs_1_spec.rb[1:1:1:1:1]' # Manage Group audit logs Add group behaves like group audit event logs logs audit events
rspec './qa/specs/features/ee/browser_ui/1_manage/group/group_audit_logs_1_spec.rb[1:1:2:1:1]' # Manage Group audit logs Change repository size limit behaves like group audit event logs logs audit events
rspec './qa/specs/features/ee/browser_ui/1_manage/group/group_audit_logs_1_spec.rb[1:1:3:1:1]' # Manage Group audit logs Update group name behaves like group audit event logs logs audit events
rspec './qa/specs/features/ee/browser_ui/1_manage/group/group_audit_logs_1_spec.rb[1:1:4:1:1]' # Manage Group audit logs Add user, change access level, remove user behaves like group audit event logs logs audit events
rspec './qa/specs/features/ee/browser_ui/1_manage/group/group_audit_logs_1_spec.rb[1:1:5:1:1]' # Manage Group audit logs Add and remove project access behaves like group audit event logs logs audit events

group_audit_logs_2_spec.rb_2019-10-10-04-11-33.883

This is caused due to qa/specs/features/ee/browser_ui/1_manage/group/group_audit_logs_2_spec.rb:67 (Enable and disable 2FA requirement) test. Even though it was running in quarantine, it makes the user gitlab-qa create a group and enable 2FA on it causing 2FA requirement for that user to be enabled globally.

A fix for now is to skip that test since it is not needed to be run due to a bug.

Edited Oct 11, 2019 by Sanad Liaquat
Assignee Loading
Time tracking Loading