Dequarantine E2E Tests
Follow up to #1545 (closed)
Currently we have 44 quarantined tests with average age of 159 days - we need to bring both of those numbers down.
Part of FY24 Q1 QE Specific KRs.
| Spec | Issue | Reason | Status | Assignee |
|---|---|---|---|---|
| browser_ui/1_manage/login/maintain_log_in_mixed_env_spec.rb | gitlab-org/gitlab#344213 (closed) | Stale | ||
| gitlab-org/gitlab#378697 (closed) | Investigating | Flaky test, already addressed with other snippet tests in gitlab-org/gitlab!102240 (merged) Dequarantine MR in gitlab-org/gitlab!116175 (merged) |
@a_mcdonald | |
| browser_ui/3_create/pages/new_static_page_spec.rb | gitlab-org/gitlab#383215 | Test Environment | ||
| gitlab-org/gitlab#387033 (closed) | Stale | Dequarantined MR: gitlab-org/gitlab!113161 (merged) |
@a_mcdonald | |
| gitlab-org/gitlab#387032 (closed) | Stale | Dequarantined MR: gitlab-org/gitlab!113161 (merged) |
@a_mcdonald | |
| gitlab-org/gitlab#387043 (closed) | Stale | Dequarantined MR: gitlab-org/gitlab!113161 (merged) |
@a_mcdonald | |
| gitlab-org/gitlab#387031 (closed) | Stale | Dequarantined MR: gitlab-org/gitlab!113161 (merged) |
@a_mcdonald | |
| gitlab-org/gitlab#387035 (closed) | Stale | Dequarantined MR: gitlab-org/gitlab!113161 (merged) |
@a_mcdonald | |
| gitlab-org/gitlab#387029 (closed) | Stale | Dequarantined MR: gitlab-org/gitlab!113161 (merged) |
@a_mcdonald | |
| gitlab-org/gitlab#387723 (closed) | Stale | Dequarantined MR: gitlab-org/gitlab!113161 (merged) |
@a_mcdonald | |
| gitlab-org/gitlab#387928 (closed) | Stale | Dequarantined MR: gitlab-org/gitlab!113773 (merged) |
@a_mcdonald | |
| gitlab-org/gitlab#338179 (closed) | Bug | Deleted MR: gitlab-org/gitlab!112093 (merged) |
@a_mcdonald | |
| gitlab-org/gitlab#352525 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!113047 (merged) |
@a_mcdonald | |
| ee/browser_ui/3_create/repository/pull_mirroring_over_ssh_with_key_spec.rb | gitlab-com/gl-infra/production#6621 (closed) | Test Environment | ||
| gitlab-org/gitlab#364565 (closed) | Bug | The bug got fixed but the test got broken while in quarantine. Fix and dequarantine MR: gitlab-org/gitlab!116227 (merged) |
@a_mcdonald | |
| gitlab-org/gitlab#364742 (closed) | Investigating | Dequarantine MR: gitlab-org/gitlab!116336 (merged) | @a_mcdonald | |
| gitlab-org/gitlab#364742 (closed) | Investigating | Dequarantine MR: gitlab-org/gitlab!116336 (merged) | @a_mcdonald | |
| gitlab-org/gitlab#372258 (closed) | Bug / Test | Added additional deletes to clean up groups after tests Dequarantine MR | @jay_mccure | |
| ee/browser_ui/4_verify/system_cancel_merge_request_in_merge_train_spec.rb | gitlab-org/gitlab#324122 (closed) | Bug | Dequarantine is blocked by gitlab-org/gitlab#324122 (closed) and have asked to counterpart to schedule for upcoming milestones. | @richard.chong |
| gitlab-org/gitlab#379747 (closed) | Test Environment | Dequarantine MR: gitlab-org/gitlab!110431 (merged) | @richard.chong | |
| gitlab-org/gitlab#385353 (closed) | Test Environment | Dequarantine MR: gitlab-org/gitlab!115747 (merged) | @richard.chong | |
| browser_ui/5_package/package_registry/maven/maven_project_level_spec.rb | gitlab-org/gitlab#378221 (closed) | Investigating | @svistas | |
| browser_ui/5_package/package_registry/conan_repository_spec.rb | gitlab-org/gitlab#335981 (closed) | Bug | Format is not being worked on | |
| ee/browser_ui/9_data_stores/elasticsearch/elasticsearch_reindexing_spec.rb | gitlab-org/gitlab#385927 (closed) | Stale | @bwilkerson13 | |
| ee/browser_ui/10_govern/instance/instance_audit_logs_spec.rb | gitlab-org/gitlab#373794 (closed) | Flaky | @hmuralidhar | |
| gitlab-org/gitlab#386434 (closed) | Bug | @hmuralidhar | ||
| gitlab-org/gitlab#377442 (closed) | FE changes | Updated MR: gitlab-org/gitlab!109315 (merged) |
@ebralitis | |
| gitlab-org/gitlab#374550 (closed) | Test environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#374550 (closed) | Test Environment | Dequarantined MR: gitlab-org/gitlab!111009 (merged) |
@nwestbury |
|
| gitlab-org/gitlab#386308 (closed) | Bug | Dequarantined MR: gitlab-org/gitlab!111917 (merged) |
@acunskis |
|
| Tests dequarantined in this effort: 36 |
Quarantined status by reason
| Quarantined reason | Count as 2023-01-23 | Count as of 2023-03-07 | Count as of 2023-03-31 | Count as of end of Q1 (2023-05-01) |
|---|---|---|---|---|
| Stale | 10 | 2 | 2 | 2 |
| Investigating | 6 | 6 | 3 | 2 (1 investigating + 1 flaky) |
| Test Environment | 20 | 2 | 2 | 2 |
| Bug | 6 | 5 | 4 | 2 |
| FF change | 1 | 0 | 0 | 0 |
| Total | 44 | 19 | 11 | 8 |
Edited by Vincy Wilson