Use tags to determine E2E test grouping
Problem
The gitlab_quality-test_tooling
currently uses the file path to determine which grouping a spec shows up under in the test session issue. This doesn't work for CustomersDot as the determination between Self-Managed and SaaS specs isn't based on the folder structure.
Proposal
In general, the tags should be used instead to determine the grouping as RSpec tags are used in both projects. Fixing this problem so that it works for both GitLab and CustomersDot projects will require multiple steps to ensure existing implementation are unaffected by the change.
-
Update the gem to look at the tag if no stage
is found. This will allow CustomersDot specs to be grouped while GitLab specs will be unaffected. ( gitlab-org/ruby/gems/gitlab_quality-test_tooling!84 (merged)) -
Update the Gemfile to use this new update to the gem. ( https://gitlab.com/gitlab-org/customers-gitlab-com/-/merge_requests/8589#bf13f78ba5f53cc9c7debde6edf108df1da7887e) -
Update the gem again to completely stop using the file path to determine stage
and use the RSpec tags instead. This will be the risky change as it will affect existing implementation and will need to be tested thoroughly.
These 2 separate updates (step 1 and 3) will allow CustomersDot to start being grouped properly sooner with step 1 and allow more time to implement and test out the riskier change in step 3.
Edited by Richard Chong