Skip to content

Draft: E2E: Run All Tests For Specific Groups

Valerie Burton requested to merge e2e-run-all-specs-for-specific-groups into master

What does this MR do and why?

This MR updates our selective test execution strategy to automatically run the full QA suite for certain product groups which have features that have far-reaching impact across multiple areas of the application. groupfoundations has been added to start due to their ongoing work involving site-wide navigation and settings. Issues have slipped through in the past on groupfoundations MRs because tests that aren't related to the devopsmanage stage get skipped.

One example to note is changes from Migrate groups' template setting away from select2 (!108807 - merged) caused Failure in browser_ui/3_create/repository/group... (#389181 - closed), which required an E2E test in the devopscreate stage to be updated to account for the new group template dropdown, but this test never ran for that MR.

This is not an ideal solution, and there have been similar discussions in the past with Do we have cross stage E2E coverage? (gitlab-org/quality/quality-engineering/team-tasks#1484), but this serves as a workaround with the current strategy we have to help provide extra coverage for cases like this.

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Valerie Burton

Merge request reports