Adding rule to run smoke and reliable tests in omnibus MR pipelines depending on the trigger job
What does this MR do and why?
Adds rules to pass smoke and reliable tags, to certain tests which run entire suite, for omnibus MR pipelines.
The MR pipelines in omnibus-project
are currently running all the tests which isn't required as all this testing would had been done upstream. We need to only run smoke and reliable test for omnibus MR pipeline.
Also adding a new env var QA_RUN_SMOKE_AND_RELIABLE_TESTS_FOR_OMNIBUS_MR
which is being passed in the omnibus qa-test
job which decides if the job wants to run only smoke and reliable test or run tests excluding smoke and reliable test. The idea is to have two jobs in omnibus pipeline
- One automatic job runs only smoke and reliable tests for
instance
,praefect
,decomposition-single-db
anddecomposition-multiple-db
jobs. - Another manual job which runs tests other than smoke and reliable for
instance
,praefect
,decomposition-single-db
anddecomposition-multiple-db
test jobs, so that this job doesn't overlap tests which already have ran in the previous automated job.
Tested this by creating an MR pipeline
- automated
qa-test
job https://gitlab.com/gitlab-org/omnibus-gitlab/-/pipelines/966448283 -> has smoke and reliable tags enabled forinstance
,praefect
,decomposition-single-db
anddecomposition-multiple-db
- manual trigger
manual-qa-full-suite
job https://gitlab.com/gitlab-org/omnibus-gitlab/-/pipelines/966451101 -> has test other than smoke and reliable forinstance
,praefect
,decomposition-single-db
anddecomposition-multiple-db
Issue linked gitlab-org/quality/quality-engineering/team-tasks#1935 (closed)
Screenshots or screen recordings
Screenshots are required for UI changes, and strongly recommended for all other merge requests.
Before | After |
---|---|
How to set up and validate locally
Numbered steps to set up and validate the change are strongly suggested.
MR acceptance checklist
This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.
-
I have evaluated the MR acceptance checklist for this MR.