Skip to content

E2E: Skip after_script and test result artifacts for quarantine job

Sanad Liaquat requested to merge tti-shl-skip-creating-json-and-xml-test-artifacts into master

What does this MR do and why?

We are now running the _quarantine job for e2e tests on master pipelines for the purpose of collecting metrics. However, it is expected to fail and so we do not want its results to be used in generate-test-session job in the report stage. We also do not want the failures in this job to be reported on Slack.

This MR:

  1. Overrides the default after_script that performs all the post processing of results and setting of SUITE_FAILED which is used to report failure via Slack.
  2. Removes CREATE_TEST_FAILURE_ISSUES which was used in after_script.
  3. Skips creating test results artifacts used in later jobs such as generate-test-session by updating (overriding) RSPEC_REPORT_OPTS.

MR acceptance checklist

Please evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

Screenshots or screen recordings

Screenshots are required for UI changes, and strongly recommended for all other merge requests.

Before After

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

Edited by Sanad Liaquat

Merge request reports