Disallow review-qa-reliable job to fail

Anastasia McDonaldrequested to merge
qa-make-review-qa-reliable-mandatory into master

What does this MR do and why?

Describe in detail what your merge request does and why.

Disallows the review-qa-reliable job to fail in all MRs with a deployed Review App (it currently runs by defaults in MRs with Frontend, QA and CI patters). The review-qa-reliable job runs E2E tests from the reliable suite that is executed as a blocking step in the release process, so it is important to detect failures early at the MR stage.

We have been monitoring the job for a month and all detected issues are now addressed (see https://gitlab.com/gitlab-org/quality/team-tasks/-/issues/1058#note_751126018 for more information).

The MR also adds a missing allure report for the reliable job and updates relevant documentation.

Third task of https://gitlab.com/gitlab-org/quality/team-tasks/-/issues/1058.

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Anastasia McDonald

Merge request reports