Add an automatic job to run QA smoke tests against Review Apps
EE port: https://gitlab.com/gitlab-org/gitlab-ee/merge_requests/8499
What does this MR do?
- Renames
review
toreview-deploy
. - Renames
stop_review
toreview-stop
. - Adds a
build-qa-image
job to theprepare
stage and save the QA Docker image as artifact (example: https://gitlab.com/gitlab-org/gitlab-ce/-/jobs/120967019). - Make
review-deploy
wait forgitlab:assets:compile
to be done first since the CNG pipelines are depending on this job. - Adds a
review-qa-smoke
job (which waits forreview-deploy
to be done first) to thetest
stage to run the smoke QA suite against the Review App. - Adds a manual
review-qa-all
job (which waits forreview-deploy
to be done first) to thetest
stage to run the full QA suite against the Review App. - Updates the Review Apps documentation accordingly.
Problems
-
review-deploy
depends ongitlab:assets:compile
which runs in thetest
stage and can take up to 22 minutes to complete- We could wait for that particular job to finish...
What are the relevant issue numbers?
Closes #49570 (closed).
Does this MR meet the acceptance criteria?
- [-] Changelog entry added, if necessary
-
Documentation created/updated - [-] Tests added for this feature/bug
-
Conforms to the code review guidelines -
Conforms to the merge request performance guidelines -
Conforms to the style guides -
Conforms to the database guides
Edited by Rémy Coutable