Skip to content

Add an automatic job to run QA smoke tests against Review Apps

Rémy Coutable requested to merge 49570-add-review_qa-job into master

EE port: https://gitlab.com/gitlab-org/gitlab-ee/merge_requests/8499

What does this MR do?

  1. Renames review to review-deploy.
  2. Renames stop_review to review-stop.
  3. Adds a build-qa-image job to the prepare stage and save the QA Docker image as artifact (example: https://gitlab.com/gitlab-org/gitlab-ce/-/jobs/120967019).
  4. Make review-deploy wait for gitlab:assets:compile to be done first since the CNG pipelines are depending on this job.
  5. Adds a review-qa-smoke job (which waits for review-deploy to be done first) to the test stage to run the smoke QA suite against the Review App.
  6. Adds a manual review-qa-all job (which waits for review-deploy to be done first) to the test stage to run the full QA suite against the Review App.
  7. Updates the Review Apps documentation accordingly.

Problems

  • review-deploy depends on gitlab:assets:compile which runs in the test stage and can take up to 22 minutes to complete
    • We could wait for that particular job to finish...

What are the relevant issue numbers?

Closes #49570 (closed).

Does this MR meet the acceptance criteria?

Edited by Rémy Coutable

Merge request reports