E2e test of Suggested Reviewers UI
The Suggested Reviewers (SR) feature is being integrated with the GitLab UI as part of gitlab-org/modelops/applied-ml/review-recommender&3 (closed)
Each of the system components and subcomponents will be tested individually, and we will also have contract tests: https://gitlab.com/gitlab-org/quality/team-tasks/-/issues/1410
Broadly, there are two halves of the SR feature - model training, and serving the trained model to make predictions.
This issue is for end-to-end tests that will test the later half, model serving:
- Install and configure the SR backend services (gitlab-org/gitlab-qa!1024 (merged))
- Enable the feature
- Import a pretrained model
- Verify by validating suggestions via the UI
- Check that a valid user is suggested. Don't need to verify accuracy of the suggestion because that's part of the model training.
The last step can serve on its own as a test of the feature in production.
Since SR includes a few services and some involves some relatively long-running processes. This work is likely to be similar to the implementation of Gitaly Cluster tests.
Tasks
-
Add a new GitLab QA scenario for SR e2e tests using pre-trained models: gitlab-org/gitlab-qa!1024 (merged) -
Refactor GitLab QA shell command handling to make it simpler to add k82 support: gitlab-org/gitlab-qa!1031 (merged)
-
-
Add an e2e test for validating suggestions via the UI (this issue): gitlab-org/gitlab!100890 (merged) -
Add QA selectors and page object elements: gitlab-org/gitlab!100792 (merged) -
Add an additional frontend data attribute: gitlab-org/gitlab!101308 (merged) - https://gitlab.com/gitlab-org/gitlab/-/quality/test_cases/377613
-
Subsequent tasks
- Allow the new scenario to test model training features: gitlab-org/gitlab-qa#685 (closed)
- Include special characters in project name (see https://gitlab.com/gitlab-org/modelops/applied-ml/review-recommender/etl/-/issues/11)
- Test project backup/restore/import