Test plan for "Mirror changes from Web IDE to CI runner"
Test Plan
Introduction
This test plan is for https://gitlab.com/gitlab-org/gitlab-ee/issues/5276 and extends https://gitlab.com/gitlab-org/gitlab-ee/issues/7658. The feature allows a user to open a web terminal from the Web IDE and execute commands against the code as it exists in the Web IDE (i.e., the current state of the code, not the latest commit).
Implementation details are still under discussion.
Scope
- EE-only (Ultimate)
- The terminal will include the current state of the code in the Web IDE.
- Starting/stopping the web terminal and basic functionality is covered as part of https://gitlab.com/gitlab-org/gitlab-ee/issues/7658. This test plan focuses on mirroring changes during an active session. But it should include what happens when a session is interrupted.
ACC Matrix
Secure | Responsive | Intuitive | Reliable | |
---|---|---|---|---|
Web IDE |
For more information see the Google Testing Blog article about the 10 minute test plan and this wiki page from an open-source tool that implements the ACC model.
Capabilities
Web IDE is:
-
Reliable
- Code changes made in the Web IDE are available in the web terminal without undue delay.
-
Intuitive
- It's clear when code changes made in the IDE will be available in the web terminal. E.g., if the user has to save their changes first, the UI should make that clear.
- It's clear what's happening if there is a delay in syncing data from the Web IDE to the web terminal. I.e., there is some kind of indication that data is out of sync and is being updated.
Test Plan
End-to-end tests:
- Add and configure a runner, push code to a project, and then
- start the web terminal and
cat
the changed file - make a change to a project via the Web IDE and
cat
the changed file
- start the web terminal and
Edited by Mark Lapierre