FY22-Q2 KR: Increase functional and performance test coverage of large MRs => 75%
To align with increasing SUS for Merge Requests FY21-Q2 OKRs
The performance of large merge requests on GitLab.com is a common problem that has been surfaced in various areas like SUS surveys and Hacker News.
For this objective, we will need to:
-
Review large MR requirement => 100% | https://gitlab.com/gitlab-org/gitlab/-/issues/327128 | https://gitlab.com/gitlab-org/gitlab/-/merge_requests/63527
-
Fully automated end-to-end tests that tests large MRs in functional test => 95% | https://gitlab.com/gitlab-org/gitlab/-/issues/333925 | https://gitlab.com/gitlab-org/gitlab/-/merge_requests/63527
- MR to add jobs for this test is in progress
- Identify and tag additional MR specific tests which would need large MRs.
-
Add Large MR to Sample Demo data in GitLab => 100% | https://gitlab.com/gitlab-org/gitlab/-/merge_requests/65125
- Sample large MR is being added to the gitlab project. If needed, it can be done for the Sample Data project as well.
-
Increase focus of bug refinement meeting that affect large MRs => 0%
Next Steps
Cleanup
Status | Step | Merge Request |
---|---|---|
Documentation | - |
Improvements
Status | Step | Merge Request |
---|---|---|
Using API instead of UI | - | |
Refactoring the Project Page Object | - |
Resources and previous data
- System Usability Scale https://docs.google.com/presentation/d/1kMZcRnOjuQ0K3TtT1YxedhFb5-Ej_cr2mXxeeJ9sbZ0/edit#slide=id.ga943e54df8_0_157
- NPS (Net Promoter Score) report https://docs.google.com/presentation/d/1BYh0gg8ogmmW8_hwmvi30Yr3Wh5aIXEa_M8RHrQ5ciw/edit#slide=id.g816b061b2f_0_33
- MR size and performance research synthesis:
- GPT 30000 diffs https://staging.gitlab.com/gpt/large_projects/gitlabhq1/-/merge_requests/10495/diffs
- GPT 130 discussions https://staging.gitlab.com/gpt/large_projects/gitlabhq1/-/merge_requests/6958
- Last iteration of Performance Testing: Functional testing of large Merge Requests, diffs and discussions gitlab-org&422 (closed)
Related links
- https://gitlab.com/gitlab-data/analytics/-/issues/8486
- gitlab-org/gitlab#327128 (closed)
- gitlab-org&422 (closed)
Related goals
- Product OKR's for Q2-FY22
- UX KR for Q2-FY22: Focus on negative SUS theme related to merge requests
- Development KR for Q2-FY22: Code Review: Improve rendering performance of Large MR: 40% faster, 65% less memory usage
Issue Tracking
Issues in support of this effort are identified with ~"OKR FY22 Q2::Large MR". They can be tracked at this link.
Edited by Ramya Authappan