FY22-Q2 KR: Increase functional and performance test coverage of large MRs => 75%

To align with increasing SUS for Merge Requests FY21-Q2 OKRs

The performance of large merge requests on GitLab.com is a common problem that has been surfaced in various areas like SUS surveys and Hacker News.

For this objective, we will need to:

• Review large MR requirement => 100% | https://gitlab.com/gitlab-org/gitlab/-/issues/327128 | https://gitlab.com/gitlab-org/gitlab/-/merge_requests/63527
• Fully automated end-to-end tests that tests large MRs in functional test => 95% | https://gitlab.com/gitlab-org/gitlab/-/issues/333925 | https://gitlab.com/gitlab-org/gitlab/-/merge_requests/63527
  • MR to add jobs for this test is in progress
  • Identify and tag additional MR specific tests which would need large MRs.
• Add Large MR to Sample Demo data in GitLab => 100% | https://gitlab.com/gitlab-org/gitlab/-/merge_requests/65125
  • Sample large MR is being added to the gitlab project. If needed, it can be done for the Sample Data project as well.
• Increase focus of bug refinement meeting that affect large MRs => 0%

Next Steps

Cleanup

Status	Step	Merge Request
⌛	Documentation	-

Improvements

Status	Step	Merge Request
⌛	Using API instead of UI	-
⌛	Refactoring the Project Page Object	-

Resources and previous data

• System Usability Scale https://docs.google.com/presentation/d/1kMZcRnOjuQ0K3TtT1YxedhFb5-Ej_cr2mXxeeJ9sbZ0/edit#slide=id.ga943e54df8_0_157
• NPS (Net Promoter Score) report https://docs.google.com/presentation/d/1BYh0gg8ogmmW8_hwmvi30Yr3Wh5aIXEa_M8RHrQ5ciw/edit#slide=id.g816b061b2f_0_33
• MR size and performance research synthesis:
  • Slide https://docs.google.com/presentation/d/13i_aagzPLusuVCx_jOVYPCyT1SSx__0OAt6cSHmWRdQ/edit?usp=sharing
  • Summary video https://youtu.be/Rd8aVDJIHGs
• GPT 30000 diffs https://staging.gitlab.com/gpt/large_projects/gitlabhq1/-/merge_requests/10495/diffs
• GPT 130 discussions https://staging.gitlab.com/gpt/large_projects/gitlabhq1/-/merge_requests/6958
• Last iteration of Performance Testing: Functional testing of large Merge Requests, diffs and discussions gitlab-org&422 (closed)

Related links

• https://gitlab.com/gitlab-data/analytics/-/issues/8486
• gitlab-org/gitlab#327128 (closed)
• gitlab-org&422 (closed)

Related goals

• Product OKR's for Q2-FY22
• UX KR for Q2-FY22: Focus on negative SUS theme related to merge requests
• Development KR for Q2-FY22: Code Review: Improve rendering performance of Large MR: 40% faster, 65% less memory usage

Issue Tracking

Issues in support of this effort are identified with ~"OKR FY22 Q2::Large MR". They can be tracked at this link.