|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/165230827)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1594383012326&to=1594386794240)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/165780151)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1594603566040&to=1594607366497)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.2.0-pre `6a9c2b82797`
|
|
|
* Environment Version: 13.2.0-pre `58e88479a34`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-07-10
|
|
|
* Run Time: 1h 3m 1.91s (Start: 12:10:12 UTC, End: 13:13:14 UTC)
|
|
|
* Date: 2020-07-13
|
|
|
* Run Time: 1h 3m 20.46s (Start: 01:26:06 UTC, End: 02:29:26 UTC)
|
|
|
* GPT Version: v2.0.5
|
|
|
|
|
|
❯ Overall Results Score: 97.44%
|
|
|
❯ Overall Results Score: 97.48%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|-----------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.37/s (>160.00/s) | 59.25ms | 64.30ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 139.72/s (>16.00/s) | 1292.78ms | 1487.18ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.75/s (>160.00/s) | 64.97ms | 70.86ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 145.98/s (>16.00/s) | 1235.21ms | 1425.72ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 56.15/s (>8.00/s) | 3165.20ms | 3882.08ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.97/s (>160.00/s) | 41.82ms | 43.60ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 193.7/s (>96.00/s) | 187.35ms | 251.28ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 190.93/s (>96.00/s) | 232.90ms | 325.91ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.63/s (>160.00/s) | 39.60ms | 41.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 191.85/s (>96.00/s) | 173.46ms | 193.26ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.18/s (>160.00/s) | 87.34ms | 92.83ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 25.35/s (>16.00/s) | 6367.82ms | 8574.98ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 194.72/s (>160.00/s) | 63.79ms | 67.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 192.43/s (>128.00/s) | 167.80ms | 221.45ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 55.2/s (>8.00/s) | 3218.85ms | 4008.00ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.85/s (>160.00/s) | 97.74ms | 105.04ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.85/s (>160.00/s) | 51.88ms | 55.04ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 193.25/s (>16.00/s) | 213.06ms | 246.73ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.78/s (>160.00/s) | 38.84ms | 40.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 107.6/s (>32.00/s) | 1668.83ms | 2619.30ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.75/s (>160.00/s) | 56.95ms | 59.42ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.77/s (>160.00/s) | 59.14ms | 62.43ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.73/s (>160.00/s) | 57.68ms | 60.24ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.75/s (>160.00/s) | 52.73ms | 55.32ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.55/s (>160.00/s) | 139.05ms | 152.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.48/s (>160.00/s) | 132.39ms | 176.51ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 17.97/s (>1.60/s) | 9173.67ms | 11558.92ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.98/s (>160.00/s) | 98.09ms | 121.27ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.47/s (>160.00/s) | 82.65ms | 92.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 190.83/s (>48.00/s) | 174.48ms | 306.11ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 190.68/s (>48.00/s) | 190.01ms | 335.65ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 191.3/s (>48.00/s) | 215.65ms | 371.92ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 195.32/s (>160.00/s) | 29.34ms | 30.35ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.5/s (>160.00/s) | 65.35ms | 69.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.6/s (>16.00/s) | 44.25ms | 44.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.73/s (>16.00/s) | 51.37ms | 62.01ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.35/s (>16.00/s) | 347.11ms | 506.42ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 371.65ms | 409.74ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.05/s (>1.60/s) | 258.71ms | 601.76ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.1/s (>16.00/s) | 123.40ms | 146.56ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.12/s (>16.00/s) | 246.61ms | 300.53ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.95/s (>9.60/s) | 574.05ms | 716.98ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.05/s (>16.00/s) | 420.25ms | 448.32ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.98/s (>0.16/s) | 2999.91ms | 3585.36ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.67/s (>0.16/s) | 6315.89ms | 13935.50ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.25/s (>1.60/s) | 1572.12ms | 3214.88ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.78/s (>12.00/s) | 318.88ms | 468.65ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.13/s (>16.00/s) | 333.17ms | 977.59ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.28/s (>16.00/s) | 233.98ms | 299.52ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 12.92/s (>8.00/s) | 1647.18ms | 2311.91ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 19.07/s (>9.60/s) | 450.66ms | 679.24ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.7/s (>11.20/s) | 920.67ms | 2382.33ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.3/s (>16.00/s) | 269.03ms | 330.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.1/s (>9.60/s) | 304.52ms | 500.44ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.0/s (>16.00/s) | 79.42ms | 152.87ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.25/s (>16.00/s) | 71.52ms | 129.54ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.15/s (>16.00/s) | 82.09ms | 225.46ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.28/s (>9.60/s) | 103.28ms | 130.94ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
api_v4_groups | 200/s | 195.15/s (>160.00/s) | 63.71ms | 70.49ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 131.9/s (>16.00/s) | 1370.30ms | 1564.48ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.57/s (>160.00/s) | 69.37ms | 75.79ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 139.32/s (>16.00/s) | 1295.87ms | 1509.84ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 48.45/s (>8.00/s) | 3671.13ms | 4409.40ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.87/s (>160.00/s) | 44.04ms | 46.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 178.22/s (>96.00/s) | 984.91ms | 1234.71ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.8/s (>96.00/s) | 387.02ms | 537.54ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.85/s (>160.00/s) | 42.26ms | 45.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 147.7/s (>96.00/s) | 1220.69ms | 1539.67ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.0/s (>160.00/s) | 102.09ms | 116.95ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 25.7/s (>16.00/s) | 6454.19ms | 8128.62ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.42/s (>160.00/s) | 69.73ms | 76.23ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.8/s (>128.00/s) | 195.28ms | 257.99ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 52.88/s (>8.00/s) | 3355.67ms | 4072.54ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.57/s (>160.00/s) | 118.65ms | 136.08ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.83/s (>160.00/s) | 55.41ms | 58.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.37/s (>16.00/s) | 231.66ms | 318.32ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.0/s (>160.00/s) | 41.19ms | 43.17ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 112.05/s (>32.00/s) | 1608.92ms | 2100.16ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.67/s (>160.00/s) | 60.43ms | 63.61ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.75/s (>160.00/s) | 61.82ms | 65.32ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.72/s (>160.00/s) | 61.26ms | 64.69ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.78/s (>160.00/s) | 54.03ms | 56.19ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.58/s (>160.00/s) | 141.33ms | 153.94ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.5/s (>160.00/s) | 134.24ms | 181.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 17.43/s (>1.60/s) | 9519.60ms | 13505.16ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.17/s (>160.00/s) | 101.32ms | 123.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.23/s (>160.00/s) | 84.79ms | 94.39ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.55/s (>48.00/s) | 319.45ms | 957.20ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 147.02/s (>48.00/s) | 5611.02ms | 7180.15ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 172.92/s (>48.00/s) | 3334.26ms | 4817.95ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.03/s (>160.00/s) | 30.36ms | 31.74ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.37/s (>160.00/s) | 67.98ms | 72.81ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 46.07ms | 51.55ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.7/s (>16.00/s) | 52.67ms | 61.97ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.45/s (>16.00/s) | 352.23ms | 501.19ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.0/s (>1.60/s) | 381.20ms | 407.96ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.05/s (>1.60/s) | 240.51ms | 599.09ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.27/s (>16.00/s) | 124.63ms | 179.45ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.27/s (>16.00/s) | 249.80ms | 313.61ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.93/s (>9.60/s) | 570.76ms | 693.71ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.02/s (>16.00/s) | 424.50ms | 445.89ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.93/s (>0.16/s) | 3016.61ms | 3592.37ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.62/s (>0.16/s) | 6352.15ms | 13965.52ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.35/s (>1.60/s) | 1550.45ms | 3208.23ms (<5000ms) | 99.86% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.97/s (>12.00/s) | 300.91ms | 347.22ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.2/s (>16.00/s) | 333.97ms | 973.96ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.28/s (>16.00/s) | 238.23ms | 303.36ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 13.2/s (>8.00/s) | 1606.59ms | 2252.84ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.77/s (>9.60/s) | 461.00ms | 686.03ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.58/s (>11.20/s) | 931.98ms | 2398.44ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.32/s (>16.00/s) | 273.18ms | 339.35ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.07/s (>9.60/s) | 306.78ms | 503.38ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 76.21ms | 154.13ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.17/s (>16.00/s) | 68.74ms | 124.63ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.08/s (>16.00/s) | 77.49ms | 224.00ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.23/s (>9.60/s) | 103.59ms | 142.30ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |