|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/169264769)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1595381256459&to=1595385019078)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/169759791)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1595467790037&to=1595471603398)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.2.0-pre `4eeb6114938`
|
|
|
* Environment Version: 13.2.0-pre `8170b984763`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-07-22
|
|
|
* Run Time: 1h 2m 42.62s (Start: 01:27:36 UTC, End: 02:30:19 UTC)
|
|
|
* Date: 2020-07-23
|
|
|
* Run Time: 1h 3m 33.36s (Start: 01:29:50 UTC, End: 02:33:23 UTC)
|
|
|
* GPT Version: v2.0.5
|
|
|
|
|
|
❯ Overall Results Score: 97.45%
|
|
|
❯ Overall Results Score: 97.4%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.17/s (>160.00/s) | 65.96ms | 79.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 122.37/s (>16.00/s) | 1477.44ms | 1723.60ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.57/s (>160.00/s) | 70.25ms | 79.86ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 128.5/s (>16.00/s) | 1407.83ms | 1677.03ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 47.6/s (>8.00/s) | 3716.13ms | 4595.94ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.83/s (>160.00/s) | 44.33ms | 47.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 163.0/s (>96.00/s) | 1102.45ms | 1348.40ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 182.35/s (>96.00/s) | 914.21ms | 1466.00ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.8/s (>160.00/s) | 41.82ms | 45.36ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 157.68/s (>96.00/s) | 1139.10ms | 1463.78ms (<2000ms) | 99.96% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.07/s (>160.00/s) | 98.13ms | 110.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 26.48/s (>16.00/s) | 6248.40ms | 7721.50ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.43/s (>160.00/s) | 69.16ms | 77.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.6/s (>128.00/s) | 221.17ms | 313.42ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 47.53/s (>8.00/s) | 3730.01ms | 4625.03ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.65/s (>160.00/s) | 116.88ms | 132.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.72/s (>160.00/s) | 55.99ms | 61.72ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.07/s (>16.00/s) | 239.96ms | 357.79ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.93/s (>160.00/s) | 41.15ms | 43.08ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 92.87/s (>32.00/s) | 1928.22ms | 2973.01ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.55/s (>160.00/s) | 61.35ms | 65.42ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.73/s (>160.00/s) | 63.08ms | 68.69ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.7/s (>160.00/s) | 62.09ms | 65.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.75/s (>160.00/s) | 55.71ms | 59.05ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.35/s (>160.00/s) | 157.71ms | 182.43ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.82/s (>160.00/s) | 111.68ms | 157.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 15.87/s (>1.60/s) | 10309.33ms | 13542.90ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.0/s (>160.00/s) | 106.33ms | 138.92ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.47/s (>160.00/s) | 79.40ms | 84.42ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.37/s (>48.00/s) | 489.00ms | 1878.41ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 161.88/s (>48.00/s) | 4854.28ms | 6482.73ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 191.27/s (>48.00/s) | 233.75ms | 399.61ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.13/s (>160.00/s) | 30.56ms | 31.31ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.62/s (>160.00/s) | 69.95ms | 78.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.6/s (>16.00/s) | 45.97ms | 46.70ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.73/s (>16.00/s) | 52.72ms | 61.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.38/s (>16.00/s) | 360.52ms | 530.02ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 374.40ms | 368.74ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.03/s (>1.60/s) | 302.12ms | 714.32ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.27/s (>16.00/s) | 128.21ms | 180.31ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.1/s (>16.00/s) | 269.63ms | 323.88ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.95/s (>9.60/s) | 653.18ms | 805.51ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.93/s (>16.00/s) | 461.29ms | 503.48ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.32/s (>0.16/s) | 3335.87ms | 3969.94ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.33/s (>0.16/s) | 6974.02ms | 16897.15ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 11.78/s (>1.60/s) | 1619.39ms | 3365.09ms (<5000ms) | 99.85% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.3/s (>12.00/s) | 178.86ms | 271.87ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.15/s (>16.00/s) | 364.43ms | 1114.56ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.2/s (>16.00/s) | 260.65ms | 325.55ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.93/s (>8.00/s) | 641.44ms | 1074.03ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.98/s (>9.60/s) | 501.92ms | 792.86ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.17/s (>11.20/s) | 1013.59ms | 2718.16ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.25/s (>16.00/s) | 294.47ms | 357.56ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.03/s (>9.60/s) | 338.92ms | 553.79ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 90.68ms | 175.21ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.23/s (>16.00/s) | 81.37ms | 124.47ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.23/s (>16.00/s) | 92.47ms | 334.23ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.28/s (>9.60/s) | 111.23ms | 156.60ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
api_v4_groups | 200/s | 195.32/s (>160.00/s) | 63.00ms | 69.65ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 134.15/s (>16.00/s) | 1344.99ms | 1651.58ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.63/s (>160.00/s) | 65.26ms | 71.38ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 142.45/s (>16.00/s) | 1265.07ms | 1559.06ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 52.07/s (>8.00/s) | 3412.83ms | 4244.63ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.85/s (>160.00/s) | 42.43ms | 45.23ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 174.17/s (>96.00/s) | 989.12ms | 1291.94ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 183.78/s (>96.00/s) | 590.60ms | 1149.65ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.78/s (>160.00/s) | 42.68ms | 46.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 117.85/s (>96.00/s) | 1531.90ms | 1888.62ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.58/s (>160.00/s) | 116.24ms | 152.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 27.02/s (>16.00/s) | 6132.97ms | 7636.48ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.3/s (>160.00/s) | 77.40ms | 91.43ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.43/s (>128.00/s) | 274.67ms | 409.53ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 50.73/s (>8.00/s) | 3510.56ms | 4250.20ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.03/s (>160.00/s) | 137.18ms | 168.61ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.8/s (>160.00/s) | 58.39ms | 68.96ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.3/s (>16.00/s) | 232.32ms | 305.23ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.98/s (>160.00/s) | 44.17ms | 52.23ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 95.47/s (>32.00/s) | 1879.02ms | 2832.76ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.62/s (>160.00/s) | 63.29ms | 71.92ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.68/s (>160.00/s) | 62.69ms | 68.73ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.6/s (>160.00/s) | 65.23ms | 71.79ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.85/s (>160.00/s) | 58.68ms | 65.64ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.25/s (>160.00/s) | 157.89ms | 179.38ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.78/s (>160.00/s) | 116.23ms | 156.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 15.78/s (>1.60/s) | 10414.05ms | 13411.96ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.65/s (>160.00/s) | 108.42ms | 143.49ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.37/s (>160.00/s) | 76.27ms | 84.63ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.15/s (>48.00/s) | 1057.50ms | 3486.83ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 132.95/s (>48.00/s) | 6454.51ms | 7968.53ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 156.32/s (>48.00/s) | 4053.61ms | 5750.59ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 195.95/s (>160.00/s) | 32.39ms | 36.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.32/s (>160.00/s) | 71.09ms | 82.50ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 50.30ms | 56.07ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.68/s (>16.00/s) | 56.91ms | 71.69ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.53/s (>16.00/s) | 366.26ms | 540.57ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 372.25ms | 374.16ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.0/s (>1.60/s) | 294.53ms | 656.94ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.27/s (>16.00/s) | 126.18ms | 171.84ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.15/s (>16.00/s) | 261.18ms | 314.46ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.95/s (>9.60/s) | 636.09ms | 814.51ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.98/s (>16.00/s) | 438.33ms | 497.77ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.55/s (>0.16/s) | 3195.81ms | 3769.71ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.58/s (>0.16/s) | 6386.97ms | 15049.43ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 11.7/s (>1.60/s) | 1627.60ms | 3263.68ms (<5000ms) | 99.85% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.28/s (>12.00/s) | 170.02ms | 249.37ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.02/s (>16.00/s) | 365.46ms | 1028.39ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.35/s (>16.00/s) | 252.75ms | 320.10ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.78/s (>8.00/s) | 642.56ms | 1031.65ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 19.08/s (>9.60/s) | 463.72ms | 742.17ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.5/s (>11.20/s) | 945.85ms | 2587.28ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.27/s (>16.00/s) | 279.52ms | 339.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.07/s (>9.60/s) | 321.47ms | 533.10ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.07/s (>16.00/s) | 87.32ms | 166.51ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.27/s (>16.00/s) | 78.08ms | 139.73ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.17/s (>16.00/s) | 89.60ms | 326.77ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.15/s (>9.60/s) | 119.39ms | 163.27ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |