|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/159102490)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1592904908795&to=1592908705834)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/159432513)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1592961675454&to=1592965462445)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.2.0-pre `b7cc764269e`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-06-23
|
|
|
* Run Time: 1h 3m 17.04s (Start: 09:35:08 UTC, End: 10:38:25 UTC)
|
|
|
* GPT Version: v2.0.2
|
|
|
* Date: 2020-06-24
|
|
|
* Run Time: 1h 3m 6.99s (Start: 01:21:15 UTC, End: 02:24:22 UTC)
|
|
|
* GPT Version: v2.0.3
|
|
|
|
|
|
❯ Overall Results Score: 97.48%
|
|
|
❯ Overall Results Score: 97.4%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.1/s (>160.00/s) | 59.42ms | 66.76ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 195.32/s (>160.00/s) | 58.96ms | 75.66ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.95/s (>160.00/s) | 49.75ms | 54.09ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 84.98/s (>32.00/s) | 2120.28ms | 2371.73ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 69.18/s (>32.00/s) | 2587.84ms | 3113.42ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.95/s (>160.00/s) | 37.54ms | 40.20ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 192.92/s (>96.00/s) | 204.96ms | 282.95ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 190.82/s (>96.00/s) | 233.51ms | 331.09ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.88/s (>160.00/s) | 35.67ms | 38.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 143.0/s (>96.00/s) | 1256.87ms | 1570.40ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.0/s (>160.00/s) | 91.60ms | 111.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.37/s (>160.00/s) | 91.55ms | 110.59ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.48/s (>160.00/s) | 60.65ms | 68.83ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.07/s (>128.00/s) | 174.27ms | 231.42ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 72.47/s (>32.00/s) | 2476.52ms | 2924.24ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 195.07/s (>160.00/s) | 97.09ms | 116.49ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.98/s (>160.00/s) | 48.22ms | 53.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.4/s (>16.00/s) | 213.98ms | 285.95ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.55/s (>160.00/s) | 35.55ms | 37.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 93.5/s (>32.00/s) | 1917.79ms | 3089.07ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.83/s (>160.00/s) | 52.36ms | 55.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.83/s (>160.00/s) | 54.34ms | 58.27ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.73/s (>160.00/s) | 54.46ms | 57.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.93/s (>160.00/s) | 49.01ms | 51.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.6/s (>160.00/s) | 137.18ms | 147.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.53/s (>160.00/s) | 127.23ms | 171.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 9.37/s (>1.60/s) | 13880.48ms | 19023.18ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.0/s (>160.00/s) | 95.54ms | 109.56ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.32/s (>160.00/s) | 81.61ms | 95.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 146.92/s (>48.00/s) | 5613.33ms | 7242.20ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 107.8/s (>48.00/s) | 7793.31ms | 10314.75ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 110.17/s (>48.00/s) | 6419.20ms | 8485.78ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.13/s (>160.00/s) | 26.50ms | 28.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.42/s (>160.00/s) | 59.44ms | 65.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.62/s (>16.00/s) | 41.50ms | 42.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.7/s (>16.00/s) | 47.93ms | 57.63ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.4/s (>16.00/s) | 448.43ms | 673.69ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 454.48ms | 462.35ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 282.99ms | 676.23ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.2/s (>16.00/s) | 116.12ms | 152.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.27/s (>16.00/s) | 226.84ms | 288.56ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.98/s (>9.60/s) | 577.38ms | 702.86ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.02/s (>16.00/s) | 399.42ms | 425.73ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 3.42/s (>0.80/s) | 5027.49ms | 5663.03ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.67/s (>0.80/s) | 6248.44ms | 14199.37ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 11.85/s (>1.60/s) | 1605.16ms | 3250.75ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.7/s (>12.00/s) | 326.18ms | 416.78ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.15/s (>16.00/s) | 317.44ms | 943.33ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.33/s (>16.00/s) | 221.39ms | 282.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 13.23/s (>8.00/s) | 1577.37ms | 2141.19ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.88/s (>9.60/s) | 453.10ms | 689.68ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.67/s (>11.20/s) | 874.70ms | 2225.39ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.33/s (>16.00/s) | 241.53ms | 286.78ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.2/s (>9.60/s) | 293.92ms | 481.29ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 72.68ms | 166.82ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.2/s (>16.00/s) | 64.64ms | 125.52ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 18.98/s (>16.00/s) | 75.86ms | 211.85ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.37/s (>9.60/s) | 91.13ms | 121.15ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
api_v4_groups | 200/s | 195.08/s (>160.00/s) | 65.55ms | 75.07ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 194.43/s (>160.00/s) | 73.21ms | 89.63ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.83/s (>160.00/s) | 54.31ms | 59.84ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 73.55/s (>32.00/s) | 2443.59ms | 2874.39ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 62.62/s (>32.00/s) | 2856.79ms | 3509.77ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.93/s (>160.00/s) | 41.50ms | 44.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 187.92/s (>96.00/s) | 434.35ms | 617.80ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 185.3/s (>96.00/s) | 797.24ms | 1292.19ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.87/s (>160.00/s) | 39.32ms | 43.89ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 135.93/s (>96.00/s) | 1322.59ms | 1672.07ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.98/s (>160.00/s) | 105.04ms | 133.20ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.33/s (>160.00/s) | 102.39ms | 126.08ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.25/s (>160.00/s) | 67.67ms | 76.94ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 192.5/s (>128.00/s) | 211.07ms | 291.22ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 63.28/s (>32.00/s) | 2833.64ms | 3446.12ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.68/s (>160.00/s) | 112.13ms | 137.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.03/s (>160.00/s) | 53.72ms | 59.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.8/s (>16.00/s) | 240.63ms | 365.41ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.0/s (>160.00/s) | 39.00ms | 42.42ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 83.83/s (>32.00/s) | 2121.45ms | 3589.90ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.75/s (>160.00/s) | 57.38ms | 62.11ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.75/s (>160.00/s) | 61.17ms | 68.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.63/s (>160.00/s) | 59.80ms | 65.78ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.8/s (>160.00/s) | 52.81ms | 56.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.47/s (>160.00/s) | 148.76ms | 166.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.4/s (>160.00/s) | 133.30ms | 178.17ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 8.8/s (>1.60/s) | 14944.04ms | 20616.70ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.75/s (>160.00/s) | 106.25ms | 143.22ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.5/s (>160.00/s) | 86.70ms | 101.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 138.62/s (>48.00/s) | 5901.67ms | 7649.93ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 104.7/s (>48.00/s) | 7897.59ms | 10556.89ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 105.05/s (>48.00/s) | 6727.60ms | 8806.37ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 195.97/s (>160.00/s) | 29.23ms | 31.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.53/s (>160.00/s) | 68.04ms | 75.70ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.62/s (>16.00/s) | 44.96ms | 47.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.67/s (>16.00/s) | 52.22ms | 62.76ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.18/s (>16.00/s) | 477.14ms | 757.47ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 493.25ms | 497.30ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 257.15ms | 715.26ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.22/s (>16.00/s) | 126.14ms | 155.95ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.1/s (>16.00/s) | 255.79ms | 307.24ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.9/s (>9.60/s) | 655.23ms | 816.85ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.97/s (>16.00/s) | 456.20ms | 494.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 2.98/s (>0.80/s) | 5751.38ms | 6705.81ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.37/s (>0.80/s) | 7048.17ms | 16884.40ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 11.52/s (>1.60/s) | 1679.65ms | 3466.47ms (<5000ms) | 99.70% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 16.75/s (>12.00/s) | 426.67ms | 767.19ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.12/s (>16.00/s) | 359.35ms | 1101.38ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.3/s (>16.00/s) | 245.20ms | 306.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 12.73/s (>8.00/s) | 1673.65ms | 2288.20ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 19.0/s (>9.60/s) | 498.18ms | 808.63ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.3/s (>11.20/s) | 987.94ms | 2685.82ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.27/s (>16.00/s) | 272.67ms | 325.04ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.02/s (>9.60/s) | 327.56ms | 527.85ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 79.72ms | 165.22ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.32/s (>16.00/s) | 70.84ms | 129.78ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.12/s (>16.00/s) | 79.47ms | 244.15ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.27/s (>9.60/s) | 97.87ms | 127.65ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |