|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/173519334)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1596418114792&to=1596421966769)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/173934135)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1596506157149&to=1596509999829)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.3.0-pre `62d6e81cc3a`
|
|
|
* Environment Version: 13.3.0-pre `490f1902e6f`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-08-03
|
|
|
* Run Time: 1h 4m 11.98s (Start: 01:28:34 UTC, End: 02:32:46 UTC)
|
|
|
* Date: 2020-08-04
|
|
|
* Run Time: 1h 4m 2.68s (Start: 01:55:57 UTC, End: 02:59:59 UTC)
|
|
|
* GPT Version: v2.0.5
|
|
|
|
|
|
❯ Overall Results Score: 97.52%
|
|
|
❯ Overall Results Score: 97.49%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|-----------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.18/s (>160.00/s) | 58.07ms | 62.39ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 135.73/s (>16.00/s) | 1331.21ms | 1528.80ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.72/s (>160.00/s) | 63.89ms | 68.79ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 143.27/s (>16.00/s) | 1258.49ms | 1469.42ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 53.55/s (>8.00/s) | 3325.87ms | 4004.15ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.93/s (>160.00/s) | 41.21ms | 42.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 181.88/s (>96.00/s) | 948.96ms | 1152.94ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 159.2/s (>96.00/s) | 734.34ms | 1075.78ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.93/s (>160.00/s) | 39.31ms | 41.01ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 155.75/s (>96.00/s) | 1149.24ms | 1480.56ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.63/s (>160.00/s) | 93.26ms | 101.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 27.25/s (>16.00/s) | 6009.00ms | 7328.50ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.58/s (>160.00/s) | 63.86ms | 68.45ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.5/s (>128.00/s) | 170.99ms | 225.55ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 55.37/s (>8.00/s) | 3216.36ms | 3907.90ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.53/s (>160.00/s) | 106.16ms | 115.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.93/s (>160.00/s) | 51.33ms | 53.92ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.35/s (>16.00/s) | 231.62ms | 315.27ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.07/s (>160.00/s) | 38.19ms | 39.15ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 105.88/s (>32.00/s) | 1703.33ms | 2085.32ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.72/s (>160.00/s) | 58.88ms | 61.68ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.78/s (>160.00/s) | 58.09ms | 60.83ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit | 200/s | 194.98/s (>160.00/s) | 101.30ms | 110.38ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit_diff | 200/s | 194.97/s (>160.00/s) | 107.98ms | 116.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.48/s (>160.00/s) | 141.38ms | 152.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 195.03/s (>160.00/s) | 105.49ms | 151.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 16.2/s (>1.60/s) | 9937.98ms | 11870.84ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.12/s (>160.00/s) | 98.70ms | 124.16ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.58/s (>160.00/s) | 70.13ms | 73.09ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.43/s (>48.00/s) | 557.81ms | 2293.83ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 162.07/s (>48.00/s) | 4804.11ms | 6357.97ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 191.62/s (>48.00/s) | 191.29ms | 317.21ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.05/s (>160.00/s) | 28.38ms | 29.05ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.5/s (>160.00/s) | 64.92ms | 68.95ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.7/s (>16.00/s) | 44.13ms | 44.39ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.72/s (>16.00/s) | 52.04ms | 60.88ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.43/s (>16.00/s) | 360.23ms | 520.02ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.05/s (>1.60/s) | 343.42ms | 352.60ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.03/s (>1.60/s) | 277.97ms | 651.82ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.2/s (>16.00/s) | 123.78ms | 178.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.18/s (>16.00/s) | 255.50ms | 304.84ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.97/s (>9.60/s) | 605.23ms | 745.49ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commit | 20/s | 6.0/s (>3.20/s) | 2849.71ms | 9449.93ms (<12500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.07/s (>16.00/s) | 422.87ms | 436.96ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.67/s (>0.16/s) | 3144.84ms | 3690.07ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.63/s (>0.16/s) | 6258.59ms | 14268.20ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 10.38/s (>1.60/s) | 1847.38ms | 3552.28ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.28/s (>12.00/s) | 177.99ms | 255.30ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.17/s (>16.00/s) | 334.82ms | 976.85ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.27/s (>16.00/s) | 237.26ms | 296.57ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.75/s (>8.00/s) | 633.96ms | 1013.32ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.75/s (>9.60/s) | 449.04ms | 672.70ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.32/s (>11.20/s) | 942.33ms | 2390.37ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.25/s (>16.00/s) | 266.31ms | 330.30ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.05/s (>9.60/s) | 358.75ms | 601.81ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.07/s (>16.00/s) | 87.64ms | 171.15ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.23/s (>16.00/s) | 72.36ms | 126.70ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.23/s (>16.00/s) | 85.35ms | 319.75ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.27/s (>9.60/s) | 109.85ms | 153.45ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
api_v4_groups | 200/s | 195.1/s (>160.00/s) | 58.28ms | 63.20ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 139.07/s (>16.00/s) | 1299.65ms | 1496.07ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.7/s (>160.00/s) | 63.60ms | 69.55ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 142.05/s (>16.00/s) | 1270.04ms | 1492.72ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 54.17/s (>8.00/s) | 3288.06ms | 4012.09ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.83/s (>160.00/s) | 40.10ms | 41.64ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 186.57/s (>96.00/s) | 877.51ms | 1117.38ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 193.47/s (>96.00/s) | 226.37ms | 318.52ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 196.02/s (>160.00/s) | 38.45ms | 40.71ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 157.82/s (>96.00/s) | 1134.18ms | 1449.98ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.1/s (>160.00/s) | 88.06ms | 95.99ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 27.82/s (>16.00/s) | 5934.17ms | 7317.65ms (<12000ms) | 99.88% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.75/s (>160.00/s) | 61.98ms | 67.10ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 194.02/s (>128.00/s) | 167.23ms | 224.05ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 55.77/s (>8.00/s) | 3202.10ms | 3943.37ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.75/s (>160.00/s) | 102.03ms | 111.89ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.95/s (>160.00/s) | 49.76ms | 53.05ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.33/s (>16.00/s) | 222.29ms | 295.57ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.12/s (>160.00/s) | 37.34ms | 39.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 105.92/s (>32.00/s) | 1696.96ms | 2385.54ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.82/s (>160.00/s) | 57.72ms | 61.71ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.87/s (>160.00/s) | 56.41ms | 59.88ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit | 200/s | 195.15/s (>160.00/s) | 99.87ms | 109.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit_diff | 200/s | 195.12/s (>160.00/s) | 106.37ms | 115.10ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.55/s (>160.00/s) | 139.40ms | 150.46ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.87/s (>160.00/s) | 104.58ms | 151.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 16.72/s (>1.60/s) | 9619.14ms | 15456.70ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 193.47/s (>160.00/s) | 100.61ms | 141.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.62/s (>160.00/s) | 68.73ms | 72.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.38/s (>48.00/s) | 546.28ms | 2239.13ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 162.35/s (>48.00/s) | 4653.29ms | 6329.12ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 191.27/s (>48.00/s) | 197.60ms | 333.42ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.12/s (>160.00/s) | 27.09ms | 28.78ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.53/s (>160.00/s) | 61.71ms | 66.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.62/s (>16.00/s) | 43.57ms | 45.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.73/s (>16.00/s) | 50.09ms | 60.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.5/s (>16.00/s) | 351.97ms | 505.60ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.05/s (>1.60/s) | 345.90ms | 354.52ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 264.19ms | 607.65ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.28/s (>16.00/s) | 119.87ms | 173.88ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.17/s (>16.00/s) | 251.85ms | 308.32ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.95/s (>9.60/s) | 597.08ms | 732.84ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commit | 20/s | 6.08/s (>3.20/s) | 2825.05ms | 9425.07ms (<12500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.97/s (>16.00/s) | 424.56ms | 442.00ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.77/s (>0.16/s) | 3082.95ms | 3640.71ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.7/s (>0.16/s) | 6131.54ms | 13839.29ms (<30000ms) | 99.29% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 10.38/s (>1.60/s) | 1816.33ms | 3501.72ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.4/s (>12.00/s) | 165.42ms | 247.96ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.17/s (>16.00/s) | 325.84ms | 961.73ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.3/s (>16.00/s) | 235.45ms | 296.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.88/s (>8.00/s) | 615.58ms | 993.42ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.73/s (>9.60/s) | 448.71ms | 675.47ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.65/s (>11.20/s) | 914.46ms | 2407.40ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.33/s (>16.00/s) | 265.89ms | 330.34ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.08/s (>9.60/s) | 352.63ms | 594.50ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.03/s (>16.00/s) | 83.35ms | 168.73ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.18/s (>16.00/s) | 71.59ms | 123.31ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.22/s (>16.00/s) | 82.00ms | 306.37ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.4/s (>9.60/s) | 108.30ms | 151.64ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |