|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/173934135)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1596506157149&to=1596509999829)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/174359654)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1596590864074&to=1596594692936)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.3.0-pre `490f1902e6f`
|
|
|
* Environment Version: 13.3.0-pre `7f45a7fdc00`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-08-04
|
|
|
* Run Time: 1h 4m 2.68s (Start: 01:55:57 UTC, End: 02:59:59 UTC)
|
|
|
* Date: 2020-08-05
|
|
|
* Run Time: 1h 3m 48.86s (Start: 01:27:44 UTC, End: 02:31:32 UTC)
|
|
|
* GPT Version: v2.0.5
|
|
|
|
|
|
❯ Overall Results Score: 97.49%
|
|
|
❯ Overall Results Score: 97.42%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|-----------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.1/s (>160.00/s) | 58.28ms | 63.20ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 139.07/s (>16.00/s) | 1299.65ms | 1496.07ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.7/s (>160.00/s) | 63.60ms | 69.55ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 142.05/s (>16.00/s) | 1270.04ms | 1492.72ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 54.17/s (>8.00/s) | 3288.06ms | 4012.09ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.83/s (>160.00/s) | 40.10ms | 41.64ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 186.57/s (>96.00/s) | 877.51ms | 1117.38ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 193.47/s (>96.00/s) | 226.37ms | 318.52ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 196.02/s (>160.00/s) | 38.45ms | 40.71ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 157.82/s (>96.00/s) | 1134.18ms | 1449.98ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.1/s (>160.00/s) | 88.06ms | 95.99ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 27.82/s (>16.00/s) | 5934.17ms | 7317.65ms (<12000ms) | 99.88% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.75/s (>160.00/s) | 61.98ms | 67.10ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 194.02/s (>128.00/s) | 167.23ms | 224.05ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 55.77/s (>8.00/s) | 3202.10ms | 3943.37ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.75/s (>160.00/s) | 102.03ms | 111.89ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.95/s (>160.00/s) | 49.76ms | 53.05ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.33/s (>16.00/s) | 222.29ms | 295.57ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.12/s (>160.00/s) | 37.34ms | 39.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 105.92/s (>32.00/s) | 1696.96ms | 2385.54ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.82/s (>160.00/s) | 57.72ms | 61.71ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.87/s (>160.00/s) | 56.41ms | 59.88ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit | 200/s | 195.15/s (>160.00/s) | 99.87ms | 109.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit_diff | 200/s | 195.12/s (>160.00/s) | 106.37ms | 115.10ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.55/s (>160.00/s) | 139.40ms | 150.46ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.87/s (>160.00/s) | 104.58ms | 151.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 16.72/s (>1.60/s) | 9619.14ms | 15456.70ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 193.47/s (>160.00/s) | 100.61ms | 141.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.62/s (>160.00/s) | 68.73ms | 72.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.38/s (>48.00/s) | 546.28ms | 2239.13ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 162.35/s (>48.00/s) | 4653.29ms | 6329.12ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 191.27/s (>48.00/s) | 197.60ms | 333.42ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.12/s (>160.00/s) | 27.09ms | 28.78ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.53/s (>160.00/s) | 61.71ms | 66.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.62/s (>16.00/s) | 43.57ms | 45.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.73/s (>16.00/s) | 50.09ms | 60.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.5/s (>16.00/s) | 351.97ms | 505.60ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.05/s (>1.60/s) | 345.90ms | 354.52ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 264.19ms | 607.65ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.28/s (>16.00/s) | 119.87ms | 173.88ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.17/s (>16.00/s) | 251.85ms | 308.32ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.95/s (>9.60/s) | 597.08ms | 732.84ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commit | 20/s | 6.08/s (>3.20/s) | 2825.05ms | 9425.07ms (<12500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.97/s (>16.00/s) | 424.56ms | 442.00ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.77/s (>0.16/s) | 3082.95ms | 3640.71ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.7/s (>0.16/s) | 6131.54ms | 13839.29ms (<30000ms) | 99.29% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 10.38/s (>1.60/s) | 1816.33ms | 3501.72ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.4/s (>12.00/s) | 165.42ms | 247.96ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.17/s (>16.00/s) | 325.84ms | 961.73ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.3/s (>16.00/s) | 235.45ms | 296.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.88/s (>8.00/s) | 615.58ms | 993.42ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.73/s (>9.60/s) | 448.71ms | 675.47ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.65/s (>11.20/s) | 914.46ms | 2407.40ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.33/s (>16.00/s) | 265.89ms | 330.34ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.08/s (>9.60/s) | 352.63ms | 594.50ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.03/s (>16.00/s) | 83.35ms | 168.73ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.18/s (>16.00/s) | 71.59ms | 123.31ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.22/s (>16.00/s) | 82.00ms | 306.37ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.4/s (>9.60/s) | 108.30ms | 151.64ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
api_v4_groups | 200/s | 195.23/s (>160.00/s) | 61.64ms | 67.60ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 126.03/s (>16.00/s) | 1433.99ms | 1756.74ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.57/s (>160.00/s) | 67.98ms | 75.03ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 131.43/s (>16.00/s) | 1375.40ms | 1652.92ms (<7000ms) | 99.96% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 50.42/s (>8.00/s) | 3520.28ms | 4275.15ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.87/s (>160.00/s) | 44.38ms | 48.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 170.22/s (>96.00/s) | 1037.66ms | 1289.72ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.9/s (>96.00/s) | 398.23ms | 590.82ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.87/s (>160.00/s) | 41.83ms | 45.32ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 146.62/s (>96.00/s) | 1231.74ms | 1563.49ms (<2000ms) | 99.93% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.07/s (>160.00/s) | 153.44ms | 178.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 26.28/s (>16.00/s) | 6268.90ms | 7743.23ms (<12000ms) | 99.87% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.53/s (>160.00/s) | 68.25ms | 75.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.68/s (>128.00/s) | 188.84ms | 253.65ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 51.95/s (>8.00/s) | 3415.18ms | 4153.84ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.72/s (>160.00/s) | 115.10ms | 131.41ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.82/s (>160.00/s) | 54.25ms | 58.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.0/s (>16.00/s) | 242.03ms | 327.89ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.07/s (>160.00/s) | 41.09ms | 43.56ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 95.48/s (>32.00/s) | 1881.99ms | 3063.40ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.58/s (>160.00/s) | 62.68ms | 67.61ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.68/s (>160.00/s) | 60.34ms | 64.90ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit | 200/s | 195.17/s (>160.00/s) | 104.64ms | 114.34ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit_diff | 200/s | 195.02/s (>160.00/s) | 110.41ms | 119.96ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.58/s (>160.00/s) | 145.67ms | 159.53ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.92/s (>160.00/s) | 109.06ms | 154.96ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 16.4/s (>1.60/s) | 9789.76ms | 14297.78ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 193.65/s (>160.00/s) | 103.97ms | 147.44ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.6/s (>160.00/s) | 71.90ms | 75.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 190.95/s (>48.00/s) | 642.41ms | 2583.72ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 155.65/s (>48.00/s) | 5241.23ms | 6736.90ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 186.17/s (>48.00/s) | 1022.57ms | 1942.12ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.12/s (>160.00/s) | 30.15ms | 32.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.3/s (>160.00/s) | 67.61ms | 74.22ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.65/s (>16.00/s) | 47.14ms | 49.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.68/s (>16.00/s) | 53.80ms | 64.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.4/s (>16.00/s) | 362.16ms | 529.56ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 365.15ms | 371.31ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 303.08ms | 711.36ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.3/s (>16.00/s) | 127.40ms | 175.42ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.12/s (>16.00/s) | 267.32ms | 318.08ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.98/s (>9.60/s) | 629.95ms | 797.50ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commit | 20/s | 5.88/s (>3.20/s) | 2912.26ms | 9682.23ms (<12500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.98/s (>16.00/s) | 443.84ms | 467.58ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.57/s (>0.16/s) | 3197.65ms | 3706.77ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.67/s (>0.16/s) | 6279.32ms | 14196.67ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 10.02/s (>1.60/s) | 1901.73ms | 3841.18ms (<5000ms) | 99.65% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.28/s (>12.00/s) | 175.58ms | 266.85ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.2/s (>16.00/s) | 348.27ms | 1021.30ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.28/s (>16.00/s) | 247.40ms | 312.53ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.92/s (>8.00/s) | 635.80ms | 1004.24ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 19.0/s (>9.60/s) | 463.43ms | 699.42ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.38/s (>11.20/s) | 965.69ms | 2591.17ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.25/s (>16.00/s) | 286.02ms | 344.94ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.07/s (>9.60/s) | 374.65ms | 634.31ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.07/s (>16.00/s) | 84.95ms | 172.72ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.32/s (>16.00/s) | 79.67ms | 144.66ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.2/s (>16.00/s) | 90.29ms | 317.24ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.3/s (>9.60/s) | 113.74ms | 157.16ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |