|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/175433466)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1596806891393&to=1596810712237)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/175962358)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1597022890914&to=1597026749168)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.3.0-pre `5f2283ed403`
|
|
|
* Environment Version: 13.3.0-pre `f2d2f348a3e`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-08-07
|
|
|
* Run Time: 1h 3m 40.84s (Start: 13:28:11 UTC, End: 14:31:52 UTC)
|
|
|
* Date: 2020-08-10
|
|
|
* Run Time: 1h 4m 18.25s (Start: 01:28:10 UTC, End: 02:32:29 UTC)
|
|
|
* GPT Version: v2.0.5
|
|
|
|
|
|
❯ Overall Results Score: 97.38%
|
|
|
❯ Overall Results Score: 97.41%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.35/s (>160.00/s) | 57.45ms | 62.57ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 132.4/s (>16.00/s) | 1363.25ms | 1614.50ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.68/s (>160.00/s) | 64.07ms | 70.13ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 142.1/s (>16.00/s) | 1270.40ms | 1516.15ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 47.88/s (>8.00/s) | 3696.63ms | 4678.62ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.97/s (>160.00/s) | 41.37ms | 44.02ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 179.5/s (>96.00/s) | 946.66ms | 1190.69ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.28/s (>96.00/s) | 285.62ms | 410.19ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 196.03/s (>160.00/s) | 39.50ms | 42.38ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 152.02/s (>96.00/s) | 1182.62ms | 1500.86ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.9/s (>160.00/s) | 93.03ms | 103.52ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 27.15/s (>16.00/s) | 6023.17ms | 7450.65ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.63/s (>160.00/s) | 64.24ms | 70.09ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.87/s (>128.00/s) | 171.82ms | 234.05ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 53.95/s (>8.00/s) | 3293.46ms | 4075.91ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.52/s (>160.00/s) | 107.08ms | 118.26ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.58/s (>160.00/s) | 51.30ms | 54.70ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.12/s (>16.00/s) | 243.34ms | 348.11ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.77/s (>160.00/s) | 38.19ms | 40.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 101.72/s (>32.00/s) | 1767.48ms | 2734.00ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.67/s (>160.00/s) | 58.84ms | 62.96ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.68/s (>160.00/s) | 57.84ms | 61.17ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit | 200/s | 195.07/s (>160.00/s) | 102.19ms | 111.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit_diff | 200/s | 195.07/s (>160.00/s) | 109.33ms | 119.92ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.47/s (>160.00/s) | 144.12ms | 160.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.82/s (>160.00/s) | 106.55ms | 151.36ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 16.28/s (>1.60/s) | 10062.66ms | 13378.45ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.03/s (>160.00/s) | 100.05ms | 125.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.62/s (>160.00/s) | 71.26ms | 76.61ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 190.7/s (>48.00/s) | 555.78ms | 2280.64ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 160.53/s (>48.00/s) | 4957.72ms | 6437.82ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 191.45/s (>48.00/s) | 204.05ms | 343.10ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.12/s (>160.00/s) | 28.18ms | 30.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.47/s (>160.00/s) | 63.50ms | 68.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 44.10ms | 46.61ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.73/s (>16.00/s) | 52.00ms | 62.80ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.27/s (>16.00/s) | 349.31ms | 513.82ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 364.14ms | 406.93ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 1.97/s (>1.60/s) | 273.10ms | 643.56ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.27/s (>16.00/s) | 124.12ms | 172.65ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.12/s (>16.00/s) | 266.91ms | 324.78ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.93/s (>9.60/s) | 597.03ms | 749.17ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commit | 20/s | 6.03/s (>3.20/s) | 2881.71ms | 9688.22ms (<12500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.13/s (>16.00/s) | 390.77ms | 434.64ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.52/s (>0.16/s) | 3203.23ms | 3710.96ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 3.33/s (>0.16/s) | 5240.58ms | 11514.13ms (<30000ms) | 99.45% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 10.0/s (>1.60/s) | 1896.00ms | 3812.02ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.32/s (>12.00/s) | 169.18ms | 256.36ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.12/s (>16.00/s) | 341.80ms | 1016.44ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.28/s (>16.00/s) | 239.63ms | 312.74ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.83/s (>8.00/s) | 641.77ms | 1005.76ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 19.12/s (>9.60/s) | 458.22ms | 717.00ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.52/s (>11.20/s) | 952.38ms | 2561.28ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.25/s (>16.00/s) | 277.66ms | 342.24ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.03/s (>9.60/s) | 365.85ms | 622.77ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.2/s (>16.00/s) | 85.12ms | 165.85ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.22/s (>16.00/s) | 75.85ms | 144.84ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.25/s (>16.00/s) | 87.08ms | 313.58ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.25/s (>9.60/s) | 112.96ms | 156.34ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|-----------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.2/s (>160.00/s) | 61.48ms | 68.04ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 124.67/s (>16.00/s) | 1449.04ms | 1710.59ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.48/s (>160.00/s) | 67.85ms | 74.48ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 132.38/s (>16.00/s) | 1365.58ms | 1630.23ms (<7000ms) | 99.96% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 50.45/s (>8.00/s) | 3524.30ms | 4423.25ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.85/s (>160.00/s) | 44.47ms | 47.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 170.08/s (>96.00/s) | 1049.47ms | 1269.96ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.65/s (>96.00/s) | 386.31ms | 567.89ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.72/s (>160.00/s) | 41.09ms | 43.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 152.05/s (>96.00/s) | 1184.87ms | 1514.93ms (<2000ms) | 99.96% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.87/s (>160.00/s) | 97.08ms | 108.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 26.65/s (>16.00/s) | 6179.32ms | 7584.71ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.5/s (>160.00/s) | 67.83ms | 74.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.57/s (>128.00/s) | 185.90ms | 256.75ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 52.18/s (>8.00/s) | 3402.90ms | 4282.24ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.58/s (>160.00/s) | 111.52ms | 123.97ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.7/s (>160.00/s) | 54.88ms | 59.07ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.7/s (>16.00/s) | 237.31ms | 321.71ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.05/s (>160.00/s) | 41.09ms | 44.30ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 105.98/s (>32.00/s) | 1701.56ms | 2205.54ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.72/s (>160.00/s) | 61.96ms | 65.92ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.75/s (>160.00/s) | 61.86ms | 65.84ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit | 200/s | 194.78/s (>160.00/s) | 104.58ms | 114.15ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit_diff | 200/s | 195.07/s (>160.00/s) | 110.99ms | 120.12ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.52/s (>160.00/s) | 145.77ms | 158.60ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.8/s (>160.00/s) | 111.86ms | 159.02ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 16.78/s (>1.60/s) | 9821.23ms | 13945.91ms (<35000ms) | 99.90% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.9/s (>160.00/s) | 104.31ms | 136.10ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.43/s (>160.00/s) | 71.68ms | 75.76ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 190.8/s (>48.00/s) | 656.32ms | 2663.44ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 156.65/s (>48.00/s) | 5147.98ms | 6684.80ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 191.27/s (>48.00/s) | 214.88ms | 359.11ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.12/s (>160.00/s) | 30.69ms | 33.53ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.58/s (>160.00/s) | 67.45ms | 72.42ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.67/s (>16.00/s) | 48.21ms | 51.12ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.73/s (>16.00/s) | 55.10ms | 66.59ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.5/s (>16.00/s) | 364.39ms | 525.41ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 361.64ms | 359.17ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.0/s (>1.60/s) | 281.17ms | 665.31ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.23/s (>16.00/s) | 130.58ms | 184.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.1/s (>16.00/s) | 274.43ms | 338.36ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.92/s (>9.60/s) | 607.31ms | 762.67ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commit | 20/s | 5.83/s (>3.20/s) | 2907.52ms | 9813.72ms (<12500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.02/s (>16.00/s) | 402.35ms | 446.28ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.45/s (>0.16/s) | 3248.18ms | 3762.99ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 3.3/s (>0.16/s) | 5234.04ms | 11834.97ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 9.97/s (>1.60/s) | 1896.28ms | 3990.28ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.32/s (>12.00/s) | 176.35ms | 258.10ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.05/s (>16.00/s) | 362.34ms | 1072.96ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.28/s (>16.00/s) | 252.50ms | 333.63ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.93/s (>8.00/s) | 620.85ms | 990.76ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.87/s (>9.60/s) | 487.05ms | 765.47ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.47/s (>11.20/s) | 977.52ms | 2619.57ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.28/s (>16.00/s) | 284.13ms | 350.49ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.02/s (>9.60/s) | 385.92ms | 683.69ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.08/s (>16.00/s) | 90.13ms | 172.72ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.37/s (>16.00/s) | 82.77ms | 147.53ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.15/s (>16.00/s) | 91.86ms | 331.29ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.25/s (>9.60/s) | 120.24ms | 170.06ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |