|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/171399196)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1595899619253&to=1595903467289)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/171863496)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1595986073192&to=1595989908773)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.3.0-pre `9cda1414a43`
|
|
|
* Environment Version: 13.3.0-pre `e650a4d4c5f`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-07-28
|
|
|
* Run Time: 1h 4m 8.04s (Start: 01:26:59 UTC, End: 02:31:07 UTC)
|
|
|
* Date: 2020-07-29
|
|
|
* Run Time: 1h 3m 55.58s (Start: 01:27:53 UTC, End: 02:31:48 UTC)
|
|
|
* GPT Version: v2.0.5
|
|
|
|
|
|
❯ Overall Results Score: 97.48%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|-----------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.38/s (>160.00/s) | 56.90ms | 61.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 134.12/s (>16.00/s) | 1345.52ms | 1714.97ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.63/s (>160.00/s) | 62.54ms | 67.89ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 140.8/s (>16.00/s) | 1283.10ms | 1629.26ms (<7000ms) | 99.91% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 55.88/s (>8.00/s) | 3179.08ms | 3876.02ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.95/s (>160.00/s) | 39.80ms | 41.29ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 180.02/s (>96.00/s) | 930.47ms | 1146.05ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.53/s (>96.00/s) | 218.70ms | 308.57ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.98/s (>160.00/s) | 38.06ms | 39.69ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 181.65/s (>96.00/s) | 960.66ms | 1267.69ms (<2000ms) | 99.94% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.2/s (>160.00/s) | 84.74ms | 91.33ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 27.47/s (>16.00/s) | 6020.67ms | 7408.84ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.62/s (>160.00/s) | 61.46ms | 65.97ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.68/s (>128.00/s) | 167.82ms | 222.49ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 56.23/s (>8.00/s) | 3167.31ms | 3891.54ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.85/s (>160.00/s) | 100.47ms | 109.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.88/s (>160.00/s) | 50.04ms | 52.74ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.43/s (>16.00/s) | 223.67ms | 298.54ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.9/s (>160.00/s) | 37.69ms | 39.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 106.0/s (>32.00/s) | 1695.13ms | 2167.60ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.78/s (>160.00/s) | 55.74ms | 58.73ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.8/s (>160.00/s) | 57.01ms | 59.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit | 200/s | 195.13/s (>160.00/s) | 100.20ms | 108.71ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit_diff | 200/s | 194.98/s (>160.00/s) | 110.85ms | 119.39ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.48/s (>160.00/s) | 139.69ms | 150.88ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.8/s (>160.00/s) | 105.06ms | 152.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 17.1/s (>1.60/s) | 9590.23ms | 12099.38ms (<35000ms) | 99.90% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.08/s (>160.00/s) | 98.09ms | 120.43ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.67/s (>160.00/s) | 67.51ms | 70.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.47/s (>48.00/s) | 366.87ms | 1192.01ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 186.65/s (>48.00/s) | 1849.90ms | 2435.14ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 191.68/s (>48.00/s) | 167.93ms | 277.09ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.0/s (>160.00/s) | 28.44ms | 29.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.57/s (>160.00/s) | 63.06ms | 67.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.67/s (>16.00/s) | 43.31ms | 44.88ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.72/s (>16.00/s) | 50.27ms | 58.99ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.43/s (>16.00/s) | 331.49ms | 491.78ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.05/s (>1.60/s) | 332.42ms | 330.00ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 265.36ms | 612.76ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.28/s (>16.00/s) | 120.11ms | 180.22ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.1/s (>16.00/s) | 244.85ms | 305.27ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 19.02/s (>9.60/s) | 591.81ms | 734.62ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commit | 20/s | 10.73/s (>6.40/s) | 1672.36ms | 5351.67ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.98/s (>16.00/s) | 425.13ms | 448.32ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.8/s (>0.16/s) | 3074.89ms | 3632.56ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.63/s (>0.16/s) | 6266.14ms | 14028.90ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 10.2/s (>1.60/s) | 1847.04ms | 3579.63ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.32/s (>12.00/s) | 172.20ms | 252.55ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.08/s (>16.00/s) | 343.92ms | 992.23ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.25/s (>16.00/s) | 233.10ms | 299.99ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 19.03/s (>8.00/s) | 597.32ms | 960.85ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.67/s (>9.60/s) | 453.43ms | 679.67ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.65/s (>11.20/s) | 912.03ms | 2341.58ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.27/s (>16.00/s) | 263.75ms | 337.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.05/s (>9.60/s) | 351.24ms | 589.20ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.08/s (>16.00/s) | 84.52ms | 172.28ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.15/s (>16.00/s) | 73.19ms | 118.01ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.27/s (>16.00/s) | 84.38ms | 321.58ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.25/s (>9.60/s) | 96.83ms | 133.60ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.03/s (>160.00/s) | 59.78ms | 68.78ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 139.03/s (>16.00/s) | 1298.28ms | 1671.13ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.72/s (>160.00/s) | 62.99ms | 68.27ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 143.23/s (>16.00/s) | 1258.72ms | 1635.34ms (<7000ms) | 99.90% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 54.12/s (>8.00/s) | 3297.42ms | 3985.21ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.95/s (>160.00/s) | 40.49ms | 41.97ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 185.53/s (>96.00/s) | 721.14ms | 1092.12ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.5/s (>96.00/s) | 228.41ms | 319.59ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 196.0/s (>160.00/s) | 38.45ms | 40.16ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 149.43/s (>96.00/s) | 1204.15ms | 1527.41ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.98/s (>160.00/s) | 90.56ms | 101.73ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 28.1/s (>16.00/s) | 5912.16ms | 7339.80ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.48/s (>160.00/s) | 63.87ms | 70.57ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.8/s (>128.00/s) | 167.04ms | 220.35ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 58.05/s (>8.00/s) | 3078.61ms | 3743.78ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.82/s (>160.00/s) | 102.44ms | 111.75ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.85/s (>160.00/s) | 49.91ms | 52.29ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.15/s (>16.00/s) | 239.37ms | 326.15ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.85/s (>160.00/s) | 37.15ms | 38.20ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 96.22/s (>32.00/s) | 1866.54ms | 2530.55ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.78/s (>160.00/s) | 56.73ms | 59.23ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.8/s (>160.00/s) | 57.01ms | 59.64ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit | 200/s | 194.92/s (>160.00/s) | 105.09ms | 114.81ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit_diff | 200/s | 194.9/s (>160.00/s) | 111.36ms | 120.75ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.48/s (>160.00/s) | 146.85ms | 160.56ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.93/s (>160.00/s) | 105.22ms | 150.60ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 15.32/s (>1.60/s) | 10630.77ms | 15047.36ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.05/s (>160.00/s) | 100.19ms | 120.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.55/s (>160.00/s) | 70.46ms | 73.92ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.48/s (>48.00/s) | 478.21ms | 1923.20ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 162.07/s (>48.00/s) | 4773.62ms | 6326.75ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 189.0/s (>48.00/s) | 714.62ms | 1638.67ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.07/s (>160.00/s) | 27.63ms | 28.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.55/s (>160.00/s) | 63.04ms | 67.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.65/s (>16.00/s) | 43.91ms | 44.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.72/s (>16.00/s) | 52.13ms | 62.34ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.33/s (>16.00/s) | 350.87ms | 546.24ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 381.36ms | 386.05ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.03/s (>1.60/s) | 266.64ms | 627.17ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.22/s (>16.00/s) | 119.33ms | 176.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.22/s (>16.00/s) | 244.93ms | 302.33ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.9/s (>9.60/s) | 626.69ms | 775.92ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commit | 20/s | 6.2/s (>3.20/s) | 2808.63ms | 9212.99ms (<12500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.03/s (>16.00/s) | 422.77ms | 437.63ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.63/s (>0.16/s) | 3151.68ms | 3697.74ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.73/s (>0.16/s) | 6151.28ms | 13919.10ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 10.47/s (>1.60/s) | 1821.09ms | 3530.63ms (<5000ms) | 99.83% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.3/s (>12.00/s) | 184.51ms | 261.57ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.18/s (>16.00/s) | 339.21ms | 968.29ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.37/s (>16.00/s) | 229.72ms | 286.42ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.95/s (>8.00/s) | 597.57ms | 973.79ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.77/s (>9.60/s) | 449.07ms | 660.95ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.68/s (>11.20/s) | 878.44ms | 2243.42ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.27/s (>16.00/s) | 267.26ms | 329.12ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.02/s (>9.60/s) | 352.07ms | 582.97ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 79.44ms | 161.27ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.2/s (>16.00/s) | 72.57ms | 111.61ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.15/s (>16.00/s) | 81.26ms | 293.61ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.32/s (>9.60/s) | 111.24ms | 156.89ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |