|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/161811541)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1593566614635&to=1593570377141)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/162236601)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1593653209729&to=1593657005161)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.2.0-pre `744484487f2`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-07-01
|
|
|
* Run Time: 1h 2m 42.51s (Start: 01:23:34 UTC, End: 02:26:17 UTC)
|
|
|
* Date: 2020-07-02
|
|
|
* Run Time: 1h 3m 15.43s (Start: 01:26:49 UTC, End: 02:30:05 UTC)
|
|
|
* GPT Version: v2.0.4
|
|
|
|
|
|
❯ Overall Results Score: 97.42%
|
|
|
❯ Overall Results Score: 97.24%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.03/s (>160.00/s) | 63.22ms | 70.06ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 140.58/s (>128.00/s) | 1284.05ms | 1469.37ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.6/s (>160.00/s) | 67.57ms | 74.16ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 145.32/s (>32.00/s) | 1242.72ms | 1455.64ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 52.27/s (>32.00/s) | 3405.16ms | 4083.09ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.83/s (>160.00/s) | 43.77ms | 47.31ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 192.88/s (>96.00/s) | 281.06ms | 390.18ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.98/s (>96.00/s) | 301.85ms | 402.79ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.8/s (>160.00/s) | 40.54ms | 43.45ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 141.17/s (>96.00/s) | 1275.77ms | 1578.50ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.9/s (>160.00/s) | 107.74ms | 126.72ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 25.98/s (>16.00/s) | 6313.42ms | 7814.08ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.37/s (>160.00/s) | 67.58ms | 75.36ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.8/s (>128.00/s) | 189.83ms | 248.46ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 56.17/s (>32.00/s) | 3177.68ms | 3858.73ms (<7500ms) | 99.91% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.68/s (>160.00/s) | 116.06ms | 135.69ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.78/s (>160.00/s) | 53.10ms | 57.57ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.88/s (>16.00/s) | 242.94ms | 368.82ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.05/s (>160.00/s) | 38.85ms | 41.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 79.07/s (>32.00/s) | 2253.79ms | 3737.93ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.82/s (>160.00/s) | 58.41ms | 63.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.78/s (>160.00/s) | 59.74ms | 64.50ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.73/s (>160.00/s) | 60.28ms | 65.52ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.83/s (>160.00/s) | 52.79ms | 56.55ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.38/s (>160.00/s) | 148.46ms | 165.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.47/s (>160.00/s) | 133.51ms | 176.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 9.25/s (>1.60/s) | 14406.40ms | 20067.32ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.97/s (>160.00/s) | 104.02ms | 123.27ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.38/s (>160.00/s) | 85.13ms | 96.27ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 145.2/s (>48.00/s) | 5826.56ms | 7268.45ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 108.33/s (>48.00/s) | 7757.98ms | 10238.14ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 110.75/s (>48.00/s) | 6555.65ms | 8394.74ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.02/s (>160.00/s) | 28.95ms | 31.34ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.37/s (>160.00/s) | 68.69ms | 76.33ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.6/s (>16.00/s) | 44.91ms | 47.71ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.7/s (>16.00/s) | 52.46ms | 64.19ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.17/s (>16.00/s) | 482.68ms | 726.41ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.02/s (>1.60/s) | 524.84ms | 527.97ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.03/s (>1.60/s) | 293.52ms | 700.31ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.18/s (>16.00/s) | 121.92ms | 164.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.2/s (>16.00/s) | 243.28ms | 300.29ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.95/s (>9.60/s) | 620.45ms | 763.45ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.07/s (>16.00/s) | 404.99ms | 438.97ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 3.43/s (>0.80/s) | 5025.02ms | 5854.93ms (<20000ms) | 99.51% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.75/s (>0.80/s) | 6259.46ms | 14168.75ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.62/s (>1.60/s) | 1514.38ms | 3151.85ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.68/s (>12.00/s) | 331.19ms | 335.09ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.08/s (>16.00/s) | 320.18ms | 950.15ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.32/s (>16.00/s) | 228.50ms | 297.35ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 13.23/s (>8.00/s) | 1597.40ms | 2228.84ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 19.03/s (>9.60/s) | 453.62ms | 704.67ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.78/s (>11.20/s) | 871.82ms | 2300.68ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.23/s (>16.00/s) | 258.66ms | 306.73ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.1/s (>9.60/s) | 287.19ms | 455.77ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.1/s (>16.00/s) | 75.40ms | 160.89ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.3/s (>16.00/s) | 68.06ms | 123.83ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.22/s (>16.00/s) | 76.91ms | 244.16ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.33/s (>9.60/s) | 96.19ms | 126.54ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
api_v4_groups | 200/s | 194.72/s (>160.00/s) | 68.05ms | 77.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 133.12/s (>128.00/s) | 1356.58ms | 1615.45ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.45/s (>160.00/s) | 71.39ms | 78.63ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 140.32/s (>32.00/s) | 1287.94ms | 1573.30ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 50.75/s (>32.00/s) | 3498.66ms | 4363.12ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.85/s (>160.00/s) | 46.04ms | 50.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 190.75/s (>96.00/s) | 314.66ms | 435.62ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 189.45/s (>96.00/s) | 376.64ms | 528.74ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.82/s (>160.00/s) | 44.08ms | 49.26ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 142.27/s (>96.00/s) | 1260.98ms | 1555.54ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.78/s (>160.00/s) | 111.58ms | 128.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 24.97/s (>16.00/s) | 6569.46ms | 8429.62ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.02/s (>160.00/s) | 75.64ms | 84.59ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 192.6/s (>128.00/s) | 214.83ms | 302.04ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 52.5/s (>32.00/s) | 3391.71ms | 4250.72ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.28/s (>160.00/s) | 123.89ms | 147.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.73/s (>160.00/s) | 57.76ms | 63.78ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.97/s (>16.00/s) | 230.67ms | 300.16ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.62/s (>160.00/s) | 43.31ms | 47.92ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 100.43/s (>32.00/s) | 1792.88ms | 2471.29ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.58/s (>160.00/s) | 65.84ms | 72.17ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.63/s (>160.00/s) | 65.54ms | 70.94ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.52/s (>160.00/s) | 67.23ms | 75.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.68/s (>160.00/s) | 58.14ms | 63.80ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.38/s (>160.00/s) | 156.60ms | 171.78ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.53/s (>160.00/s) | 143.48ms | 187.41ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 8.78/s (>1.60/s) | 15173.05ms | 20841.07ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.72/s (>160.00/s) | 110.50ms | 148.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.22/s (>160.00/s) | 90.85ms | 103.11ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 153.57/s (>48.00/s) | 5376.45ms | 6865.73ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 114.77/s (>48.00/s) | 7336.59ms | 9611.52ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 115.65/s (>48.00/s) | 6272.51ms | 8189.29ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.0/s (>160.00/s) | 32.89ms | 37.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.33/s (>160.00/s) | 73.86ms | 82.55ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 49.48ms | 54.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.7/s (>16.00/s) | 57.28ms | 71.56ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 18.95/s (>16.00/s) | 477.42ms | 740.28ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.02/s (>1.60/s) | 534.66ms | 545.24ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.0/s (>1.60/s) | 321.55ms | 747.86ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.15/s (>16.00/s) | 136.56ms | 184.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 18.98/s (>16.00/s) | 267.20ms | 314.28ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.88/s (>9.60/s) | 649.81ms | 827.22ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.95/s (>16.00/s) | 443.38ms | 509.29ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 3.17/s (>0.80/s) | 5473.38ms | 6249.24ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.5/s (>0.80/s) | 6499.64ms | 15223.43ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 11.85/s (>1.60/s) | 1618.98ms | 3224.97ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.42/s (>12.00/s) | 339.59ms | 362.13ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.05/s (>16.00/s) | 348.79ms | 1017.34ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.22/s (>16.00/s) | 251.02ms | 309.22ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 12.48/s (>8.00/s) | 1718.09ms | 2405.28ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.82/s (>9.60/s) | 494.82ms | 807.45ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.6/s (>11.20/s) | 962.60ms | 2717.84ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.27/s (>16.00/s) | 281.94ms | 342.74ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.05/s (>9.60/s) | 326.52ms | 533.83ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 80.77ms | 173.53ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.37/s (>16.00/s) | 74.44ms | 128.56ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.17/s (>16.00/s) | 82.70ms | 219.27ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.12/s (>9.60/s) | 107.53ms | 140.47ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |