|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/161373502)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1593480442615&to=1593484304007)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/161811541)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1593566614635&to=1593570377141)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.2.0-pre `744484487f2`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-06-30
|
|
|
* Run Time: 1h 4m 21.39s (Start: 01:27:22 UTC, End: 02:31:44 UTC)
|
|
|
* GPT Version: v2.0.3
|
|
|
* Date: 2020-07-01
|
|
|
* Run Time: 1h 2m 42.51s (Start: 01:23:34 UTC, End: 02:26:17 UTC)
|
|
|
* GPT Version: v2.0.4
|
|
|
|
|
|
❯ Overall Results Score: 96.48%
|
|
|
❯ Overall Results Score: 97.42%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|--------
|
|
|
api_v4_groups | 200/s | 194.92/s (>160.00/s) | 66.23ms | 72.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 195.32/s (>160.00/s) | 70.90ms | 88.78ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.5/s (>160.00/s) | 70.58ms | 78.01ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 134.27/s (>32.00/s) | 1345.52ms | 1578.46ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 50.68/s (>32.00/s) | 3490.03ms | 4244.82ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.92/s (>160.00/s) | 45.55ms | 48.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 192.83/s (>96.00/s) | 330.98ms | 467.78ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.22/s (>96.00/s) | 383.37ms | 561.58ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.93/s (>160.00/s) | 42.46ms | 45.30ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 144.27/s (>96.00/s) | 1245.66ms | 1570.45ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.92/s (>160.00/s) | 110.49ms | 135.42ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.23/s (>160.00/s) | 111.35ms | 132.29ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.32/s (>160.00/s) | 69.71ms | 76.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.65/s (>128.00/s) | 197.48ms | 262.38ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 54.2/s (>32.00/s) | 3287.47ms | 4007.97ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 132.98/s (>160.00/s) | 1342.04ms | 1782.91ms (<500ms) | 100.00% (>95%) | **{-FAILED-}**²
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.6/s (>160.00/s) | 81.66ms | 114.10ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.1/s (>16.00/s) | 312.37ms | 500.30ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.82/s (>160.00/s) | 52.24ms | 62.45ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 92.67/s (>32.00/s) | 1940.92ms | 2778.27ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.43/s (>160.00/s) | 76.12ms | 92.61ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.35/s (>160.00/s) | 72.10ms | 81.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 194.58/s (>160.00/s) | 151.47ms | 219.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.68/s (>160.00/s) | 64.77ms | 73.90ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.47/s (>160.00/s) | 161.73ms | 184.26ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.33/s (>160.00/s) | 142.23ms | 188.47ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 9.15/s (>1.60/s) | 14584.32ms | 19665.87ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.92/s (>160.00/s) | 103.98ms | 124.77ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.28/s (>160.00/s) | 88.34ms | 101.76ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 129.85/s (>48.00/s) | 6378.28ms | 7961.75ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 99.08/s (>48.00/s) | 8386.54ms | 11078.14ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 99.52/s (>48.00/s) | 7224.01ms | 9252.62ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.03/s (>160.00/s) | 30.34ms | 32.47ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.28/s (>160.00/s) | 78.83ms | 97.49ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.67/s (>16.00/s) | 55.55ms | 58.02ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.68/s (>16.00/s) | 65.20ms | 76.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.37/s (>16.00/s) | 490.08ms | 754.41ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.0/s (>1.60/s) | 549.87ms | 573.91ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 1.98/s (>1.60/s) | 381.04ms | 858.81ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.25/s (>16.00/s) | 153.63ms | 196.63ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.17/s (>16.00/s) | 285.08ms | 343.05ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.92/s (>9.60/s) | 656.14ms | 817.14ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.97/s (>16.00/s) | 455.08ms | 483.52ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 3.25/s (>0.80/s) | 5355.46ms | 6027.83ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.6/s (>0.80/s) | 6445.27ms | 14195.58ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.1/s (>1.60/s) | 1595.47ms | 3251.09ms (<5000ms) | 99.85% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.48/s (>12.00/s) | 328.82ms | 359.08ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.15/s (>16.00/s) | 334.51ms | 980.79ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.35/s (>16.00/s) | 241.07ms | 306.11ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.87/s (>8.00/s) | 678.01ms | 1043.21ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.87/s (>9.60/s) | 474.43ms | 721.25ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.65/s (>11.20/s) | 924.03ms | 2423.84ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.32/s (>16.00/s) | 273.99ms | 338.53ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.05/s (>9.60/s) | 326.71ms | 523.24ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.32/s (>16.00/s) | 84.40ms | 179.31ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.33/s (>16.00/s) | 75.13ms | 139.61ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.12/s (>16.00/s) | 83.99ms | 246.90ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.37/s (>9.60/s) | 115.31ms | 165.17ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
|
|
|
|
|
|
² Failure may not be clear from summary alone. Refer to the individual test's full output for further debugging. |
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.03/s (>160.00/s) | 63.22ms | 70.06ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 140.58/s (>128.00/s) | 1284.05ms | 1469.37ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.6/s (>160.00/s) | 67.57ms | 74.16ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 145.32/s (>32.00/s) | 1242.72ms | 1455.64ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 52.27/s (>32.00/s) | 3405.16ms | 4083.09ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.83/s (>160.00/s) | 43.77ms | 47.31ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 192.88/s (>96.00/s) | 281.06ms | 390.18ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.98/s (>96.00/s) | 301.85ms | 402.79ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.8/s (>160.00/s) | 40.54ms | 43.45ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 141.17/s (>96.00/s) | 1275.77ms | 1578.50ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.9/s (>160.00/s) | 107.74ms | 126.72ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 25.98/s (>16.00/s) | 6313.42ms | 7814.08ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.37/s (>160.00/s) | 67.58ms | 75.36ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.8/s (>128.00/s) | 189.83ms | 248.46ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 56.17/s (>32.00/s) | 3177.68ms | 3858.73ms (<7500ms) | 99.91% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.68/s (>160.00/s) | 116.06ms | 135.69ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.78/s (>160.00/s) | 53.10ms | 57.57ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.88/s (>16.00/s) | 242.94ms | 368.82ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.05/s (>160.00/s) | 38.85ms | 41.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 79.07/s (>32.00/s) | 2253.79ms | 3737.93ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.82/s (>160.00/s) | 58.41ms | 63.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.78/s (>160.00/s) | 59.74ms | 64.50ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.73/s (>160.00/s) | 60.28ms | 65.52ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.83/s (>160.00/s) | 52.79ms | 56.55ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.38/s (>160.00/s) | 148.46ms | 165.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.47/s (>160.00/s) | 133.51ms | 176.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 9.25/s (>1.60/s) | 14406.40ms | 20067.32ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.97/s (>160.00/s) | 104.02ms | 123.27ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.38/s (>160.00/s) | 85.13ms | 96.27ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 145.2/s (>48.00/s) | 5826.56ms | 7268.45ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 108.33/s (>48.00/s) | 7757.98ms | 10238.14ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 110.75/s (>48.00/s) | 6555.65ms | 8394.74ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.02/s (>160.00/s) | 28.95ms | 31.34ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.37/s (>160.00/s) | 68.69ms | 76.33ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.6/s (>16.00/s) | 44.91ms | 47.71ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.7/s (>16.00/s) | 52.46ms | 64.19ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.17/s (>16.00/s) | 482.68ms | 726.41ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.02/s (>1.60/s) | 524.84ms | 527.97ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.03/s (>1.60/s) | 293.52ms | 700.31ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.18/s (>16.00/s) | 121.92ms | 164.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.2/s (>16.00/s) | 243.28ms | 300.29ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.95/s (>9.60/s) | 620.45ms | 763.45ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.07/s (>16.00/s) | 404.99ms | 438.97ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 3.43/s (>0.80/s) | 5025.02ms | 5854.93ms (<20000ms) | 99.51% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.75/s (>0.80/s) | 6259.46ms | 14168.75ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.62/s (>1.60/s) | 1514.38ms | 3151.85ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.68/s (>12.00/s) | 331.19ms | 335.09ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.08/s (>16.00/s) | 320.18ms | 950.15ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.32/s (>16.00/s) | 228.50ms | 297.35ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 13.23/s (>8.00/s) | 1597.40ms | 2228.84ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 19.03/s (>9.60/s) | 453.62ms | 704.67ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.78/s (>11.20/s) | 871.82ms | 2300.68ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.23/s (>16.00/s) | 258.66ms | 306.73ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.1/s (>9.60/s) | 287.19ms | 455.77ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.1/s (>16.00/s) | 75.40ms | 160.89ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.3/s (>16.00/s) | 68.06ms | 123.83ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.22/s (>16.00/s) | 76.91ms | 244.16ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.33/s (>9.60/s) | 96.19ms | 126.54ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |