|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/172770587)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1596158912266&to=1596162773404)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/173519334)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1596418114792&to=1596421966769)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.3.0-pre `8321eac5e34`
|
|
|
* Environment Version: 13.3.0-pre `62d6e81cc3a`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-07-31
|
|
|
* Run Time: 1h 4m 21.14s (Start: 01:28:32 UTC, End: 02:32:53 UTC)
|
|
|
* Date: 2020-08-03
|
|
|
* Run Time: 1h 4m 11.98s (Start: 01:28:34 UTC, End: 02:32:46 UTC)
|
|
|
* GPT Version: v2.0.5
|
|
|
|
|
|
❯ Overall Results Score: 97.35%
|
|
|
❯ Overall Results Score: 97.52%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.18/s (>160.00/s) | 64.04ms | 73.70ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 120.5/s (>16.00/s) | 1498.82ms | 2058.66ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.53/s (>160.00/s) | 68.25ms | 74.76ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 127.53/s (>16.00/s) | 1416.59ms | 1950.20ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 50.82/s (>8.00/s) | 3493.07ms | 4213.84ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.92/s (>160.00/s) | 44.16ms | 46.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 174.33/s (>96.00/s) | 985.92ms | 1226.74ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 191.92/s (>96.00/s) | 390.22ms | 594.31ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.88/s (>160.00/s) | 42.01ms | 44.63ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 152.0/s (>96.00/s) | 1180.81ms | 1532.02ms (<2000ms) | 99.96% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.0/s (>160.00/s) | 97.75ms | 108.16ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 26.57/s (>16.00/s) | 6219.78ms | 7825.33ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.37/s (>160.00/s) | 68.03ms | 74.17ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.6/s (>128.00/s) | 186.57ms | 254.02ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 51.62/s (>8.00/s) | 3444.80ms | 4253.13ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.55/s (>160.00/s) | 113.71ms | 125.81ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.85/s (>160.00/s) | 55.07ms | 58.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.13/s (>16.00/s) | 237.87ms | 329.68ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.02/s (>160.00/s) | 41.97ms | 43.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 98.75/s (>32.00/s) | 1818.46ms | 2745.12ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.68/s (>160.00/s) | 63.72ms | 66.72ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.68/s (>160.00/s) | 62.41ms | 65.96ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit | 200/s | 194.87/s (>160.00/s) | 108.25ms | 118.19ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit_diff | 200/s | 194.93/s (>160.00/s) | 114.08ms | 123.39ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.4/s (>160.00/s) | 151.47ms | 167.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.78/s (>160.00/s) | 114.82ms | 164.79ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 16.43/s (>1.60/s) | 10100.70ms | 13205.92ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.05/s (>160.00/s) | 108.24ms | 134.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.37/s (>160.00/s) | 78.23ms | 82.73ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.65/s (>48.00/s) | 537.79ms | 2141.72ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 161.07/s (>48.00/s) | 4809.26ms | 6398.06ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 191.35/s (>48.00/s) | 236.50ms | 404.41ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.07/s (>160.00/s) | 31.44ms | 33.39ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.37/s (>160.00/s) | 69.00ms | 73.77ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 48.13ms | 50.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.7/s (>16.00/s) | 56.11ms | 67.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.45/s (>16.00/s) | 383.37ms | 559.73ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 392.27ms | 434.64ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.0/s (>1.60/s) | 298.39ms | 669.10ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.2/s (>16.00/s) | 136.29ms | 206.02ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.17/s (>16.00/s) | 264.53ms | 332.49ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.9/s (>9.60/s) | 660.82ms | 828.03ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commit | 20/s | 5.83/s (>3.20/s) | 2972.53ms | 9530.16ms (<12500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.92/s (>16.00/s) | 472.92ms | 492.72ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.23/s (>0.16/s) | 3412.05ms | 4064.75ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.43/s (>0.16/s) | 6823.95ms | 15451.19ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 9.65/s (>1.60/s) | 1951.82ms | 3932.18ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.28/s (>12.00/s) | 184.34ms | 276.66ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.13/s (>16.00/s) | 373.65ms | 1073.06ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.27/s (>16.00/s) | 257.51ms | 333.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.82/s (>8.00/s) | 630.81ms | 1008.81ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.98/s (>9.60/s) | 490.20ms | 752.20ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.47/s (>11.20/s) | 986.26ms | 2528.91ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.3/s (>16.00/s) | 289.99ms | 352.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.1/s (>9.60/s) | 381.11ms | 640.03ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 18.98/s (>16.00/s) | 94.33ms | 181.01ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.13/s (>16.00/s) | 80.29ms | 143.17ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.17/s (>16.00/s) | 87.39ms | 309.38ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.25/s (>9.60/s) | 115.53ms | 161.83ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|-----------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.18/s (>160.00/s) | 58.07ms | 62.39ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 135.73/s (>16.00/s) | 1331.21ms | 1528.80ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.72/s (>160.00/s) | 63.89ms | 68.79ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 143.27/s (>16.00/s) | 1258.49ms | 1469.42ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 53.55/s (>8.00/s) | 3325.87ms | 4004.15ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.93/s (>160.00/s) | 41.21ms | 42.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 181.88/s (>96.00/s) | 948.96ms | 1152.94ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 159.2/s (>96.00/s) | 734.34ms | 1075.78ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.93/s (>160.00/s) | 39.31ms | 41.01ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 155.75/s (>96.00/s) | 1149.24ms | 1480.56ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.63/s (>160.00/s) | 93.26ms | 101.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 27.25/s (>16.00/s) | 6009.00ms | 7328.50ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.58/s (>160.00/s) | 63.86ms | 68.45ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.5/s (>128.00/s) | 170.99ms | 225.55ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 55.37/s (>8.00/s) | 3216.36ms | 3907.90ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.53/s (>160.00/s) | 106.16ms | 115.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.93/s (>160.00/s) | 51.33ms | 53.92ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.35/s (>16.00/s) | 231.62ms | 315.27ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.07/s (>160.00/s) | 38.19ms | 39.15ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 105.88/s (>32.00/s) | 1703.33ms | 2085.32ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.72/s (>160.00/s) | 58.88ms | 61.68ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.78/s (>160.00/s) | 58.09ms | 60.83ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit | 200/s | 194.98/s (>160.00/s) | 101.30ms | 110.38ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_commit_diff | 200/s | 194.97/s (>160.00/s) | 107.98ms | 116.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.48/s (>160.00/s) | 141.38ms | 152.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 195.03/s (>160.00/s) | 105.49ms | 151.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 16.2/s (>1.60/s) | 9937.98ms | 11870.84ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.12/s (>160.00/s) | 98.70ms | 124.16ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.58/s (>160.00/s) | 70.13ms | 73.09ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.43/s (>48.00/s) | 557.81ms | 2293.83ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 162.07/s (>48.00/s) | 4804.11ms | 6357.97ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 191.62/s (>48.00/s) | 191.29ms | 317.21ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.05/s (>160.00/s) | 28.38ms | 29.05ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.5/s (>160.00/s) | 64.92ms | 68.95ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.7/s (>16.00/s) | 44.13ms | 44.39ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.72/s (>16.00/s) | 52.04ms | 60.88ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.43/s (>16.00/s) | 360.23ms | 520.02ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.05/s (>1.60/s) | 343.42ms | 352.60ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.03/s (>1.60/s) | 277.97ms | 651.82ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.2/s (>16.00/s) | 123.78ms | 178.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.18/s (>16.00/s) | 255.50ms | 304.84ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.97/s (>9.60/s) | 605.23ms | 745.49ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commit | 20/s | 6.0/s (>3.20/s) | 2849.71ms | 9449.93ms (<12500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.07/s (>16.00/s) | 422.87ms | 436.96ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.67/s (>0.16/s) | 3144.84ms | 3690.07ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.63/s (>0.16/s) | 6258.59ms | 14268.20ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 10.38/s (>1.60/s) | 1847.38ms | 3552.28ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.28/s (>12.00/s) | 177.99ms | 255.30ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.17/s (>16.00/s) | 334.82ms | 976.85ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.27/s (>16.00/s) | 237.26ms | 296.57ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.75/s (>8.00/s) | 633.96ms | 1013.32ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.75/s (>9.60/s) | 449.04ms | 672.70ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.32/s (>11.20/s) | 942.33ms | 2390.37ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.25/s (>16.00/s) | 266.31ms | 330.30ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.05/s (>9.60/s) | 358.75ms | 601.81ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.07/s (>16.00/s) | 87.64ms | 171.15ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.23/s (>16.00/s) | 72.36ms | 126.70ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.23/s (>16.00/s) | 85.35ms | 319.75ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.27/s (>9.60/s) | 109.85ms | 153.45ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |