|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/166759769)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1594804225159&to=1594808020890)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/167143594)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1594862683840&to=1594866471669)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.2.0-pre `3064cb316d7`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-07-15
|
|
|
* Run Time: 1h 3m 15.73s (Start: 09:10:25 UTC, End: 10:13:40 UTC)
|
|
|
* Date: 2020-07-16
|
|
|
* Run Time: 1h 3m 7.83s (Start: 01:24:43 UTC, End: 02:27:51 UTC)
|
|
|
* GPT Version: v2.0.5
|
|
|
|
|
|
❯ Overall Results Score: 97.31%
|
|
|
❯ Overall Results Score: 97.36%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 194.92/s (>160.00/s) | 69.18ms | 80.78ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 114.28/s (>16.00/s) | 1581.85ms | 1764.20ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.5/s (>160.00/s) | 74.25ms | 83.84ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 121.62/s (>16.00/s) | 1487.88ms | 1704.34ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 39.48/s (>8.00/s) | 4461.21ms | 6082.69ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.98/s (>160.00/s) | 45.67ms | 48.90ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 157.03/s (>96.00/s) | 1144.23ms | 1362.40ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 172.28/s (>96.00/s) | 986.10ms | 1666.78ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.82/s (>160.00/s) | 44.61ms | 48.75ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 141.53/s (>96.00/s) | 1265.28ms | 1595.68ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.67/s (>160.00/s) | 105.49ms | 120.27ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 24.63/s (>16.00/s) | 6627.16ms | 8321.25ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.12/s (>160.00/s) | 74.37ms | 82.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 191.72/s (>128.00/s) | 292.59ms | 412.96ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 45.28/s (>8.00/s) | 3906.44ms | 4735.64ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.58/s (>160.00/s) | 125.10ms | 144.35ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.68/s (>160.00/s) | 58.37ms | 63.70ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.65/s (>16.00/s) | 252.66ms | 406.11ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.07/s (>160.00/s) | 42.91ms | 45.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 104.83/s (>32.00/s) | 1719.44ms | 2462.73ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.7/s (>160.00/s) | 63.60ms | 68.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.48/s (>160.00/s) | 66.24ms | 71.75ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.62/s (>160.00/s) | 65.78ms | 70.65ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.7/s (>160.00/s) | 57.76ms | 61.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.25/s (>160.00/s) | 156.84ms | 174.41ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.27/s (>160.00/s) | 144.09ms | 191.17ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 16.07/s (>1.60/s) | 10286.13ms | 12854.78ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.0/s (>160.00/s) | 107.70ms | 129.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.3/s (>160.00/s) | 91.43ms | 105.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.88/s (>48.00/s) | 507.09ms | 1938.92ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 146.7/s (>48.00/s) | 5621.74ms | 7190.27ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 168.93/s (>48.00/s) | 3636.38ms | 5070.07ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 195.97/s (>160.00/s) | 32.14ms | 34.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.18/s (>160.00/s) | 73.05ms | 80.90ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.65/s (>16.00/s) | 48.29ms | 50.50ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.72/s (>16.00/s) | 59.03ms | 74.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.42/s (>16.00/s) | 376.67ms | 555.80ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 389.64ms | 397.40ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 1.98/s (>1.60/s) | 307.44ms | 748.89ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.32/s (>16.00/s) | 136.55ms | 191.36ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.12/s (>16.00/s) | 280.09ms | 334.71ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.95/s (>9.60/s) | 648.71ms | 791.05ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.93/s (>16.00/s) | 478.94ms | 503.50ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.25/s (>0.16/s) | 3387.79ms | 4028.57ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.33/s (>0.16/s) | 7066.08ms | 16638.26ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 11.47/s (>1.60/s) | 1669.15ms | 3419.50ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.4/s (>12.00/s) | 340.93ms | 380.64ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.17/s (>16.00/s) | 381.96ms | 1130.07ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.18/s (>16.00/s) | 267.94ms | 333.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.68/s (>8.00/s) | 699.40ms | 1118.70ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.8/s (>9.60/s) | 519.36ms | 784.72ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 17.8/s (>11.20/s) | 1055.11ms | 2700.38ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.25/s (>16.00/s) | 298.79ms | 360.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.03/s (>9.60/s) | 344.26ms | 554.32ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.1/s (>16.00/s) | 86.77ms | 179.10ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.1/s (>16.00/s) | 81.25ms | 156.20ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.13/s (>16.00/s) | 89.78ms | 250.39ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.22/s (>9.60/s) | 112.16ms | 156.55ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
api_v4_groups | 200/s | 194.47/s (>160.00/s) | 66.25ms | 76.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 131.65/s (>16.00/s) | 1370.61ms | 1605.06ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.55/s (>160.00/s) | 70.84ms | 77.86ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 136.37/s (>16.00/s) | 1322.17ms | 1588.80ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 50.57/s (>8.00/s) | 3514.18ms | 4233.67ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.92/s (>160.00/s) | 45.26ms | 47.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 173.62/s (>96.00/s) | 1002.08ms | 1250.77ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 190.25/s (>96.00/s) | 400.06ms | 569.50ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.75/s (>160.00/s) | 42.36ms | 44.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 147.83/s (>96.00/s) | 1217.08ms | 1532.21ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.83/s (>160.00/s) | 101.32ms | 113.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 25.75/s (>16.00/s) | 6409.03ms | 8223.60ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.15/s (>160.00/s) | 72.10ms | 79.04ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 191.97/s (>128.00/s) | 207.68ms | 282.98ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 51.53/s (>8.00/s) | 3448.51ms | 4177.33ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.5/s (>160.00/s) | 116.42ms | 130.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.83/s (>160.00/s) | 56.58ms | 60.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.65/s (>16.00/s) | 257.13ms | 458.67ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.02/s (>160.00/s) | 41.41ms | 43.16ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 93.03/s (>32.00/s) | 1920.61ms | 3047.91ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.82/s (>160.00/s) | 60.82ms | 64.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.63/s (>160.00/s) | 64.96ms | 69.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.68/s (>160.00/s) | 62.26ms | 65.56ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.87/s (>160.00/s) | 55.56ms | 58.26ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.37/s (>160.00/s) | 147.74ms | 159.99ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.45/s (>160.00/s) | 137.56ms | 180.26ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 15.75/s (>1.60/s) | 10368.46ms | 12383.70ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.95/s (>160.00/s) | 102.86ms | 136.94ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.25/s (>160.00/s) | 87.47ms | 101.26ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.18/s (>48.00/s) | 476.92ms | 1867.39ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 157.18/s (>48.00/s) | 5119.66ms | 6695.74ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 182.63/s (>48.00/s) | 1964.54ms | 2886.05ms (<25000ms) | 99.97% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 195.97/s (>160.00/s) | 31.73ms | 33.09ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.33/s (>160.00/s) | 71.92ms | 77.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.6/s (>16.00/s) | 47.40ms | 48.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.7/s (>16.00/s) | 55.07ms | 64.79ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.4/s (>16.00/s) | 362.82ms | 529.29ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 390.18ms | 410.78ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.03/s (>1.60/s) | 306.38ms | 697.26ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.1/s (>16.00/s) | 132.96ms | 176.74ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.05/s (>16.00/s) | 269.59ms | 321.66ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.93/s (>9.60/s) | 623.11ms | 772.96ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.98/s (>16.00/s) | 442.00ms | 489.29ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.6/s (>0.16/s) | 3176.13ms | 3704.62ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.5/s (>0.16/s) | 6484.21ms | 16020.11ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.07/s (>1.60/s) | 1590.40ms | 3261.26ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.45/s (>12.00/s) | 332.41ms | 357.72ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.0/s (>16.00/s) | 348.57ms | 1039.66ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.27/s (>16.00/s) | 251.08ms | 316.84ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.8/s (>8.00/s) | 661.29ms | 1061.33ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 19.05/s (>9.60/s) | 476.01ms | 752.15ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.5/s (>11.20/s) | 955.40ms | 2568.28ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.28/s (>16.00/s) | 284.96ms | 351.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.08/s (>9.60/s) | 320.64ms | 509.60ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.15/s (>16.00/s) | 81.99ms | 168.19ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.28/s (>16.00/s) | 73.08ms | 123.80ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.03/s (>16.00/s) | 83.47ms | 244.30ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.28/s (>9.60/s) | 107.74ms | 149.83ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |