|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/159846414)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1593048584968&to=1593052358445)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/160283059)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1593134822199&to=1593138669769)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.2.0-pre `60b7c3bce82`
|
|
|
* Environment Version: 13.2.0-pre `31bed4c06fe`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-06-25
|
|
|
* Run Time: 1h 2m 53.48s (Start: 01:29:44 UTC, End: 02:32:38 UTC)
|
|
|
* Date: 2020-06-26
|
|
|
* Run Time: 1h 4m 7.57s (Start: 01:27:02 UTC, End: 02:31:09 UTC)
|
|
|
* GPT Version: v2.0.3
|
|
|
|
|
|
❯ Overall Results Score: 97.43%
|
|
|
❯ Overall Results Score: 97.37%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.2/s (>160.00/s) | 57.73ms | 63.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 195.38/s (>160.00/s) | 58.14ms | 71.13ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.82/s (>160.00/s) | 49.69ms | 54.20ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 83.02/s (>32.00/s) | 2168.99ms | 2445.87ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 69.95/s (>32.00/s) | 2557.66ms | 3062.22ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.97/s (>160.00/s) | 39.57ms | 42.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 192.93/s (>96.00/s) | 214.65ms | 301.83ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 191.68/s (>96.00/s) | 220.74ms | 310.54ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.77/s (>160.00/s) | 37.05ms | 39.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 144.55/s (>96.00/s) | 1247.50ms | 1548.32ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.97/s (>160.00/s) | 95.32ms | 118.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.48/s (>160.00/s) | 90.67ms | 109.34ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.23/s (>160.00/s) | 62.36ms | 70.59ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.55/s (>128.00/s) | 169.97ms | 226.82ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 71.77/s (>32.00/s) | 2499.90ms | 2943.40ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.88/s (>160.00/s) | 101.50ms | 121.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.83/s (>160.00/s) | 49.71ms | 55.43ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.05/s (>16.00/s) | 225.69ms | 303.41ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.15/s (>160.00/s) | 36.65ms | 40.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 97.73/s (>32.00/s) | 1832.03ms | 2465.97ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.8/s (>160.00/s) | 54.72ms | 59.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.7/s (>160.00/s) | 56.89ms | 61.24ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.77/s (>160.00/s) | 56.61ms | 61.49ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.87/s (>160.00/s) | 50.70ms | 53.44ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.55/s (>160.00/s) | 141.23ms | 153.65ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.48/s (>160.00/s) | 129.15ms | 173.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 9.18/s (>1.60/s) | 14632.44ms | 19262.04ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.07/s (>160.00/s) | 101.49ms | 117.55ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.52/s (>160.00/s) | 83.33ms | 93.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 162.78/s (>48.00/s) | 4887.45ms | 6419.07ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 119.75/s (>48.00/s) | 6903.65ms | 9179.65ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 125.43/s (>48.00/s) | 5586.97ms | 7454.46ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.12/s (>160.00/s) | 27.59ms | 29.66ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.55/s (>160.00/s) | 62.09ms | 70.29ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.6/s (>16.00/s) | 43.81ms | 45.81ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.72/s (>16.00/s) | 50.39ms | 61.51ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.3/s (>16.00/s) | 437.44ms | 682.14ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 480.42ms | 533.14ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.0/s (>1.60/s) | 279.34ms | 658.71ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.13/s (>16.00/s) | 119.39ms | 159.43ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.17/s (>16.00/s) | 235.81ms | 299.30ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 19.03/s (>9.60/s) | 584.17ms | 709.93ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.08/s (>16.00/s) | 407.20ms | 432.15ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 3.28/s (>0.80/s) | 5244.32ms | 5899.61ms (<20000ms) | 99.48% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.65/s (>0.80/s) | 6281.60ms | 14154.20ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 11.97/s (>1.60/s) | 1595.67ms | 3261.59ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.28/s (>12.00/s) | 348.19ms | 587.01ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.0/s (>16.00/s) | 332.60ms | 972.38ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.3/s (>16.00/s) | 223.47ms | 289.44ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 13.15/s (>8.00/s) | 1600.89ms | 2211.46ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.82/s (>9.60/s) | 453.25ms | 695.51ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.63/s (>11.20/s) | 885.23ms | 2288.38ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.32/s (>16.00/s) | 246.90ms | 302.80ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.08/s (>9.60/s) | 286.88ms | 463.50ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 71.97ms | 134.70ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.18/s (>16.00/s) | 67.80ms | 120.50ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.2/s (>16.00/s) | 73.21ms | 212.33ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.33/s (>9.60/s) | 92.58ms | 122.06ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|--------
|
|
|
api_v4_groups | 200/s | 195.03/s (>160.00/s) | 61.17ms | 66.68ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 194.95/s (>160.00/s) | 60.20ms | 69.64ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.87/s (>160.00/s) | 53.22ms | 57.95ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 79.87/s (>32.00/s) | 2254.94ms | 2724.09ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 68.13/s (>32.00/s) | 2625.86ms | 3244.72ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.88/s (>160.00/s) | 41.81ms | 45.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 191.75/s (>96.00/s) | 244.87ms | 347.46ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 191.35/s (>96.00/s) | 285.65ms | 416.41ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.9/s (>160.00/s) | 39.33ms | 42.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 139.03/s (>96.00/s) | 1297.60ms | 1621.06ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.02/s (>160.00/s) | 101.83ms | 120.19ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.37/s (>160.00/s) | 99.82ms | 116.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 194.97/s (>160.00/s) | 67.83ms | 77.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 192.52/s (>128.00/s) | 194.39ms | 266.30ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 67.98/s (>32.00/s) | 2633.42ms | 3386.33ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.85/s (>160.00/s) | 107.60ms | 125.71ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.83/s (>160.00/s) | 53.23ms | 60.56ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.78/s (>16.00/s) | 231.27ms | 318.80ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.77/s (>160.00/s) | 39.34ms | 42.44ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 93.82/s (>32.00/s) | 1921.54ms | 2660.02ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.77/s (>160.00/s) | 57.17ms | 61.57ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.7/s (>160.00/s) | 59.63ms | 64.84ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.65/s (>160.00/s) | 59.11ms | 63.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.73/s (>160.00/s) | 52.71ms | 56.26ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.52/s (>160.00/s) | 141.91ms | 154.60ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.37/s (>160.00/s) | 130.86ms | 174.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 8.82/s (>1.60/s) | 15112.27ms | 21020.14ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.17/s (>160.00/s) | 100.20ms | 134.07ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.32/s (>160.00/s) | 84.59ms | 100.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 150.03/s (>48.00/s) | 5480.62ms | 6969.78ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 113.12/s (>48.00/s) | 7335.11ms | 9679.70ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 115.77/s (>48.00/s) | 6152.04ms | 8062.91ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.05/s (>160.00/s) | 29.59ms | 32.59ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.43/s (>160.00/s) | 66.31ms | 72.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 46.98ms | 50.44ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.68/s (>16.00/s) | 53.25ms | 65.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.2/s (>16.00/s) | 466.84ms | 702.27ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.02/s (>1.60/s) | 504.49ms | 517.35ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 1.98/s (>1.60/s) | 286.54ms | 713.20ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.27/s (>16.00/s) | 126.03ms | 160.49ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.17/s (>16.00/s) | 251.83ms | 318.27ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 19.02/s (>9.60/s) | 604.76ms | 772.36ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.13/s (>16.00/s) | 426.26ms | 505.51ms (<500ms) | 100.00% (>95%) | **{-FAILED-}**²
|
|
|
web_project_file_blame | 20/s | 3.15/s (>0.80/s) | 5489.86ms | 7132.90ms (<20000ms) | 99.46% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.48/s (>0.80/s) | 6471.38ms | 16411.91ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.17/s (>1.60/s) | 1580.01ms | 3224.64ms (<5000ms) | 99.85% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.52/s (>12.00/s) | 341.04ms | 444.43ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.03/s (>16.00/s) | 335.92ms | 976.96ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.35/s (>16.00/s) | 240.42ms | 324.09ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 13.37/s (>8.00/s) | 1586.56ms | 2240.47ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 19.0/s (>9.60/s) | 482.33ms | 851.58ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.48/s (>11.20/s) | 945.94ms | 2707.21ms (<4000ms) | 99.90% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.3/s (>16.00/s) | 267.28ms | 318.96ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.08/s (>9.60/s) | 315.27ms | 516.75ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 80.46ms | 164.97ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.13/s (>16.00/s) | 72.27ms | 134.98ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.23/s (>16.00/s) | 80.77ms | 251.17ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.33/s (>9.60/s) | 99.05ms | 130.17ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
|
|
|
|
|
|
² Failure may not be clear from summary alone. Refer to the individual test's full output for further debugging. |