|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/160283059)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1593134822199&to=1593138669769)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/160968299)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1593394003362&to=1593397830972)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.2.0-pre `31bed4c06fe`
|
|
|
* Environment Version: 13.2.0-pre `f2fb34779b0`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-06-26
|
|
|
* Run Time: 1h 4m 7.57s (Start: 01:27:02 UTC, End: 02:31:09 UTC)
|
|
|
* Date: 2020-06-29
|
|
|
* Run Time: 1h 3m 47.61s (Start: 01:26:43 UTC, End: 02:30:30 UTC)
|
|
|
* GPT Version: v2.0.3
|
|
|
|
|
|
❯ Overall Results Score: 97.37%
|
... | ... | @@ -15,64 +15,64 @@ |
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|--------
|
|
|
api_v4_groups | 200/s | 195.03/s (>160.00/s) | 61.17ms | 66.68ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 194.95/s (>160.00/s) | 60.20ms | 69.64ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.87/s (>160.00/s) | 53.22ms | 57.95ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 79.87/s (>32.00/s) | 2254.94ms | 2724.09ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 68.13/s (>32.00/s) | 2625.86ms | 3244.72ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.88/s (>160.00/s) | 41.81ms | 45.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 191.75/s (>96.00/s) | 244.87ms | 347.46ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 191.35/s (>96.00/s) | 285.65ms | 416.41ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.9/s (>160.00/s) | 39.33ms | 42.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 139.03/s (>96.00/s) | 1297.60ms | 1621.06ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.02/s (>160.00/s) | 101.83ms | 120.19ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.37/s (>160.00/s) | 99.82ms | 116.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 194.97/s (>160.00/s) | 67.83ms | 77.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 192.52/s (>128.00/s) | 194.39ms | 266.30ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 67.98/s (>32.00/s) | 2633.42ms | 3386.33ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.85/s (>160.00/s) | 107.60ms | 125.71ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.83/s (>160.00/s) | 53.23ms | 60.56ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.78/s (>16.00/s) | 231.27ms | 318.80ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.77/s (>160.00/s) | 39.34ms | 42.44ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 93.82/s (>32.00/s) | 1921.54ms | 2660.02ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.77/s (>160.00/s) | 57.17ms | 61.57ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.7/s (>160.00/s) | 59.63ms | 64.84ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.65/s (>160.00/s) | 59.11ms | 63.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.73/s (>160.00/s) | 52.71ms | 56.26ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.52/s (>160.00/s) | 141.91ms | 154.60ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.37/s (>160.00/s) | 130.86ms | 174.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 8.82/s (>1.60/s) | 15112.27ms | 21020.14ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.17/s (>160.00/s) | 100.20ms | 134.07ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.32/s (>160.00/s) | 84.59ms | 100.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 150.03/s (>48.00/s) | 5480.62ms | 6969.78ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 113.12/s (>48.00/s) | 7335.11ms | 9679.70ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 115.77/s (>48.00/s) | 6152.04ms | 8062.91ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.05/s (>160.00/s) | 29.59ms | 32.59ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.43/s (>160.00/s) | 66.31ms | 72.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 46.98ms | 50.44ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.68/s (>16.00/s) | 53.25ms | 65.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.2/s (>16.00/s) | 466.84ms | 702.27ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.02/s (>1.60/s) | 504.49ms | 517.35ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 1.98/s (>1.60/s) | 286.54ms | 713.20ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.27/s (>16.00/s) | 126.03ms | 160.49ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.17/s (>16.00/s) | 251.83ms | 318.27ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 19.02/s (>9.60/s) | 604.76ms | 772.36ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.13/s (>16.00/s) | 426.26ms | 505.51ms (<500ms) | 100.00% (>95%) | **{-FAILED-}**²
|
|
|
web_project_file_blame | 20/s | 3.15/s (>0.80/s) | 5489.86ms | 7132.90ms (<20000ms) | 99.46% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.48/s (>0.80/s) | 6471.38ms | 16411.91ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.17/s (>1.60/s) | 1580.01ms | 3224.64ms (<5000ms) | 99.85% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.52/s (>12.00/s) | 341.04ms | 444.43ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.03/s (>16.00/s) | 335.92ms | 976.96ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.35/s (>16.00/s) | 240.42ms | 324.09ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 13.37/s (>8.00/s) | 1586.56ms | 2240.47ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 19.0/s (>9.60/s) | 482.33ms | 851.58ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.48/s (>11.20/s) | 945.94ms | 2707.21ms (<4000ms) | 99.90% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.3/s (>16.00/s) | 267.28ms | 318.96ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.08/s (>9.60/s) | 315.27ms | 516.75ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 80.46ms | 164.97ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.13/s (>16.00/s) | 72.27ms | 134.98ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.23/s (>16.00/s) | 80.77ms | 251.17ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.33/s (>9.60/s) | 99.05ms | 130.17ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups | 200/s | 194.98/s (>160.00/s) | 60.81ms | 66.95ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 195.23/s (>160.00/s) | 58.97ms | 68.60ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.87/s (>160.00/s) | 52.46ms | 56.94ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 78.98/s (>32.00/s) | 2278.52ms | 2754.66ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 68.28/s (>32.00/s) | 2625.88ms | 3245.77ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.93/s (>160.00/s) | 41.34ms | 43.38ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 192.2/s (>96.00/s) | 231.14ms | 324.67ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 191.53/s (>96.00/s) | 278.51ms | 401.35ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.88/s (>160.00/s) | 39.00ms | 41.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 159.53/s (>96.00/s) | 1122.45ms | 1414.94ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.0/s (>160.00/s) | 95.41ms | 108.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.38/s (>160.00/s) | 94.45ms | 106.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.45/s (>160.00/s) | 65.22ms | 71.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 192.77/s (>128.00/s) | 184.39ms | 248.63ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 68.78/s (>32.00/s) | 2604.73ms | 3254.40ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.85/s (>160.00/s) | 103.69ms | 116.61ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.85/s (>160.00/s) | 51.50ms | 55.23ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.05/s (>16.00/s) | 222.01ms | 298.63ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.72/s (>160.00/s) | 38.55ms | 41.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 98.87/s (>32.00/s) | 1825.70ms | 2780.30ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.78/s (>160.00/s) | 56.75ms | 59.88ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.68/s (>160.00/s) | 59.63ms | 64.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.63/s (>160.00/s) | 59.19ms | 62.70ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.83/s (>160.00/s) | 52.85ms | 55.70ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.52/s (>160.00/s) | 146.85ms | 160.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.47/s (>160.00/s) | 132.70ms | 178.43ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 8.85/s (>1.60/s) | 15155.25ms | 21635.44ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.07/s (>160.00/s) | 104.80ms | 129.38ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.4/s (>160.00/s) | 85.37ms | 100.99ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 174.83/s (>48.00/s) | 3994.26ms | 5294.25ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 125.37/s (>48.00/s) | 6621.28ms | 8790.43ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 130.7/s (>48.00/s) | 5435.77ms | 7108.29ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.1/s (>160.00/s) | 28.61ms | 30.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.43/s (>160.00/s) | 65.92ms | 71.10ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.58/s (>16.00/s) | 43.62ms | 45.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.7/s (>16.00/s) | 51.00ms | 60.50ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.08/s (>16.00/s) | 442.03ms | 689.40ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.02/s (>1.60/s) | 485.06ms | 496.01ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 283.77ms | 687.09ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.23/s (>16.00/s) | 110.60ms | 128.15ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.15/s (>16.00/s) | 247.87ms | 313.26ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.98/s (>9.60/s) | 656.54ms | 863.75ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.05/s (>16.00/s) | 433.05ms | 505.02ms (<500ms) | 100.00% (>95%) | **{-FAILED-}**²
|
|
|
web_project_file_blame | 20/s | 3.1/s (>0.80/s) | 5576.66ms | 6946.68ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.47/s (>0.80/s) | 6563.76ms | 16841.01ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.02/s (>1.60/s) | 1603.36ms | 3217.44ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.38/s (>12.00/s) | 332.00ms | 449.57ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.1/s (>16.00/s) | 339.36ms | 1024.90ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.27/s (>16.00/s) | 236.87ms | 303.45ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 12.7/s (>8.00/s) | 1674.90ms | 2336.18ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.9/s (>9.60/s) | 486.97ms | 835.45ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.63/s (>11.20/s) | 916.88ms | 2582.84ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.28/s (>16.00/s) | 265.39ms | 327.97ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.12/s (>9.60/s) | 302.10ms | 485.50ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 18.93/s (>16.00/s) | 76.46ms | 164.85ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.18/s (>16.00/s) | 68.97ms | 129.26ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.23/s (>16.00/s) | 77.40ms | 242.76ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.33/s (>9.60/s) | 93.33ms | 127.85ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
|
|
|
|
|
|
² Failure may not be clear from summary alone. Refer to the individual test's full output for further debugging. |