|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/161090877)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1593424688559&to=1593428480820)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/161373502)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1593480442615&to=1593484304007)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.2.0-pre `f2fb34779b0`
|
|
|
* Environment Version: 13.2.0-pre `744484487f2`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-06-29
|
|
|
* Run Time: 1h 3m 12.26s (Start: 09:58:08 UTC, End: 11:01:20 UTC)
|
|
|
* Date: 2020-06-30
|
|
|
* Run Time: 1h 4m 21.39s (Start: 01:27:22 UTC, End: 02:31:44 UTC)
|
|
|
* GPT Version: v2.0.3
|
|
|
|
|
|
❯ Overall Results Score: 97.35%
|
|
|
❯ Overall Results Score: 96.48%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.25/s (>160.00/s) | 56.92ms | 61.65ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 195.05/s (>160.00/s) | 107.26ms | 177.79ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.95/s (>160.00/s) | 51.38ms | 54.18ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 81.37/s (>32.00/s) | 2208.81ms | 2516.04ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 67.47/s (>32.00/s) | 2655.85ms | 3167.66ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.93/s (>160.00/s) | 41.23ms | 43.07ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 191.87/s (>96.00/s) | 370.84ms | 770.82ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 191.22/s (>96.00/s) | 335.32ms | 483.81ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.82/s (>160.00/s) | 38.78ms | 41.70ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 130.38/s (>96.00/s) | 1384.46ms | 1716.86ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.78/s (>160.00/s) | 107.72ms | 127.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.4/s (>160.00/s) | 105.99ms | 130.22ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.4/s (>160.00/s) | 65.85ms | 73.07ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 192.68/s (>128.00/s) | 187.21ms | 246.42ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 70.92/s (>32.00/s) | 2529.04ms | 3023.48ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.55/s (>160.00/s) | 112.43ms | 130.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.82/s (>160.00/s) | 51.11ms | 54.06ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.27/s (>16.00/s) | 225.67ms | 296.27ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.88/s (>160.00/s) | 37.95ms | 39.52ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 84.35/s (>32.00/s) | 2123.26ms | 3072.55ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.77/s (>160.00/s) | 56.16ms | 58.94ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.77/s (>160.00/s) | 57.90ms | 60.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.77/s (>160.00/s) | 58.48ms | 62.53ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.78/s (>160.00/s) | 51.64ms | 53.78ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.5/s (>160.00/s) | 143.28ms | 154.57ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.55/s (>160.00/s) | 130.47ms | 173.92ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 9.18/s (>1.60/s) | 14433.23ms | 19370.34ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.02/s (>160.00/s) | 100.07ms | 116.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.4/s (>160.00/s) | 83.22ms | 94.11ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 130.42/s (>48.00/s) | 6550.73ms | 8171.47ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 101.93/s (>48.00/s) | 8127.75ms | 10658.34ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 101.85/s (>48.00/s) | 7063.59ms | 9100.65ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 195.98/s (>160.00/s) | 28.19ms | 29.66ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.55/s (>160.00/s) | 64.86ms | 68.89ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.62/s (>16.00/s) | 43.38ms | 44.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.75/s (>16.00/s) | 50.74ms | 60.11ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.23/s (>16.00/s) | 480.18ms | 740.91ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.0/s (>1.60/s) | 526.50ms | 552.61ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 280.56ms | 667.52ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.13/s (>16.00/s) | 111.60ms | 143.80ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.12/s (>16.00/s) | 242.42ms | 299.71ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.97/s (>9.60/s) | 638.00ms | 779.17ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.0/s (>16.00/s) | 412.51ms | 437.05ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 3.33/s (>0.80/s) | 5243.30ms | 5896.50ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.75/s (>0.80/s) | 6239.71ms | 13823.24ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.27/s (>1.60/s) | 1560.96ms | 3210.81ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.33/s (>12.00/s) | 333.67ms | 335.13ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.1/s (>16.00/s) | 322.83ms | 944.22ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.28/s (>16.00/s) | 225.48ms | 287.61ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.87/s (>8.00/s) | 640.11ms | 1000.87ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 19.0/s (>9.60/s) | 452.96ms | 697.52ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.67/s (>11.20/s) | 897.47ms | 2352.68ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.27/s (>16.00/s) | 254.92ms | 317.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.03/s (>9.60/s) | 295.12ms | 480.66ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 18.95/s (>16.00/s) | 79.51ms | 174.15ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.25/s (>16.00/s) | 69.38ms | 120.18ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.15/s (>16.00/s) | 76.28ms | 218.84ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.27/s (>9.60/s) | 96.01ms | 128.54ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|--------
|
|
|
api_v4_groups | 200/s | 194.92/s (>160.00/s) | 66.23ms | 72.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 195.32/s (>160.00/s) | 70.90ms | 88.78ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.5/s (>160.00/s) | 70.58ms | 78.01ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 134.27/s (>32.00/s) | 1345.52ms | 1578.46ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 50.68/s (>32.00/s) | 3490.03ms | 4244.82ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.92/s (>160.00/s) | 45.55ms | 48.54ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 192.83/s (>96.00/s) | 330.98ms | 467.78ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.22/s (>96.00/s) | 383.37ms | 561.58ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.93/s (>160.00/s) | 42.46ms | 45.30ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 144.27/s (>96.00/s) | 1245.66ms | 1570.45ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.92/s (>160.00/s) | 110.49ms | 135.42ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.23/s (>160.00/s) | 111.35ms | 132.29ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.32/s (>160.00/s) | 69.71ms | 76.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.65/s (>128.00/s) | 197.48ms | 262.38ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 54.2/s (>32.00/s) | 3287.47ms | 4007.97ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 132.98/s (>160.00/s) | 1342.04ms | 1782.91ms (<500ms) | 100.00% (>95%) | **{-FAILED-}**²
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.6/s (>160.00/s) | 81.66ms | 114.10ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.1/s (>16.00/s) | 312.37ms | 500.30ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.82/s (>160.00/s) | 52.24ms | 62.45ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 92.67/s (>32.00/s) | 1940.92ms | 2778.27ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.43/s (>160.00/s) | 76.12ms | 92.61ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.35/s (>160.00/s) | 72.10ms | 81.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 194.58/s (>160.00/s) | 151.47ms | 219.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.68/s (>160.00/s) | 64.77ms | 73.90ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.47/s (>160.00/s) | 161.73ms | 184.26ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.33/s (>160.00/s) | 142.23ms | 188.47ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 9.15/s (>1.60/s) | 14584.32ms | 19665.87ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.92/s (>160.00/s) | 103.98ms | 124.77ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.28/s (>160.00/s) | 88.34ms | 101.76ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 129.85/s (>48.00/s) | 6378.28ms | 7961.75ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 99.08/s (>48.00/s) | 8386.54ms | 11078.14ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 99.52/s (>48.00/s) | 7224.01ms | 9252.62ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.03/s (>160.00/s) | 30.34ms | 32.47ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.28/s (>160.00/s) | 78.83ms | 97.49ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.67/s (>16.00/s) | 55.55ms | 58.02ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.68/s (>16.00/s) | 65.20ms | 76.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.37/s (>16.00/s) | 490.08ms | 754.41ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.0/s (>1.60/s) | 549.87ms | 573.91ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 1.98/s (>1.60/s) | 381.04ms | 858.81ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.25/s (>16.00/s) | 153.63ms | 196.63ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.17/s (>16.00/s) | 285.08ms | 343.05ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.92/s (>9.60/s) | 656.14ms | 817.14ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.97/s (>16.00/s) | 455.08ms | 483.52ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 3.25/s (>0.80/s) | 5355.46ms | 6027.83ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.6/s (>0.80/s) | 6445.27ms | 14195.58ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.1/s (>1.60/s) | 1595.47ms | 3251.09ms (<5000ms) | 99.85% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.48/s (>12.00/s) | 328.82ms | 359.08ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.15/s (>16.00/s) | 334.51ms | 980.79ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.35/s (>16.00/s) | 241.07ms | 306.11ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.87/s (>8.00/s) | 678.01ms | 1043.21ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.87/s (>9.60/s) | 474.43ms | 721.25ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.65/s (>11.20/s) | 924.03ms | 2423.84ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.32/s (>16.00/s) | 273.99ms | 338.53ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.05/s (>9.60/s) | 326.71ms | 523.24ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.32/s (>16.00/s) | 84.40ms | 179.31ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.33/s (>16.00/s) | 75.13ms | 139.61ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.12/s (>16.00/s) | 83.99ms | 246.90ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.37/s (>9.60/s) | 115.31ms | 165.17ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
|
|
|
|
|
|
² Failure may not be clear from summary alone. Refer to the individual test's full output for further debugging. |