|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/166198284)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1594690046938&to=1594693825298)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/166386777)
|
|
|
* [Metrics Dashboard](http://35.196.117.149//-/grafana/d/tVdO8YIWz/server-performance?from=1594728943887&to=1594732326521)
|
|
|
* [Results History Dashboard](http://35.196.117.149/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.2.0-pre `e36fb51ac82`
|
|
|
* Environment Version: 12.6.0-ee `11ac4a9aa21`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-07-14
|
|
|
* Run Time: 1h 2m 58.36s (Start: 01:27:26 UTC, End: 02:30:25 UTC)
|
|
|
* Run Time: 56m 22.63s (Start: 12:15:43 UTC, End: 13:12:06 UTC)
|
|
|
* GPT Version: v2.0.5
|
|
|
|
|
|
❯ Overall Results Score: 97.43%
|
|
|
❯ Overall Results Score: 97.13%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.15/s (>160.00/s) | 62.64ms | 68.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 130.15/s (>16.00/s) | 1387.23ms | 1603.50ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.62/s (>160.00/s) | 69.88ms | 77.63ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 134.13/s (>16.00/s) | 1346.57ms | 1609.28ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 51.05/s (>8.00/s) | 3484.38ms | 4381.22ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.88/s (>160.00/s) | 43.81ms | 47.10ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 180.58/s (>96.00/s) | 949.28ms | 1195.95ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 191.18/s (>96.00/s) | 357.41ms | 512.81ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.83/s (>160.00/s) | 41.10ms | 43.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 156.52/s (>96.00/s) | 1143.06ms | 1457.24ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.05/s (>160.00/s) | 93.66ms | 103.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 25.88/s (>16.00/s) | 6390.38ms | 8050.48ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.38/s (>160.00/s) | 68.45ms | 74.44ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 192.52/s (>128.00/s) | 189.69ms | 257.39ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 51.45/s (>8.00/s) | 3453.79ms | 4343.72ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.57/s (>160.00/s) | 110.78ms | 123.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.83/s (>160.00/s) | 56.07ms | 62.07ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.87/s (>16.00/s) | 232.96ms | 337.21ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.78/s (>160.00/s) | 40.98ms | 44.68ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 101.73/s (>32.00/s) | 1770.51ms | 2515.01ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.68/s (>160.00/s) | 59.37ms | 63.45ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.67/s (>160.00/s) | 61.97ms | 66.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.58/s (>160.00/s) | 61.20ms | 65.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.78/s (>160.00/s) | 55.28ms | 58.99ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.35/s (>160.00/s) | 150.93ms | 165.24ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.48/s (>160.00/s) | 139.31ms | 189.50ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 16.1/s (>1.60/s) | 10054.03ms | 15197.41ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.73/s (>160.00/s) | 105.75ms | 128.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.32/s (>160.00/s) | 87.72ms | 98.89ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.47/s (>48.00/s) | 325.65ms | 902.16ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 169.25/s (>48.00/s) | 4331.78ms | 5897.32ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 190.68/s (>48.00/s) | 287.25ms | 539.13ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 195.87/s (>160.00/s) | 30.53ms | 33.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.45/s (>160.00/s) | 68.09ms | 75.11ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.67/s (>16.00/s) | 47.59ms | 51.20ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.72/s (>16.00/s) | 53.41ms | 65.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.43/s (>16.00/s) | 353.03ms | 514.83ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 396.61ms | 409.54ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 260.78ms | 629.01ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.22/s (>16.00/s) | 127.40ms | 179.02ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.15/s (>16.00/s) | 255.58ms | 325.28ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.95/s (>9.60/s) | 607.93ms | 767.01ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.98/s (>16.00/s) | 438.39ms | 474.40ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.57/s (>0.16/s) | 3198.18ms | 3871.54ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.45/s (>0.16/s) | 6579.17ms | 16253.95ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 11.93/s (>1.60/s) | 1616.12ms | 3392.55ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.53/s (>12.00/s) | 333.15ms | 388.17ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.07/s (>16.00/s) | 348.21ms | 1050.54ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.35/s (>16.00/s) | 242.06ms | 322.97ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 12.45/s (>8.00/s) | 1699.64ms | 2373.86ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.83/s (>9.60/s) | 479.81ms | 751.55ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.38/s (>11.20/s) | 972.96ms | 2565.16ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.35/s (>16.00/s) | 271.74ms | 331.61ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.07/s (>9.60/s) | 317.15ms | 541.67ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.12/s (>16.00/s) | 82.19ms | 191.83ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.28/s (>16.00/s) | 74.61ms | 135.56ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.02/s (>16.00/s) | 81.88ms | 233.20ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.22/s (>9.60/s) | 104.22ms | 136.93ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|----------------|--------
|
|
|
api_v4_groups | 200/s | 195.8/s (>160.00/s) | 53.55ms | 60.99ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 161.45/s (>16.00/s) | 1110.83ms | 1529.14ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.63/s (>160.00/s) | 61.23ms | 69.70ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 160.2/s (>16.00/s) | 1122.79ms | 1587.28ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 70.58/s (>8.00/s) | 2543.25ms | 3455.18ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 196.02/s (>160.00/s) | 39.25ms | 45.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 162.57/s (>96.00/s) | 1099.55ms | 1465.23ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 191.25/s (>96.00/s) | 525.95ms | 975.91ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.92/s (>160.00/s) | 37.30ms | 41.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 159.58/s (>96.00/s) | 1124.31ms | 1399.48ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.92/s (>160.00/s) | 103.31ms | 125.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 31.28/s (>16.00/s) | 5218.52ms | 6794.99ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.63/s (>160.00/s) | 60.37ms | 70.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 78.53/s (>128.00/s) | 2282.28ms | 3301.45ms (<1500ms) | 100.00% (>95%) | **{-FAILED-}**²
|
|
|
api_v4_projects_project | 200/s | 195.0/s (>160.00/s) | 100.79ms | 121.81ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.68/s (>160.00/s) | 54.59ms | 62.24ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 194.7/s (>16.00/s) | 125.80ms | 139.32ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 47.88/s (>32.00/s) | 3622.54ms | 6397.65ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.75/s (>160.00/s) | 52.21ms | 59.16ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.67/s (>160.00/s) | 52.88ms | 56.38ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.9/s (>160.00/s) | 51.08ms | 53.34ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.88/s (>160.00/s) | 50.27ms | 52.47ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.73/s (>160.00/s) | 133.63ms | 145.55ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.62/s (>160.00/s) | 128.50ms | 162.76ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 15.48/s (>1.60/s) | 10557.05ms | 13448.99ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.57/s (>160.00/s) | 97.25ms | 110.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.5/s (>160.00/s) | 80.95ms | 99.55ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.28/s (>160.00/s) | 24.85ms | 25.79ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 196.22/s (>160.00/s) | 31.02ms | 32.80ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.65/s (>16.00/s) | 43.88ms | 46.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.73/s (>16.00/s) | 50.72ms | 57.46ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.2/s (>16.00/s) | 610.66ms | 1037.07ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 1.95/s (>1.60/s) | 692.47ms | 728.16ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.05/s (>1.60/s) | 172.53ms | 251.71ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 16.68/s (>16.00/s) | 1093.29ms | 2274.14ms (<500ms) | 100.00% (>95%) | **{-FAILED-}**²
|
|
|
web_project | 20/s | 19.18/s (>16.00/s) | 263.25ms | 314.32ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.85/s (>9.60/s) | 800.38ms | 944.91ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.03/s (>16.00/s) | 433.42ms | 474.02ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 3.07/s (>0.16/s) | 5679.57ms | 6164.27ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.15/s (>0.16/s) | 7692.51ms | 19631.00ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.68/s (>1.60/s) | 1495.92ms | 2973.21ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 8.33/s (>12.00/s) | 2147.38ms | 2998.93ms (<2500ms) | 100.00% (>95%) | **{-FAILED-}**²
|
|
|
web_project_issue | 20/s | 19.17/s (>16.00/s) | 295.32ms | 905.81ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.37/s (>16.00/s) | 245.09ms | 297.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.82/s (>9.60/s) | 529.31ms | 834.42ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.67/s (>11.20/s) | 908.60ms | 2466.25ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.35/s (>16.00/s) | 241.38ms | 294.53ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.12/s (>9.60/s) | 268.84ms | 436.73ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.4/s (>9.60/s) | 54.53ms | 67.20ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
|
|
|
|
|
|
² Failure may not be clear from summary alone. Refer to the individual test's full output for further debugging. |