|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/163420435)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1594027118349&to=1594030913881)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/163719755)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1594085103866&to=1594088889399)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.2.0-pre `e2fe6aecde2`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-07-06
|
|
|
* Run Time: 1h 3m 15.53s (Start: 09:18:38 UTC, End: 10:21:53 UTC)
|
|
|
* Date: 2020-07-07
|
|
|
* Run Time: 1h 3m 5.53s (Start: 01:25:03 UTC, End: 02:28:09 UTC)
|
|
|
* GPT Version: v2.0.4
|
|
|
|
|
|
❯ Overall Results Score: 97.42%
|
|
|
❯ Overall Results Score: 97.31%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 194.85/s (>160.00/s) | 61.87ms | 75.50ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 138.1/s (>80.00/s) | 1308.66ms | 1578.47ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.65/s (>160.00/s) | 64.65ms | 71.31ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 144.15/s (>32.00/s) | 1253.73ms | 1515.37ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 50.87/s (>32.00/s) | 3490.27ms | 4317.12ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.93/s (>160.00/s) | 40.09ms | 42.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 187.68/s (>96.00/s) | 243.20ms | 325.93ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 189.88/s (>96.00/s) | 276.29ms | 392.38ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.85/s (>160.00/s) | 37.98ms | 40.38ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 140.07/s (>96.00/s) | 1285.72ms | 1600.93ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.05/s (>160.00/s) | 96.04ms | 111.95ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 25.75/s (>16.00/s) | 6406.97ms | 7743.35ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.35/s (>160.00/s) | 64.85ms | 73.11ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 192.63/s (>128.00/s) | 183.03ms | 243.21ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 54.38/s (>32.00/s) | 3266.07ms | 4068.94ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.58/s (>160.00/s) | 103.94ms | 120.17ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.87/s (>160.00/s) | 50.82ms | 54.97ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.7/s (>16.00/s) | 213.57ms | 273.15ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.0/s (>160.00/s) | 37.50ms | 39.56ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 82.98/s (>32.00/s) | 2151.02ms | 3468.12ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.82/s (>160.00/s) | 56.55ms | 60.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.7/s (>160.00/s) | 59.18ms | 63.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.7/s (>160.00/s) | 58.29ms | 62.22ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.95/s (>160.00/s) | 52.30ms | 55.11ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.48/s (>160.00/s) | 145.43ms | 160.63ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.65/s (>160.00/s) | 134.11ms | 179.65ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 14.7/s (>1.60/s) | 11067.09ms | 15080.38ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.92/s (>160.00/s) | 99.82ms | 125.05ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.42/s (>160.00/s) | 83.59ms | 97.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 150.18/s (>48.00/s) | 5565.55ms | 6968.31ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 109.77/s (>48.00/s) | 7795.31ms | 10164.22ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 112.88/s (>48.00/s) | 6436.25ms | 8314.15ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.2/s (>160.00/s) | 27.72ms | 29.36ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.43/s (>160.00/s) | 62.58ms | 68.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 42.76ms | 45.74ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.7/s (>16.00/s) | 51.24ms | 61.75ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.35/s (>16.00/s) | 478.96ms | 743.69ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.02/s (>1.60/s) | 529.83ms | 531.91ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.0/s (>1.60/s) | 255.34ms | 582.42ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.25/s (>16.00/s) | 124.22ms | 175.34ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.2/s (>16.00/s) | 244.43ms | 298.60ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.93/s (>9.60/s) | 637.98ms | 791.14ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.02/s (>16.00/s) | 431.96ms | 496.22ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.48/s (>0.80/s) | 3236.67ms | 3694.06ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.5/s (>0.80/s) | 6654.68ms | 16669.89ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 11.87/s (>1.60/s) | 1594.40ms | 3243.40ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.63/s (>12.00/s) | 341.92ms | 552.72ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.2/s (>16.00/s) | 346.04ms | 1016.49ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.18/s (>16.00/s) | 246.13ms | 326.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 13.4/s (>8.00/s) | 1587.44ms | 2159.92ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.77/s (>9.60/s) | 473.07ms | 780.51ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.52/s (>11.20/s) | 945.93ms | 2619.93ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.3/s (>16.00/s) | 264.47ms | 329.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.0/s (>9.60/s) | 320.68ms | 525.51ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.05/s (>16.00/s) | 81.53ms | 171.32ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.25/s (>16.00/s) | 73.32ms | 121.00ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.27/s (>16.00/s) | 81.18ms | 209.47ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.22/s (>9.60/s) | 101.36ms | 136.95ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|-----------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 194.83/s (>160.00/s) | 63.46ms | 71.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 135.33/s (>16.00/s) | 1335.05ms | 1565.41ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.62/s (>160.00/s) | 66.42ms | 73.31ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 142.0/s (>16.00/s) | 1270.81ms | 1538.31ms (<7000ms) | 99.96% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 52.45/s (>8.00/s) | 3380.71ms | 4070.28ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.87/s (>160.00/s) | 42.67ms | 46.43ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 192.35/s (>96.00/s) | 287.07ms | 403.33ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 189.82/s (>96.00/s) | 358.44ms | 526.07ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.87/s (>160.00/s) | 39.92ms | 42.22ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 150.85/s (>96.00/s) | 1190.37ms | 1497.36ms (<2000ms) | 99.96% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.75/s (>160.00/s) | 100.78ms | 115.83ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 25.52/s (>16.00/s) | 6346.31ms | 8477.69ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.25/s (>160.00/s) | 67.08ms | 73.92ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 191.8/s (>128.00/s) | 186.18ms | 241.45ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 54.02/s (>8.00/s) | 3299.73ms | 3994.21ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.73/s (>160.00/s) | 109.32ms | 123.96ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.78/s (>160.00/s) | 54.14ms | 58.75ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.37/s (>16.00/s) | 255.29ms | 441.39ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.72/s (>160.00/s) | 41.42ms | 44.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 106.22/s (>32.00/s) | 1696.67ms | 2120.38ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.67/s (>160.00/s) | 64.50ms | 73.29ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.63/s (>160.00/s) | 66.84ms | 77.53ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.55/s (>160.00/s) | 65.99ms | 79.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.73/s (>160.00/s) | 53.30ms | 56.50ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.48/s (>160.00/s) | 143.56ms | 156.94ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.53/s (>160.00/s) | 132.14ms | 176.08ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 16.85/s (>1.60/s) | 9767.19ms | 12918.14ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.02/s (>160.00/s) | 99.32ms | 116.77ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.38/s (>160.00/s) | 84.09ms | 95.96ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 165.92/s (>48.00/s) | 4830.34ms | 6231.79ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 120.48/s (>48.00/s) | 6878.39ms | 9132.43ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 124.85/s (>48.00/s) | 5729.77ms | 7404.09ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 195.98/s (>160.00/s) | 30.04ms | 31.73ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.33/s (>160.00/s) | 68.49ms | 74.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 46.09ms | 48.30ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.72/s (>16.00/s) | 52.62ms | 63.63ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.1/s (>16.00/s) | 440.76ms | 678.50ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.02/s (>1.60/s) | 497.93ms | 506.06ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 270.59ms | 628.95ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.13/s (>16.00/s) | 131.29ms | 182.76ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.02/s (>16.00/s) | 253.58ms | 306.87ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.9/s (>9.60/s) | 597.49ms | 770.67ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.97/s (>16.00/s) | 430.87ms | 462.48ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.65/s (>0.80/s) | 3150.18ms | 3752.00ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.57/s (>0.80/s) | 6494.61ms | 15909.38ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.05/s (>1.60/s) | 1597.60ms | 3266.89ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.73/s (>12.00/s) | 309.77ms | 350.03ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.1/s (>16.00/s) | 346.26ms | 1021.62ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.27/s (>16.00/s) | 242.00ms | 304.57ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 13.03/s (>8.00/s) | 1650.54ms | 2245.61ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 19.02/s (>9.60/s) | 458.90ms | 715.13ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.58/s (>11.20/s) | 941.29ms | 2447.23ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.32/s (>16.00/s) | 267.93ms | 315.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.08/s (>9.60/s) | 316.60ms | 510.29ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.02/s (>16.00/s) | 84.92ms | 172.10ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.33/s (>16.00/s) | 70.21ms | 124.31ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.07/s (>16.00/s) | 80.01ms | 230.90ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.28/s (>9.60/s) | 99.76ms | 132.34ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |