|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/165780151)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1594603566040&to=1594607366497)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/165970916)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1594643154363&to=1594646935345)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.2.0-pre `58e88479a34`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-07-13
|
|
|
* Run Time: 1h 3m 20.46s (Start: 01:26:06 UTC, End: 02:29:26 UTC)
|
|
|
* Run Time: 1h 3m 0.98s (Start: 12:25:54 UTC, End: 13:28:55 UTC)
|
|
|
* GPT Version: v2.0.5
|
|
|
|
|
|
❯ Overall Results Score: 97.48%
|
|
|
❯ Overall Results Score: 97.31%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|-----------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.15/s (>160.00/s) | 63.71ms | 70.49ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 131.9/s (>16.00/s) | 1370.30ms | 1564.48ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.57/s (>160.00/s) | 69.37ms | 75.79ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 139.32/s (>16.00/s) | 1295.87ms | 1509.84ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 48.45/s (>8.00/s) | 3671.13ms | 4409.40ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.87/s (>160.00/s) | 44.04ms | 46.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 178.22/s (>96.00/s) | 984.91ms | 1234.71ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.8/s (>96.00/s) | 387.02ms | 537.54ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.85/s (>160.00/s) | 42.26ms | 45.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 147.7/s (>96.00/s) | 1220.69ms | 1539.67ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.0/s (>160.00/s) | 102.09ms | 116.95ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 25.7/s (>16.00/s) | 6454.19ms | 8128.62ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.42/s (>160.00/s) | 69.73ms | 76.23ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.8/s (>128.00/s) | 195.28ms | 257.99ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 52.88/s (>8.00/s) | 3355.67ms | 4072.54ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.57/s (>160.00/s) | 118.65ms | 136.08ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.83/s (>160.00/s) | 55.41ms | 58.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.37/s (>16.00/s) | 231.66ms | 318.32ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.0/s (>160.00/s) | 41.19ms | 43.17ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 112.05/s (>32.00/s) | 1608.92ms | 2100.16ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.67/s (>160.00/s) | 60.43ms | 63.61ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.75/s (>160.00/s) | 61.82ms | 65.32ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.72/s (>160.00/s) | 61.26ms | 64.69ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.78/s (>160.00/s) | 54.03ms | 56.19ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.58/s (>160.00/s) | 141.33ms | 153.94ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.5/s (>160.00/s) | 134.24ms | 181.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 17.43/s (>1.60/s) | 9519.60ms | 13505.16ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.17/s (>160.00/s) | 101.32ms | 123.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.23/s (>160.00/s) | 84.79ms | 94.39ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.55/s (>48.00/s) | 319.45ms | 957.20ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 147.02/s (>48.00/s) | 5611.02ms | 7180.15ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 172.92/s (>48.00/s) | 3334.26ms | 4817.95ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.03/s (>160.00/s) | 30.36ms | 31.74ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.37/s (>160.00/s) | 67.98ms | 72.81ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 46.07ms | 51.55ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.7/s (>16.00/s) | 52.67ms | 61.97ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.45/s (>16.00/s) | 352.23ms | 501.19ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.0/s (>1.60/s) | 381.20ms | 407.96ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.05/s (>1.60/s) | 240.51ms | 599.09ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.27/s (>16.00/s) | 124.63ms | 179.45ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.27/s (>16.00/s) | 249.80ms | 313.61ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.93/s (>9.60/s) | 570.76ms | 693.71ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.02/s (>16.00/s) | 424.50ms | 445.89ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.93/s (>0.16/s) | 3016.61ms | 3592.37ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.62/s (>0.16/s) | 6352.15ms | 13965.52ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 12.35/s (>1.60/s) | 1550.45ms | 3208.23ms (<5000ms) | 99.86% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.97/s (>12.00/s) | 300.91ms | 347.22ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.2/s (>16.00/s) | 333.97ms | 973.96ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.28/s (>16.00/s) | 238.23ms | 303.36ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 13.2/s (>8.00/s) | 1606.59ms | 2252.84ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.77/s (>9.60/s) | 461.00ms | 686.03ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.58/s (>11.20/s) | 931.98ms | 2398.44ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.32/s (>16.00/s) | 273.18ms | 339.35ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.07/s (>9.60/s) | 306.78ms | 503.38ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 76.21ms | 154.13ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.17/s (>16.00/s) | 68.74ms | 124.63ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.08/s (>16.00/s) | 77.49ms | 224.00ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.23/s (>9.60/s) | 103.59ms | 142.30ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.65/s (>160.00/s) | 63.48ms | 69.72ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 127.57/s (>16.00/s) | 1416.35ms | 1700.95ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.5/s (>160.00/s) | 71.95ms | 79.26ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 133.47/s (>16.00/s) | 1354.98ms | 1624.97ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 48.88/s (>8.00/s) | 3631.90ms | 4546.06ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.95/s (>160.00/s) | 44.91ms | 46.94ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 167.92/s (>96.00/s) | 1063.20ms | 1377.68ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 186.1/s (>96.00/s) | 891.42ms | 1433.02ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.98/s (>160.00/s) | 42.19ms | 44.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 134.72/s (>96.00/s) | 1339.22ms | 1682.56ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.8/s (>160.00/s) | 110.80ms | 128.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 25.23/s (>16.00/s) | 6500.86ms | 8399.56ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.38/s (>160.00/s) | 75.69ms | 86.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.57/s (>128.00/s) | 228.40ms | 324.50ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 50.62/s (>8.00/s) | 3504.34ms | 4432.17ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.15/s (>160.00/s) | 133.50ms | 154.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.75/s (>160.00/s) | 58.76ms | 64.04ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.98/s (>16.00/s) | 214.28ms | 249.72ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.9/s (>160.00/s) | 42.93ms | 45.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 85.97/s (>32.00/s) | 2078.00ms | 3585.89ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.67/s (>160.00/s) | 63.63ms | 67.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.65/s (>160.00/s) | 65.76ms | 70.79ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.67/s (>160.00/s) | 64.76ms | 68.76ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.7/s (>160.00/s) | 57.57ms | 60.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.38/s (>160.00/s) | 153.87ms | 167.49ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.47/s (>160.00/s) | 140.59ms | 186.53ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 15.6/s (>1.60/s) | 10242.15ms | 17698.21ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 192.25/s (>160.00/s) | 113.87ms | 161.15ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.32/s (>160.00/s) | 89.35ms | 104.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.32/s (>48.00/s) | 621.69ms | 2170.10ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 135.92/s (>48.00/s) | 6322.53ms | 7867.78ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 153.78/s (>48.00/s) | 4356.37ms | 5799.87ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 195.65/s (>160.00/s) | 31.81ms | 32.92ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.4/s (>160.00/s) | 73.02ms | 78.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.6/s (>16.00/s) | 47.95ms | 49.69ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.73/s (>16.00/s) | 57.72ms | 72.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.42/s (>16.00/s) | 388.06ms | 563.06ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 378.46ms | 377.54ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 276.67ms | 688.04ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.13/s (>16.00/s) | 134.35ms | 180.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.17/s (>16.00/s) | 272.67ms | 332.43ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.95/s (>9.60/s) | 652.81ms | 808.35ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.92/s (>16.00/s) | 452.64ms | 502.46ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.53/s (>0.16/s) | 3237.44ms | 3748.45ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.48/s (>0.16/s) | 6627.32ms | 16747.70ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 11.88/s (>1.60/s) | 1613.54ms | 3269.13ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.47/s (>12.00/s) | 354.58ms | 492.26ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.13/s (>16.00/s) | 361.48ms | 1065.10ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.18/s (>16.00/s) | 256.22ms | 320.50ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 12.75/s (>8.00/s) | 1678.51ms | 2366.21ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.98/s (>9.60/s) | 491.00ms | 790.47ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.48/s (>11.20/s) | 971.24ms | 2725.73ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.23/s (>16.00/s) | 292.50ms | 358.84ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.12/s (>9.60/s) | 328.32ms | 541.71ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 18.97/s (>16.00/s) | 84.14ms | 181.49ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.23/s (>16.00/s) | 74.84ms | 132.44ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.13/s (>16.00/s) | 80.35ms | 229.67ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.17/s (>9.60/s) | 114.67ms | 159.05ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |