|
### Test Links
|
|
### Test Links
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/177740469)
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/178497065)
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1597368473256&to=1597372328657)
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1597627634341&to=1597631467402)
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
### Test Results
|
|
### Test Results
|
|
* Environment: 10k
|
|
* Environment: 10k
|
|
* Environment Version: 13.3.0-pre `ccaa07a1849`
|
|
* Environment Version: 13.3.0-pre `9e404d35ecc`
|
|
* Option: 60s_200rps
|
|
* Option: 60s_200rps
|
|
* Date: 2020-08-14
|
|
* Date: 2020-08-17
|
|
* Run Time: 1h 4m 15.4s (Start: 01:27:53 UTC, End: 02:32:08 UTC)
|
|
* Run Time: 1h 3m 53.06s (Start: 01:27:14 UTC, End: 02:31:07 UTC)
|
|
* GPT Version: v2.0.5
|
|
* GPT Version: v2.0.5
|
|
|
|
|
|
❯ Overall Results Score: 97.36%
|
|
❯ Overall Results Score: 97.44%
|
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
api_v4_groups | 200/s | 195.1/s (>160.00/s) | 59.82ms | 65.63ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups | 200/s | 195.22/s (>160.00/s) | 56.76ms | 60.77ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups_group | 200/s | 134.65/s (>16.00/s) | 1340.70ms | 1594.18ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups_group | 200/s | 130.43/s (>16.00/s) | 1383.86ms | 1849.68ms (<7500ms) | 99.92% (>95%) | **{+Passed+}**
|
|
api_v4_groups_group_subgroups | 200/s | 195.73/s (>160.00/s) | 65.58ms | 71.19ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups_group_subgroups | 200/s | 195.63/s (>160.00/s) | 63.24ms | 67.80ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups_projects | 200/s | 145.0/s (>16.00/s) | 1245.16ms | 1460.50ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups_projects | 200/s | 140.08/s (>16.00/s) | 1289.51ms | 1761.37ms (<7000ms) | 99.92% (>95%) | **{+Passed+}**
|
|
api_v4_projects | 200/s | 51.07/s (>8.00/s) | 3475.59ms | 4199.91ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects | 200/s | 52.57/s (>8.00/s) | 3374.38ms | 4070.55ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_deploy_keys | 200/s | 195.97/s (>160.00/s) | 41.12ms | 42.32ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_deploy_keys | 200/s | 195.95/s (>160.00/s) | 40.49ms | 41.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_issues | 200/s | 182.25/s (>96.00/s) | 903.67ms | 1196.54ms (<2000ms) | 99.93% (>95%) | **{+Passed+}**
|
|
api_v4_projects_issues | 200/s | 177.98/s (>96.00/s) | 954.21ms | 1192.24ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_issues_issue | 200/s | 193.05/s (>96.00/s) | 250.73ms | 347.05ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_issues_issue | 200/s | 192.03/s (>96.00/s) | 280.07ms | 394.91ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_languages | 200/s | 195.92/s (>160.00/s) | 39.74ms | 41.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_languages | 200/s | 195.87/s (>160.00/s) | 38.69ms | 40.29ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests | 200/s | 136.93/s (>96.00/s) | 1318.38ms | 1675.72ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests | 200/s | 148.37/s (>96.00/s) | 1216.22ms | 1566.30ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.82/s (>160.00/s) | 93.89ms | 103.84ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.95/s (>160.00/s) | 92.59ms | 105.11ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 27.88/s (>16.00/s) | 5899.91ms | 7197.42ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 27.43/s (>16.00/s) | 5956.41ms | 7197.85ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.57/s (>160.00/s) | 62.10ms | 66.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.48/s (>160.00/s) | 61.16ms | 65.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.8/s (>128.00/s) | 175.24ms | 230.77ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.87/s (>128.00/s) | 177.57ms | 231.00ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_pagination_keyset | 200/s | 55.23/s (>8.00/s) | 3228.70ms | 3891.43ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_pagination_keyset | 200/s | 55.47/s (>8.00/s) | 3212.83ms | 3883.93ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project | 200/s | 194.78/s (>160.00/s) | 111.06ms | 125.15ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project | 200/s | 194.73/s (>160.00/s) | 111.42ms | 128.08ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project_pipelines | 200/s | 195.9/s (>160.00/s) | 51.46ms | 54.32ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project_pipelines | 200/s | 195.92/s (>160.00/s) | 51.90ms | 54.81ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project_search_blobs | 200/s | 192.13/s (>16.00/s) | 237.76ms | 317.16ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project_search_blobs | 200/s | 192.2/s (>16.00/s) | 253.73ms | 386.57ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project_services | 200/s | 195.68/s (>160.00/s) | 38.90ms | 40.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project_services | 200/s | 195.77/s (>160.00/s) | 38.46ms | 39.67ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_branches | 200/s | 87.35/s (>32.00/s) | 2040.65ms | 3377.06ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_branches | 200/s | 96.47/s (>32.00/s) | 1855.06ms | 2947.89ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.7/s (>160.00/s) | 59.57ms | 62.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.82/s (>160.00/s) | 60.11ms | 63.01ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_commits | 200/s | 195.8/s (>160.00/s) | 58.16ms | 60.92ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_commits | 200/s | 195.78/s (>160.00/s) | 59.54ms | 62.75ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_commits_commit | 200/s | 194.97/s (>160.00/s) | 105.35ms | 115.63ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_commits_commit | 200/s | 194.92/s (>160.00/s) | 105.10ms | 115.66ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_commits_commit_diff | 200/s | 195.12/s (>160.00/s) | 112.74ms | 123.77ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_commits_commit_diff | 200/s | 194.98/s (>160.00/s) | 111.14ms | 122.64ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.35/s (>160.00/s) | 154.46ms | 181.96ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.47/s (>160.00/s) | 148.48ms | 165.66ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_files_file | 200/s | 194.87/s (>160.00/s) | 107.92ms | 152.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_files_file | 200/s | 194.95/s (>160.00/s) | 106.38ms | 147.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_files_file_blame | 200/s | 15.48/s (>1.60/s) | 10421.26ms | 17128.37ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_files_file_blame | 200/s | 15.63/s (>1.60/s) | 10143.56ms | 17526.45ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_files_file_raw | 200/s | 192.75/s (>160.00/s) | 107.00ms | 150.82ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_files_file_raw | 200/s | 189.02/s (>160.00/s) | 127.61ms | 155.89ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_tree | 200/s | 195.48/s (>160.00/s) | 78.62ms | 97.30ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_tree | 200/s | 195.63/s (>160.00/s) | 70.38ms | 75.00ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_search_global | 200/s | 190.82/s (>48.00/s) | 770.84ms | 3026.73ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
api_v4_search_global | 200/s | 190.98/s (>48.00/s) | 632.85ms | 2567.40ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
api_v4_search_groups | 200/s | 151.35/s (>48.00/s) | 5497.77ms | 6959.89ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
api_v4_search_groups | 200/s | 155.93/s (>48.00/s) | 5302.49ms | 6704.68ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
api_v4_search_projects | 200/s | 177.22/s (>48.00/s) | 2078.01ms | 4064.42ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
api_v4_search_projects | 200/s | 184.13/s (>48.00/s) | 1022.85ms | 2202.79ms (<25000ms) | 99.97% (>9.5%) | **{+Passed+}**
|
|
api_v4_user | 200/s | 196.1/s (>160.00/s) | 28.50ms | 29.17ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_user | 200/s | 196.05/s (>160.00/s) | 28.42ms | 28.99ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_users | 200/s | 195.62/s (>160.00/s) | 64.62ms | 68.90ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_users | 200/s | 195.6/s (>160.00/s) | 62.72ms | 66.29ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 45.26ms | 48.55ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 45.17ms | 47.79ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
git_pull | 20/s | 19.68/s (>16.00/s) | 53.58ms | 66.76ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
git_pull | 20/s | 19.72/s (>16.00/s) | 52.78ms | 63.56ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
git_push | 20/s | 19.33/s (>16.00/s) | 357.70ms | 551.19ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
git_push | 20/s | 19.43/s (>16.00/s) | 378.99ms | 539.57ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 362.05ms | 408.86ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
scenario_api_new_branches | 2/s | 2.07/s (>1.60/s) | 354.85ms | 365.35ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
scenario_api_new_issues | 2/s | 2.0/s (>1.60/s) | 280.76ms | 659.88ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
scenario_api_new_issues | 2/s | 2.03/s (>1.60/s) | 304.17ms | 662.20ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_group | 20/s | 19.27/s (>16.00/s) | 122.99ms | 164.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_group | 20/s | 19.2/s (>16.00/s) | 125.28ms | 184.31ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project | 20/s | 19.13/s (>16.00/s) | 264.69ms | 314.72ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project | 20/s | 19.15/s (>16.00/s) | 252.55ms | 305.53ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_branches | 20/s | 18.93/s (>9.60/s) | 625.20ms | 788.24ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_branches | 20/s | 18.98/s (>9.60/s) | 593.35ms | 731.15ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_commit | 20/s | 6.0/s (>3.20/s) | 2842.98ms | 9469.07ms (<12500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_commit | 20/s | 5.93/s (>3.20/s) | 2869.49ms | 9906.34ms (<12500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_commits | 20/s | 19.13/s (>16.00/s) | 377.32ms | 401.55ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_commits | 20/s | 19.05/s (>16.00/s) | 393.82ms | 422.02ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_file_blame | 20/s | 5.57/s (>0.16/s) | 3187.98ms | 3716.85ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_file_blame | 20/s | 5.37/s (>0.16/s) | 3288.87ms | 3753.15ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_file_rendered | 20/s | 3.43/s (>0.16/s) | 5035.55ms | 10931.23ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_file_rendered | 20/s | 3.38/s (>0.16/s) | 5096.86ms | 11031.22ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_file_source | 20/s | 10.33/s (>1.60/s) | 1834.85ms | 3557.23ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_file_source | 20/s | 10.27/s (>1.60/s) | 1826.17ms | 3511.78ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_files | 20/s | 19.3/s (>12.00/s) | 161.01ms | 252.37ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_files | 20/s | 19.32/s (>12.00/s) | 168.86ms | 253.82ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_issue | 20/s | 19.08/s (>16.00/s) | 335.70ms | 977.72ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_issue | 20/s | 19.08/s (>16.00/s) | 360.48ms | 1000.04ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_issues | 20/s | 19.35/s (>16.00/s) | 232.47ms | 295.51ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_issues | 20/s | 19.3/s (>16.00/s) | 235.97ms | 291.72ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_request_changes | 20/s | 18.98/s (>8.00/s) | 637.72ms | 1063.09ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_request_changes | 20/s | 18.8/s (>8.00/s) | 619.47ms | 950.85ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_request_commits | 20/s | 19.13/s (>9.60/s) | 449.08ms | 668.91ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_request_commits | 20/s | 18.83/s (>9.60/s) | 465.78ms | 679.71ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_request_discussions | 20/s | 18.65/s (>11.20/s) | 932.69ms | 2377.51ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_request_discussions | 20/s | 18.67/s (>11.20/s) | 925.99ms | 2331.29ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_requests | 20/s | 19.25/s (>16.00/s) | 269.59ms | 330.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_requests | 20/s | 19.28/s (>16.00/s) | 275.63ms | 342.20ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_pipelines | 20/s | 19.07/s (>9.60/s) | 348.32ms | 594.96ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_pipelines | 20/s | 19.05/s (>9.60/s) | 344.52ms | 567.44ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_search_global | 20/s | 19.12/s (>16.00/s) | 85.37ms | 177.50ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 86.30ms | 179.43ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_search_groups | 20/s | 19.03/s (>16.00/s) | 75.84ms | 162.69ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_search_groups | 20/s | 19.3/s (>16.00/s) | 74.38ms | 116.25ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_search_projects | 20/s | 19.23/s (>16.00/s) | 84.98ms | 318.64ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_search_projects | 20/s | 19.08/s (>16.00/s) | 86.23ms | 311.57ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_user | 20/s | 19.17/s (>9.60/s) | 121.38ms | 180.68ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
web_user | 20/s | 19.3/s (>9.60/s) | 115.98ms | 167.24ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |