|
### Test Links
|
|
### Test Links
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/159432513)
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/159846414)
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1592961675454&to=1592965462445)
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1593048584968&to=1593052358445)
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
### Test Results
|
|
### Test Results
|
|
* Environment: 10k
|
|
* Environment: 10k
|
|
* Environment Version: 13.2.0-pre `b7cc764269e`
|
|
* Environment Version: 13.2.0-pre `60b7c3bce82`
|
|
* Option: 60s_200rps
|
|
* Option: 60s_200rps
|
|
* Date: 2020-06-24
|
|
* Date: 2020-06-25
|
|
* Run Time: 1h 3m 6.99s (Start: 01:21:15 UTC, End: 02:24:22 UTC)
|
|
* Run Time: 1h 2m 53.48s (Start: 01:29:44 UTC, End: 02:32:38 UTC)
|
|
* GPT Version: v2.0.3
|
|
* GPT Version: v2.0.3
|
|
|
|
|
|
❯ Overall Results Score: 97.4%
|
|
❯ Overall Results Score: 97.43%
|
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
api_v4_groups | 200/s | 195.08/s (>160.00/s) | 65.55ms | 75.07ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups | 200/s | 195.2/s (>160.00/s) | 57.73ms | 63.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups_group | 200/s | 194.43/s (>160.00/s) | 73.21ms | 89.63ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups_group | 200/s | 195.38/s (>160.00/s) | 58.14ms | 71.13ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups_group_subgroups | 200/s | 195.83/s (>160.00/s) | 54.31ms | 59.84ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups_group_subgroups | 200/s | 195.82/s (>160.00/s) | 49.69ms | 54.20ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups_projects | 200/s | 73.55/s (>32.00/s) | 2443.59ms | 2874.39ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_groups_projects | 200/s | 83.02/s (>32.00/s) | 2168.99ms | 2445.87ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects | 200/s | 62.62/s (>32.00/s) | 2856.79ms | 3509.77ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects | 200/s | 69.95/s (>32.00/s) | 2557.66ms | 3062.22ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_deploy_keys | 200/s | 195.93/s (>160.00/s) | 41.50ms | 44.18ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_deploy_keys | 200/s | 195.97/s (>160.00/s) | 39.57ms | 42.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_issues | 200/s | 187.92/s (>96.00/s) | 434.35ms | 617.80ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_issues | 200/s | 192.93/s (>96.00/s) | 214.65ms | 301.83ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_issues_issue | 200/s | 185.3/s (>96.00/s) | 797.24ms | 1292.19ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_issues_issue | 200/s | 191.68/s (>96.00/s) | 220.74ms | 310.54ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_languages | 200/s | 195.87/s (>160.00/s) | 39.32ms | 43.89ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_languages | 200/s | 195.77/s (>160.00/s) | 37.05ms | 39.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests | 200/s | 135.93/s (>96.00/s) | 1322.59ms | 1672.07ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests | 200/s | 144.55/s (>96.00/s) | 1247.50ms | 1548.32ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.98/s (>160.00/s) | 105.04ms | 133.20ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.97/s (>160.00/s) | 95.32ms | 118.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.33/s (>160.00/s) | 102.39ms | 126.08ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.48/s (>160.00/s) | 90.67ms | 109.34ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.25/s (>160.00/s) | 67.67ms | 76.94ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.23/s (>160.00/s) | 62.36ms | 70.59ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 192.5/s (>128.00/s) | 211.07ms | 291.22ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.55/s (>128.00/s) | 169.97ms | 226.82ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_pagination_keyset | 200/s | 63.28/s (>32.00/s) | 2833.64ms | 3446.12ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_pagination_keyset | 200/s | 71.77/s (>32.00/s) | 2499.90ms | 2943.40ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project | 200/s | 194.68/s (>160.00/s) | 112.13ms | 137.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project | 200/s | 194.88/s (>160.00/s) | 101.50ms | 121.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project_pipelines | 200/s | 195.03/s (>160.00/s) | 53.72ms | 59.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project_pipelines | 200/s | 195.83/s (>160.00/s) | 49.71ms | 55.43ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project_search_blobs | 200/s | 191.8/s (>16.00/s) | 240.63ms | 365.41ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project_search_blobs | 200/s | 192.05/s (>16.00/s) | 225.69ms | 303.41ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project_services | 200/s | 196.0/s (>160.00/s) | 39.00ms | 42.42ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_project_services | 200/s | 196.15/s (>160.00/s) | 36.65ms | 40.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_branches | 200/s | 83.83/s (>32.00/s) | 2121.45ms | 3589.90ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_branches | 200/s | 97.73/s (>32.00/s) | 1832.03ms | 2465.97ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.75/s (>160.00/s) | 57.38ms | 62.11ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.8/s (>160.00/s) | 54.72ms | 59.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_commits | 200/s | 195.75/s (>160.00/s) | 61.17ms | 68.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_commits | 200/s | 195.7/s (>160.00/s) | 56.89ms | 61.24ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.63/s (>160.00/s) | 59.80ms | 65.78ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.77/s (>160.00/s) | 56.61ms | 61.49ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.8/s (>160.00/s) | 52.81ms | 56.40ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.87/s (>160.00/s) | 50.70ms | 53.44ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.47/s (>160.00/s) | 148.76ms | 166.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.55/s (>160.00/s) | 141.23ms | 153.65ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_files_file | 200/s | 194.4/s (>160.00/s) | 133.30ms | 178.17ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_files_file | 200/s | 194.48/s (>160.00/s) | 129.15ms | 173.13ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_files_file_blame | 200/s | 8.8/s (>1.60/s) | 14944.04ms | 20616.70ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_files_file_blame | 200/s | 9.18/s (>1.60/s) | 14632.44ms | 19262.04ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.75/s (>160.00/s) | 106.25ms | 143.22ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.07/s (>160.00/s) | 101.49ms | 117.55ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_tree | 200/s | 195.5/s (>160.00/s) | 86.70ms | 101.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_projects_repository_tree | 200/s | 195.52/s (>160.00/s) | 83.33ms | 93.86ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_search_global | 200/s | 138.62/s (>48.00/s) | 5901.67ms | 7649.93ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
api_v4_search_global | 200/s | 162.78/s (>48.00/s) | 4887.45ms | 6419.07ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
api_v4_search_groups | 200/s | 104.7/s (>48.00/s) | 7897.59ms | 10556.89ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
api_v4_search_groups | 200/s | 119.75/s (>48.00/s) | 6903.65ms | 9179.65ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
api_v4_search_projects | 200/s | 105.05/s (>48.00/s) | 6727.60ms | 8806.37ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
api_v4_search_projects | 200/s | 125.43/s (>48.00/s) | 5586.97ms | 7454.46ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
api_v4_user | 200/s | 195.97/s (>160.00/s) | 29.23ms | 31.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_user | 200/s | 196.12/s (>160.00/s) | 27.59ms | 29.66ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_users | 200/s | 195.53/s (>160.00/s) | 68.04ms | 75.70ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
api_v4_users | 200/s | 195.55/s (>160.00/s) | 62.09ms | 70.29ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
git_ls_remote | 20/s | 19.62/s (>16.00/s) | 44.96ms | 47.37ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
git_ls_remote | 20/s | 19.6/s (>16.00/s) | 43.81ms | 45.81ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
git_pull | 20/s | 19.67/s (>16.00/s) | 52.22ms | 62.76ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
git_pull | 20/s | 19.72/s (>16.00/s) | 50.39ms | 61.51ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
git_push | 20/s | 19.18/s (>16.00/s) | 477.14ms | 757.47ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
git_push | 20/s | 19.3/s (>16.00/s) | 437.44ms | 682.14ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 493.25ms | 497.30ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 480.42ms | 533.14ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 257.15ms | 715.26ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
scenario_api_new_issues | 2/s | 2.0/s (>1.60/s) | 279.34ms | 658.71ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_group | 20/s | 19.22/s (>16.00/s) | 126.14ms | 155.95ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_group | 20/s | 19.13/s (>16.00/s) | 119.39ms | 159.43ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project | 20/s | 19.1/s (>16.00/s) | 255.79ms | 307.24ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project | 20/s | 19.17/s (>16.00/s) | 235.81ms | 299.30ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_branches | 20/s | 18.9/s (>9.60/s) | 655.23ms | 816.85ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_branches | 20/s | 19.03/s (>9.60/s) | 584.17ms | 709.93ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_commits | 20/s | 18.97/s (>16.00/s) | 456.20ms | 494.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_commits | 20/s | 19.08/s (>16.00/s) | 407.20ms | 432.15ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_file_blame | 20/s | 2.98/s (>0.80/s) | 5751.38ms | 6705.81ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_file_blame | 20/s | 3.28/s (>0.80/s) | 5244.32ms | 5899.61ms (<20000ms) | 99.48% (>95%) | **{+Passed+}**
|
|
web_project_file_rendered | 20/s | 2.37/s (>0.80/s) | 7048.17ms | 16884.40ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_file_rendered | 20/s | 2.65/s (>0.80/s) | 6281.60ms | 14154.20ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_file_source | 20/s | 11.52/s (>1.60/s) | 1679.65ms | 3466.47ms (<5000ms) | 99.70% (>95%) | **{+Passed+}**
|
|
web_project_file_source | 20/s | 11.97/s (>1.60/s) | 1595.67ms | 3261.59ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_files | 20/s | 16.75/s (>12.00/s) | 426.67ms | 767.19ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_files | 20/s | 17.28/s (>12.00/s) | 348.19ms | 587.01ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_issue | 20/s | 19.12/s (>16.00/s) | 359.35ms | 1101.38ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_issue | 20/s | 19.0/s (>16.00/s) | 332.60ms | 972.38ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_issues | 20/s | 19.3/s (>16.00/s) | 245.20ms | 306.21ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_issues | 20/s | 19.3/s (>16.00/s) | 223.47ms | 289.44ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_request_changes | 20/s | 12.73/s (>8.00/s) | 1673.65ms | 2288.20ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_request_changes | 20/s | 13.15/s (>8.00/s) | 1600.89ms | 2211.46ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_request_commits | 20/s | 19.0/s (>9.60/s) | 498.18ms | 808.63ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_request_commits | 20/s | 18.82/s (>9.60/s) | 453.25ms | 695.51ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_request_discussions | 20/s | 18.3/s (>11.20/s) | 987.94ms | 2685.82ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_request_discussions | 20/s | 18.63/s (>11.20/s) | 885.23ms | 2288.38ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_requests | 20/s | 19.27/s (>16.00/s) | 272.67ms | 325.04ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_merge_requests | 20/s | 19.32/s (>16.00/s) | 246.90ms | 302.80ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_pipelines | 20/s | 19.02/s (>9.60/s) | 327.56ms | 527.85ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_project_pipelines | 20/s | 19.08/s (>9.60/s) | 286.88ms | 463.50ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 79.72ms | 165.22ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_search_global | 20/s | 19.17/s (>16.00/s) | 71.97ms | 134.70ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_search_groups | 20/s | 19.32/s (>16.00/s) | 70.84ms | 129.78ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_search_groups | 20/s | 19.18/s (>16.00/s) | 67.80ms | 120.50ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_search_projects | 20/s | 19.12/s (>16.00/s) | 79.47ms | 244.15ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_search_projects | 20/s | 19.2/s (>16.00/s) | 73.21ms | 212.33ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
web_user | 20/s | 19.27/s (>9.60/s) | 97.87ms | 127.65ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
web_user | 20/s | 19.33/s (>9.60/s) | 92.58ms | 122.06ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |