|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/170241221)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1595554081363&to=1595557861907)
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/170964597)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1595813277242&to=1595817058161)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.3.0-pre `4b1708f9578`
|
|
|
* Environment Version: 13.3.0-pre `2b93a3e58e1`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-07-24
|
|
|
* Run Time: 1h 3m 0.54s (Start: 01:28:01 UTC, End: 02:31:01 UTC)
|
|
|
* Date: 2020-07-27
|
|
|
* Run Time: 1h 3m 0.92s (Start: 01:27:57 UTC, End: 02:30:58 UTC)
|
|
|
* GPT Version: v2.0.5
|
|
|
|
|
|
❯ Overall Results Score: 97.43%
|
|
|
❯ Overall Results Score: 97.28%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|-----------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.18/s (>160.00/s) | 60.29ms | 68.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 131.7/s (>16.00/s) | 1372.36ms | 1627.59ms (<7500ms) | 99.96% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.7/s (>160.00/s) | 64.79ms | 70.32ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 135.17/s (>16.00/s) | 1334.26ms | 1639.56ms (<7000ms) | 99.96% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 51.97/s (>8.00/s) | 3419.99ms | 4195.15ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.9/s (>160.00/s) | 42.26ms | 44.42ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 174.28/s (>96.00/s) | 1013.32ms | 1224.91ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.87/s (>96.00/s) | 263.57ms | 376.78ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.93/s (>160.00/s) | 39.92ms | 43.19ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 159.02/s (>96.00/s) | 1127.17ms | 1455.95ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 195.03/s (>160.00/s) | 89.63ms | 97.77ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 27.47/s (>16.00/s) | 6056.19ms | 7379.94ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.63/s (>160.00/s) | 64.36ms | 70.25ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.72/s (>128.00/s) | 173.62ms | 235.76ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 53.77/s (>8.00/s) | 3313.36ms | 3986.05ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.68/s (>160.00/s) | 104.42ms | 114.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.87/s (>160.00/s) | 51.46ms | 54.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.13/s (>16.00/s) | 231.59ms | 312.28ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 196.08/s (>160.00/s) | 38.71ms | 40.52ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 104.52/s (>32.00/s) | 1721.99ms | 2428.04ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.73/s (>160.00/s) | 57.58ms | 61.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.68/s (>160.00/s) | 58.53ms | 61.57ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.77/s (>160.00/s) | 58.44ms | 61.46ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.8/s (>160.00/s) | 52.90ms | 55.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.52/s (>160.00/s) | 143.70ms | 156.30ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.87/s (>160.00/s) | 109.95ms | 153.16ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 16.62/s (>1.60/s) | 9948.62ms | 12984.74ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.05/s (>160.00/s) | 101.44ms | 125.96ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.55/s (>160.00/s) | 71.90ms | 77.12ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.75/s (>48.00/s) | 442.19ms | 1680.59ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 167.32/s (>48.00/s) | 4282.84ms | 5971.57ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 191.43/s (>48.00/s) | 191.23ms | 319.55ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 195.97/s (>160.00/s) | 28.61ms | 29.98ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.35/s (>160.00/s) | 65.32ms | 73.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 46.94ms | 54.08ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.72/s (>16.00/s) | 55.14ms | 69.09ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.45/s (>16.00/s) | 359.19ms | 520.15ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.0/s (>1.60/s) | 400.29ms | 415.62ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 284.73ms | 639.02ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.27/s (>16.00/s) | 123.89ms | 179.38ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.2/s (>16.00/s) | 261.40ms | 325.78ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.98/s (>9.60/s) | 663.63ms | 852.39ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.1/s (>16.00/s) | 433.21ms | 486.27ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.48/s (>0.16/s) | 3233.73ms | 3905.04ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.53/s (>0.16/s) | 6439.18ms | 14683.36ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 9.85/s (>1.60/s) | 1930.43ms | 3916.71ms (<5000ms) | 99.82% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.32/s (>12.00/s) | 177.64ms | 264.64ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.07/s (>16.00/s) | 347.11ms | 1018.14ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.28/s (>16.00/s) | 241.31ms | 311.76ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.98/s (>8.00/s) | 611.06ms | 966.63ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.73/s (>9.60/s) | 464.03ms | 727.74ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.57/s (>11.20/s) | 940.49ms | 2411.17ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.27/s (>16.00/s) | 274.25ms | 335.97ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.08/s (>9.60/s) | 317.93ms | 517.08ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.13/s (>16.00/s) | 84.89ms | 158.45ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.23/s (>16.00/s) | 75.93ms | 132.49ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.08/s (>16.00/s) | 89.53ms | 323.33ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.2/s (>9.60/s) | 109.53ms | 147.79ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 195.12/s (>160.00/s) | 64.19ms | 69.89ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 120.55/s (>16.00/s) | 1499.14ms | 1954.41ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group_subgroups | 200/s | 195.55/s (>160.00/s) | 69.01ms | 76.18ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 128.98/s (>16.00/s) | 1399.75ms | 1733.74ms (<7000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 46.33/s (>8.00/s) | 3830.60ms | 4773.66ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.87/s (>160.00/s) | 46.17ms | 48.94ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 169.43/s (>96.00/s) | 1046.87ms | 1260.55ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 187.78/s (>96.00/s) | 834.22ms | 1435.95ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 196.0/s (>160.00/s) | 42.53ms | 44.76ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 154.42/s (>96.00/s) | 1164.13ms | 1506.05ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.97/s (>160.00/s) | 97.29ms | 106.34ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 26.57/s (>16.00/s) | 6250.12ms | 7765.58ms (<12000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.53/s (>160.00/s) | 69.20ms | 74.80ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.82/s (>128.00/s) | 191.25ms | 256.81ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 50.53/s (>8.00/s) | 3503.68ms | 4318.93ms (<11000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.48/s (>160.00/s) | 112.67ms | 123.55ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.82/s (>160.00/s) | 55.69ms | 59.34ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.8/s (>16.00/s) | 233.25ms | 317.75ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.88/s (>160.00/s) | 42.08ms | 44.60ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 92.3/s (>32.00/s) | 1937.24ms | 3167.80ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.68/s (>160.00/s) | 62.98ms | 66.84ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.67/s (>160.00/s) | 63.10ms | 67.01ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.62/s (>160.00/s) | 63.68ms | 67.46ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.77/s (>160.00/s) | 56.98ms | 59.87ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.28/s (>160.00/s) | 156.64ms | 180.58ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.75/s (>160.00/s) | 115.65ms | 161.91ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 14.12/s (>1.60/s) | 10892.51ms | 21414.72ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 189.6/s (>160.00/s) | 137.36ms | 173.19ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.15/s (>160.00/s) | 79.14ms | 86.66ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 191.63/s (>48.00/s) | 496.10ms | 1909.17ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 160.98/s (>48.00/s) | 4648.30ms | 6488.86ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 191.03/s (>48.00/s) | 231.50ms | 391.90ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.08/s (>160.00/s) | 32.42ms | 35.32ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.27/s (>160.00/s) | 73.30ms | 80.48ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.58/s (>16.00/s) | 49.42ms | 52.77ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.63/s (>16.00/s) | 57.38ms | 72.56ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.4/s (>16.00/s) | 383.52ms | 572.05ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.03/s (>1.60/s) | 374.73ms | 396.44ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.0/s (>1.60/s) | 308.12ms | 700.61ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.22/s (>16.00/s) | 136.33ms | 198.29ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.02/s (>16.00/s) | 274.72ms | 333.51ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.9/s (>9.60/s) | 674.27ms | 862.92ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 18.93/s (>16.00/s) | 463.14ms | 514.63ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 5.35/s (>0.16/s) | 3329.67ms | 3867.03ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_rendered | 20/s | 2.47/s (>0.16/s) | 6441.06ms | 14927.44ms (<30000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_source | 20/s | 9.85/s (>1.60/s) | 1956.27ms | 3947.82ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 19.27/s (>12.00/s) | 193.90ms | 278.85ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.2/s (>16.00/s) | 363.67ms | 1063.73ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.3/s (>16.00/s) | 256.82ms | 332.36ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 18.87/s (>8.00/s) | 646.33ms | 996.96ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.75/s (>9.60/s) | 497.08ms | 762.04ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.27/s (>11.20/s) | 987.29ms | 2581.99ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.15/s (>16.00/s) | 299.65ms | 374.43ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.1/s (>9.60/s) | 386.27ms | 650.10ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.27/s (>16.00/s) | 91.94ms | 188.65ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.13/s (>16.00/s) | 80.06ms | 135.03ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.2/s (>16.00/s) | 91.44ms | 329.90ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.22/s (>9.60/s) | 113.32ms | 153.62ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |