|
|
### Test Links
|
|
|
* [Pipeline](https://gitlab.com/gitlab-org/quality/performance/-/pipelines/157423620)
|
|
|
* [Metrics Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/tVdO8YIWz/server-performance?from=1592443739540&to=1592447378607)
|
|
|
* [Results History Dashboard](http://10k.testbed.gitlab.net/-/grafana/d/J0ysCtCWz/gpt-test-results)
|
|
|
### Test Results
|
|
|
* Environment: 10k
|
|
|
* Environment Version: 13.1.0-pre `9ace12e4a21`
|
|
|
* Environment Version: 13.1.0-pre `524d2ec200b`
|
|
|
* Option: 60s_200rps
|
|
|
* Date: 2020-06-17
|
|
|
* Run Time: 1h 1m 41s (Start: 01:27:27 UTC, End: 02:29:08 UTC)
|
|
|
* Date: 2020-06-18
|
|
|
* Run Time: 1h 39.07s (Start: 01:28:59 UTC, End: 02:29:38 UTC)
|
|
|
* GPT Version: v2.0.1
|
|
|
|
|
|
❯ Overall Results Score: 97.41%
|
|
|
❯ Overall Results Score: 97.38%
|
|
|
|
|
|
|
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|--------
|
|
|
api_v4_groups | 200/s | 195.23/s (>160.00/s) | 59.60ms | 65.65ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_groups_group | 200/s | 194.87/s (>160.00/s) | 70.17ms | 87.78ms (<1500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_groups_projects | 200/s | 75.12/s (>32.00/s) | 2393.70ms | 2798.30ms (<4500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects | 200/s | 70.37/s (>32.00/s) | 2552.47ms | 2987.29ms (<7500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.9/s (>160.00/s) | 44.33ms | 48.03ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_issues | 200/s | 192.75/s (>96.00/s) | 329.87ms | 468.30ms (<2000ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_issues_issue | 200/s | 192.03/s (>96.00/s) | 416.49ms | 601.38ms (<3000ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_languages | 200/s | 195.7/s (>160.00/s) | 41.90ms | 45.74ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_merge_requests | 200/s | 140.18/s (>96.00/s) | 1280.15ms | 1606.43ms (<2000ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.75/s (>160.00/s) | 106.62ms | 129.41ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.25/s (>160.00/s) | 102.82ms | 121.06ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.07/s (>160.00/s) | 69.93ms | 77.55ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.17/s (>128.00/s) | 220.23ms | 314.72ms (<1500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_pagination_keyset | 200/s | 72.13/s (>32.00/s) | 2487.36ms | 2955.72ms (<7500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_project | 200/s | 194.85/s (>160.00/s) | 110.58ms | 128.43ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.73/s (>160.00/s) | 54.77ms | 58.99ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_project_search_blobs | 200/s | 191.73/s (>16.00/s) | 242.81ms | 326.13ms (<15000ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_project_services | 200/s | 195.73/s (>160.00/s) | 41.94ms | 45.81ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_repository_branches | 200/s | 92.47/s (>32.00/s) | 1941.37ms | 2794.74ms (<7500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.68/s (>160.00/s) | 60.44ms | 64.96ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_repository_commits | 200/s | 195.65/s (>160.00/s) | 62.78ms | 67.04ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.68/s (>160.00/s) | 61.96ms | 66.68ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.75/s (>160.00/s) | 55.50ms | 59.50ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.43/s (>160.00/s) | 144.79ms | 155.61ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.28/s (>160.00/s) | 134.70ms | 180.42ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 9.23/s (>1.60/s) | 14513.21ms | 20026.02ms (<35000ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 194.88/s (>160.00/s) | 107.50ms | 149.96ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_projects_repository_tree | 200/s | 195.27/s (>160.00/s) | 90.35ms | 102.84ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_search_global | 200/s | 150.22/s (>48.00/s) | 5465.74ms | 7014.86ms (<25000ms) | 100.00% (>9.5%) | Passed
|
|
|
api_v4_search_groups | 200/s | 94.78/s (>48.00/s) | 8954.36ms | 11740.85ms (<25000ms) | 100.00% (>9.5%) | Passed
|
|
|
api_v4_search_projects | 200/s | 110.28/s (>48.00/s) | 6625.64ms | 8297.95ms (<25000ms) | 100.00% (>9.5%) | Passed
|
|
|
api_v4_user | 200/s | 196.03/s (>160.00/s) | 31.14ms | 33.81ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
api_v4_users | 200/s | 195.28/s (>160.00/s) | 71.39ms | 79.33ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
git_ls_remote | 20/s | 19.63/s (>16.00/s) | 48.13ms | 49.29ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
git_pull | 20/s | 19.7/s (>16.00/s) | 55.24ms | 66.30ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
git_push | 20/s | 19.37/s (>16.00/s) | 453.00ms | 697.22ms (<5000ms) | 100.00% (>95%) | Passed
|
|
|
scenario_api_new_branches | 2/s | 2.02/s (>1.60/s) | 509.43ms | 512.49ms (<1500ms) | 100.00% (>95%) | Passed
|
|
|
scenario_api_new_issues | 2/s | 2.02/s (>1.60/s) | 315.53ms | 698.52ms (<2500ms) | 100.00% (>95%) | Passed
|
|
|
web_group | 20/s | 19.27/s (>16.00/s) | 130.57ms | 167.93ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
web_project | 20/s | 19.1/s (>16.00/s) | 264.49ms | 328.39ms (<750ms) | 100.00% (>95%) | Passed
|
|
|
web_project_branches | 20/s | 18.92/s (>9.60/s) | 691.20ms | 801.71ms (<1500ms) | 100.00% (>95%) | Passed
|
|
|
web_project_commits | 20/s | 19.0/s (>16.00/s) | 455.98ms | 506.88ms (<500ms) | 100.00% (>95%) | FAILED²
|
|
|
web_project_file | 20/s | 11.37/s (>1.60/s) | 1689.69ms | 3572.39ms (<5000ms) | 100.00% (>95%) | Passed
|
|
|
web_project_file_blame | 20/s | 3.18/s (>0.80/s) | 5419.73ms | 6515.84ms (<20000ms) | 100.00% (>95%) | Passed
|
|
|
web_project_files | 20/s | 17.32/s (>12.00/s) | 391.43ms | 868.47ms (<2500ms) | 100.00% (>95%) | Passed
|
|
|
web_project_issue | 20/s | 19.03/s (>16.00/s) | 354.59ms | 1030.91ms (<1500ms) | 100.00% (>95%) | Passed
|
|
|
web_project_issues | 20/s | 19.25/s (>16.00/s) | 256.34ms | 326.94ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
web_project_merge_request_changes | 20/s | 13.12/s (>8.00/s) | 1612.87ms | 2249.90ms (<4000ms) | 100.00% (>95%) | Passed
|
|
|
web_project_merge_request_commits | 20/s | 18.8/s (>9.60/s) | 511.76ms | 843.71ms (<1250ms) | 100.00% (>95%) | Passed
|
|
|
web_project_merge_request_discussions | 20/s | 18.45/s (>11.20/s) | 980.81ms | 2709.16ms (<4000ms) | 100.00% (>95%) | Passed
|
|
|
web_project_merge_requests | 20/s | 19.28/s (>16.00/s) | 285.69ms | 346.37ms (<500ms) | 100.00% (>95%) | Passed
|
|
|
web_project_pipelines | 20/s | 19.0/s (>9.60/s) | 334.74ms | 550.62ms (<1000ms) | 100.00% (>95%) | Passed
|
|
|
web_search_global | 20/s | 19.08/s (>16.00/s) | 82.95ms | 166.65ms (<1500ms) | 100.00% (>95%) | Passed
|
|
|
web_search_groups | 20/s | 19.28/s (>16.00/s) | 76.90ms | 135.03ms (<1000ms) | 100.00% (>95%) | Passed
|
|
|
web_search_projects | 20/s | 19.37/s (>16.00/s) | 83.16ms | 229.23ms (<1000ms) | 100.00% (>95%) | Passed
|
|
|
web_user | 20/s | 19.25/s (>9.60/s) | 100.39ms | 135.78ms (<4000ms) | 100.00% (>95%) | Passed
|
|
|
|
|
|
|
|
|
² Failure may not be clear from summary alone. Refer to the individual test's full output for further debugging. |
|
|
NAME | RPS | RPS RESULT | TTFB AVG | TTFB P90 | REQ STATUS | RESULT
|
|
|
---------------------------------------------------------|-------|----------------------|------------|-----------------------|-----------------|-------
|
|
|
api_v4_groups | 200/s | 194.95/s (>160.00/s) | 64.78ms | 76.53ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_group | 200/s | 195.23/s (>160.00/s) | 64.91ms | 82.65ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_groups_projects | 200/s | 80.62/s (>32.00/s) | 2232.85ms | 2478.26ms (<4500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects | 200/s | 68.9/s (>32.00/s) | 2600.99ms | 3168.36ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_deploy_keys | 200/s | 195.98/s (>160.00/s) | 42.36ms | 46.47ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues | 200/s | 192.25/s (>96.00/s) | 232.74ms | 323.32ms (<2000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_issues_issue | 200/s | 192.4/s (>96.00/s) | 245.10ms | 353.61ms (<3000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_languages | 200/s | 195.8/s (>160.00/s) | 41.27ms | 44.46ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests | 200/s | 147.58/s (>96.00/s) | 1219.19ms | 1521.78ms (<2000ms) | 99.96% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request | 200/s | 194.82/s (>160.00/s) | 101.03ms | 118.93ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_changes | 200/s | 195.3/s (>160.00/s) | 97.78ms | 116.35ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_commits | 200/s | 195.3/s (>160.00/s) | 67.53ms | 76.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_merge_requests_merge_request_discussions | 200/s | 193.33/s (>128.00/s) | 182.46ms | 243.80ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_pagination_keyset | 200/s | 70.0/s (>32.00/s) | 2563.76ms | 3084.38ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project | 200/s | 194.5/s (>160.00/s) | 107.18ms | 128.78ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_pipelines | 200/s | 195.78/s (>160.00/s) | 53.98ms | 60.33ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_search_blobs | 200/s | 192.12/s (>16.00/s) | 236.05ms | 317.39ms (<15000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_project_services | 200/s | 195.73/s (>160.00/s) | 40.04ms | 44.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches | 200/s | 97.75/s (>32.00/s) | 1830.31ms | 2724.36ms (<7500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_branches_branch | 200/s | 195.75/s (>160.00/s) | 59.93ms | 67.99ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits | 200/s | 195.67/s (>160.00/s) | 61.37ms | 67.28ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha | 200/s | 195.68/s (>160.00/s) | 61.66ms | 68.05ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_commits_sha_diff | 200/s | 195.83/s (>160.00/s) | 54.56ms | 59.23ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_compare_commits | 200/s | 194.38/s (>160.00/s) | 148.27ms | 162.29ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file | 200/s | 194.42/s (>160.00/s) | 134.20ms | 179.59ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_blame | 200/s | 9.32/s (>1.60/s) | 13922.71ms | 19266.29ms (<35000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_files_file_raw | 200/s | 195.03/s (>160.00/s) | 103.40ms | 118.62ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_projects_repository_tree | 200/s | 195.32/s (>160.00/s) | 88.85ms | 104.14ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_search_global | 200/s | 161.38/s (>48.00/s) | 4736.73ms | 6112.62ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_groups | 200/s | 118.9/s (>48.00/s) | 6933.50ms | 9204.41ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_search_projects | 200/s | 124.38/s (>48.00/s) | 5705.05ms | 7473.94ms (<25000ms) | 100.00% (>9.5%) | **{+Passed+}**
|
|
|
api_v4_user | 200/s | 196.05/s (>160.00/s) | 30.08ms | 33.85ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
api_v4_users | 200/s | 195.42/s (>160.00/s) | 69.03ms | 81.27ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_ls_remote | 20/s | 19.62/s (>16.00/s) | 47.77ms | 52.61ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_pull | 20/s | 19.72/s (>16.00/s) | 56.70ms | 72.03ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
git_push | 20/s | 19.35/s (>16.00/s) | 448.83ms | 704.95ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_branches | 2/s | 2.02/s (>1.60/s) | 518.37ms | 531.98ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
scenario_api_new_issues | 2/s | 2.0/s (>1.60/s) | 285.06ms | 679.24ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_group | 20/s | 19.23/s (>16.00/s) | 123.19ms | 162.95ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project | 20/s | 19.1/s (>16.00/s) | 258.87ms | 317.46ms (<750ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_branches | 20/s | 18.92/s (>9.60/s) | 617.76ms | 760.87ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_commits | 20/s | 19.0/s (>16.00/s) | 427.04ms | 475.36ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file | 20/s | 11.57/s (>1.60/s) | 1656.52ms | 3383.20ms (<5000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_file_blame | 20/s | 3.35/s (>0.80/s) | 5153.09ms | 5997.58ms (<20000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_files | 20/s | 17.18/s (>12.00/s) | 370.82ms | 818.22ms (<2500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issue | 20/s | 19.13/s (>16.00/s) | 335.86ms | 973.42ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_issues | 20/s | 19.27/s (>16.00/s) | 241.59ms | 308.30ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_changes | 20/s | 12.52/s (>8.00/s) | 1679.13ms | 2288.04ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_commits | 20/s | 18.78/s (>9.60/s) | 483.71ms | 745.16ms (<1250ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_request_discussions | 20/s | 18.63/s (>11.20/s) | 951.00ms | 2465.04ms (<4000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_merge_requests | 20/s | 19.25/s (>16.00/s) | 271.19ms | 330.02ms (<500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_project_pipelines | 20/s | 19.07/s (>9.60/s) | 317.45ms | 506.55ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_global | 20/s | 19.18/s (>16.00/s) | 78.72ms | 166.26ms (<1500ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_groups | 20/s | 19.28/s (>16.00/s) | 73.32ms | 132.03ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_search_projects | 20/s | 19.13/s (>16.00/s) | 82.47ms | 231.65ms (<1000ms) | 100.00% (>95%) | **{+Passed+}**
|
|
|
web_user | 20/s | 19.18/s (>9.60/s) | 97.11ms | 124.30ms (<4000ms) | 100.00% (>95%) | **{+Passed+}** |