GitLab Next

* Environment:                25k
* Environment Version:        14.3.0-pre `e6223605761`
* Option:                     60s_500rps
* Date:                       2021-09-02
* Run Time:                   1h 20m 19.09s (Start: 08:40:22 UTC, End: 10:00:41 UTC)
* GPT Version:                v2.8.0

❯ Overall Results Score: 96.56%

NAME                                                     | RPS   | RPS RESULT           | TTFB AVG  | TTFB P90             | REQ STATUS     | RESULT 
---------------------------------------------------------|-------|----------------------|-----------|----------------------|----------------|--------
api_v4_groups                                            | 500/s | 494.17/s (>400.00/s) | 90.63ms   | 101.90ms (<200ms)    | 100.00% (>99%) | Passed 
api_v4_groups_group                                      | 500/s | 382.49/s (>40.00/s)  | 1174.27ms | 1484.72ms (<7500ms)  | 100.00% (>99%) | Passed 
api_v4_groups_group_subgroups                            | 500/s | 495.05/s (>400.00/s) | 104.98ms  | 116.11ms (<200ms)    | 100.00% (>99%) | Passed 
api_v4_groups_issues                                     | 500/s | 153.66/s (>120.00/s) | 2978.00ms | 3950.85ms (<3500ms)  | 100.00% (>99%) | FAILED²
api_v4_groups_merge_requests                             | 500/s | 223.57/s (>120.00/s) | 2023.99ms | 2620.44ms (<3500ms)  | 99.98% (>99%)  | Passed 
api_v4_groups_projects                                   | 500/s | 452.84/s (>200.00/s) | 963.31ms  | 1248.08ms (<3500ms)  | 99.99% (>99%)  | Passed 
api_v4_projects                                          | 500/s | 208.36/s (>60.00/s)  | 2145.70ms | 3031.28ms (<7000ms)  | 100.00% (>99%) | Passed 
api_v4_projects_deploy_keys                              | 500/s | 496.35/s (>400.00/s) | 69.82ms   | 76.45ms (<200ms)     | 100.00% (>99%) | Passed 
api_v4_projects_issues                                   | 500/s | 490.92/s (>400.00/s) | 187.22ms  | 210.13ms (<500ms)    | 100.00% (>99%) | Passed 
api_v4_projects_issues_issue                             | 500/s | 485.17/s (>400.00/s) | 238.62ms  | 278.91ms (<1500ms)   | 100.00% (>99%) | Passed 
api_v4_projects_issues_search                            | 500/s | 82.33/s (>60.00/s)   | 5578.04ms | 9591.67ms (<12000ms) | 100.00% (>99%) | Passed 
api_v4_projects_languages                                | 500/s | 496.33/s (>400.00/s) | 66.27ms   | 70.98ms (<200ms)     | 100.00% (>99%) | Passed 
api_v4_projects_merge_requests                           | 500/s | 490.05/s (>400.00/s) | 215.87ms  | 243.25ms (<400ms)    | 100.00% (>99%) | Passed 
api_v4_projects_merge_requests_merge_request             | 500/s | 110.93/s (>200.00/s) | 4234.76ms | 5605.84ms (<2750ms)  | 100.00% (>99%) | FAILED²
api_v4_projects_merge_requests_merge_request_changes     | 500/s | 70.23/s (>200.00/s)  | 6501.21ms | 8748.29ms (<3500ms)  | 100.00% (>99%) | FAILED²
api_v4_projects_merge_requests_merge_request_commits     | 500/s | 494.36/s (>400.00/s) | 97.19ms   | 107.02ms (<200ms)    | 100.00% (>99%) | Passed 
api_v4_projects_merge_requests_merge_request_discussions | 500/s | 490.54/s (>400.00/s) | 181.13ms  | 206.87ms (<400ms)    | 100.00% (>99%) | Passed 
api_v4_projects_project                                  | 500/s | 485.59/s (>400.00/s) | 159.00ms  | 165.86ms (<200ms)    | 100.00% (>99%) | Passed 
api_v4_projects_project_pipelines                        | 500/s | 496.22/s (>400.00/s) | 81.49ms   | 88.06ms (<200ms)     | 100.00% (>99%) | Passed 
api_v4_projects_project_pipelines_pipeline               | 500/s | 493.93/s (>400.00/s) | 90.11ms   | 97.87ms (<200ms)     | 100.00% (>99%) | Passed 
api_v4_projects_project_services                         | 500/s | 496.57/s (>400.00/s) | 67.75ms   | 73.43ms (<200ms)     | 100.00% (>99%) | Passed 
api_v4_projects_releases                                 | 500/s | 492.63/s (>400.00/s) | 109.33ms  | 118.31ms (<200ms)    | 100.00% (>99%) | Passed 
api_v4_projects_repository_branches                      | 500/s | 490.72/s (>400.00/s) | 69.79ms   | 72.73ms (<200ms)     | 100.00% (>99%) | Passed 
api_v4_projects_repository_branches_branch               | 500/s | 495.14/s (>400.00/s) | 97.51ms   | 105.46ms (<200ms)    | 100.00% (>99%) | Passed 
api_v4_projects_repository_branches_search               | 500/s | 494.49/s (>120.00/s) | 67.76ms   | 72.88ms (<6000ms)    | 100.00% (>99%) | Passed 
api_v4_projects_repository_commits                       | 500/s | 495.46/s (>400.00/s) | 91.44ms   | 99.02ms (<200ms)     | 100.00% (>99%) | Passed 
api_v4_projects_repository_commits_commit                | 500/s | 495.67/s (>400.00/s) | 86.25ms   | 92.81ms (<200ms)     | 100.00% (>99%) | Passed 
api_v4_projects_repository_commits_commit_diff           | 500/s | 493.98/s (>400.00/s) | 130.41ms  | 141.48ms (<200ms)    | 100.00% (>99%) | Passed 
api_v4_projects_repository_compare                       | 500/s | 487.64/s (>400.00/s) | 75.59ms   | 78.89ms (<200ms)     | 100.00% (>99%) | Passed 
api_v4_projects_repository_files_file                    | 500/s | 496.18/s (>400.00/s) | 83.82ms   | 90.89ms (<200ms)     | 100.00% (>99%) | Passed 
api_v4_projects_repository_files_file_blame              | 500/s | 61.38/s (>4.00/s)    | 5071.23ms | 6784.80ms (<35000ms) | 99.67% (>15%)  | Passed 
api_v4_projects_repository_files_file_raw                | 500/s | 494.94/s (>400.00/s) | 87.50ms   | 94.62ms (<200ms)     | 100.00% (>99%) | Passed 
api_v4_projects_repository_tags                          | 500/s | 229.13/s (>80.00/s)  | 1988.91ms | 2774.78ms (<10000ms) | 100.00% (>99%) | Passed 
api_v4_projects_repository_tree                          | 500/s | 494.25/s (>400.00/s) | 116.77ms  | 126.76ms (<200ms)    | 100.00% (>99%) | Passed 
api_v4_user                                              | 500/s | 495.72/s (>400.00/s) | 62.52ms   | 66.64ms (<200ms)     | 100.00% (>99%) | Passed 
api_v4_users                                             | 500/s | 496.29/s (>400.00/s) | 71.46ms   | 76.94ms (<200ms)     | 100.00% (>99%) | Passed 
git_ls_remote                                            | 50/s  | 49.48/s (>40.00/s)   | 86.54ms   | 95.58ms (<200ms)     | 100.00% (>99%) | Passed 
git_pull                                                 | 50/s  | 48.84/s (>40.00/s)   | 127.13ms  | 177.41ms (<400ms)    | 100.00% (>99%) | Passed 
git_push                                                 | 10/s  | 8.64/s (>8.00/s)     | 653.93ms  | 661.13ms (<1000ms)   | 99.65% (>99%)  | Passed 
scenario_api_list_group_variables                        | 5/s   | 4.94/s (>4.00/s)     | 120.43ms  | 139.19ms (<200ms)    | 100.00% (>99%) | Passed 
scenario_api_list_project_variables                      | 5/s   | 4.71/s (>4.00/s)     | 149.87ms  | 161.49ms (<200ms)    | 100.00% (>99%) | Passed 
scenario_api_new_branches                                | 5/s   | 4.67/s (>4.00/s)     | 502.49ms  | 588.91ms (<1500ms)   | 100.00% (>99%) | Passed 
scenario_api_new_commits                                 | 5/s   | 4.56/s (>4.00/s)     | 609.06ms  | 846.37ms (<700ms)    | 100.00% (>99%) | FAILED²
scenario_api_new_group_variables                         | 5/s   | 4.97/s (>4.00/s)     | 137.15ms  | 162.56ms (<200ms)    | 100.00% (>99%) | Passed 
scenario_api_new_issues                                  | 5/s   | 4.67/s (>4.00/s)     | 391.64ms  | 574.89ms (<2500ms)   | 100.00% (>99%) | Passed 
scenario_api_new_project_variables                       | 5/s   | 4.85/s (>4.00/s)     | 165.69ms  | 188.24ms (<200ms)    | 100.00% (>99%) | Passed 
web_group                                                | 50/s  | 49.39/s (>40.00/s)   | 238.08ms  | 294.39ms (<400ms)    | 100.00% (>99%) | Passed 
web_group_issues                                         | 50/s  | 47.68/s (>40.00/s)   | 314.36ms  | 363.35ms (<500ms)    | 100.00% (>99%) | Passed 
web_group_merge_requests                                 | 50/s  | 48.01/s (>40.00/s)   | 292.50ms  | 324.88ms (<500ms)    | 100.00% (>99%) | Passed 
web_project                                              | 50/s  | 47.62/s (>40.00/s)   | 323.39ms  | 350.04ms (<500ms)    | 100.00% (>99%) | Passed 
web_project_branches                                     | 50/s  | 47.32/s (>40.00/s)   | 365.79ms  | 400.60ms (<800ms)    | 100.00% (>99%) | Passed 
web_project_branches_search                              | 50/s  | 46.29/s (>40.00/s)   | 738.96ms  | 796.10ms (<1300ms)   | 100.00% (>99%) | Passed 
web_project_commit                                       | 50/s  | 45.19/s (>16.00/s)   | 693.65ms  | 1886.90ms (<2900ms)  | 100.00% (>99%) | Passed 
web_project_commits                                      | 50/s  | 46.91/s (>40.00/s)   | 435.01ms  | 486.60ms (<750ms)    | 100.00% (>99%) | Passed 
web_project_file_blame                                   | 50/s  | 14.78/s (>0.40/s)    | 2610.18ms | 3067.05ms (<7000ms)  | 100.00% (>99%) | Passed 
web_project_file_rendered                                | 50/s  | 40.86/s (>32.00/s)   | 727.65ms  | 1056.14ms (<1700ms)  | 100.00% (>99%) | Passed 
web_project_file_source                                  | 50/s  | 47.82/s (>4.00/s)    | 567.09ms  | 805.88ms (<1700ms)   | 100.00% (>99%) | Passed 
web_project_files                                        | 50/s  | 48.49/s (>40.00/s)   | 187.17ms  | 251.79ms (<800ms)    | 100.00% (>99%) | Passed 
web_project_issue                                        | 50/s  | 48.81/s (>40.00/s)   | 328.94ms  | 769.64ms (<2000ms)   | 100.00% (>99%) | Passed 
web_project_issues                                       | 50/s  | 47.88/s (>40.00/s)   | 327.47ms  | 358.66ms (<500ms)    | 100.00% (>99%) | Passed 
web_project_issues_search                                | 50/s  | 47.98/s (>40.00/s)   | 314.44ms  | 339.17ms (<500ms)    | 100.00% (>99%) | Passed 
web_project_merge_request                                | 50/s  | 46.19/s (>16.00/s)   | 959.31ms  | 3537.56ms (<7500ms)  | 100.00% (>99%) | Passed 
web_project_merge_request_changes                        | 50/s  | 35.15/s (>40.00/s)   | 433.85ms  | 645.39ms (<1500ms)   | 99.96% (>99%)  | Passed 
web_project_merge_request_commits                        | 50/s  | 46.19/s (>24.00/s)   | 656.66ms  | 900.00ms (<1750ms)   | 100.00% (>99%) | Passed 
web_project_merge_requests                               | 50/s  | 47.44/s (>40.00/s)   | 340.53ms  | 379.39ms (<500ms)    | 100.00% (>99%) | Passed 
web_project_pipelines                                    | 50/s  | 48.67/s (>24.00/s)   | 303.60ms  | 418.05ms (<1000ms)   | 100.00% (>99%) | Passed 
web_project_pipelines_pipeline                           | 50/s  | 48.41/s (>40.00/s)   | 543.55ms  | 1046.03ms (<2500ms)  | 100.00% (>99%) | Passed 
web_project_repository_compare                           | 50/s  | 6.95/s (>2.00/s)     | 4338.49ms | 4882.28ms (<7500ms)  | 100.00% (>99%) | Passed 
web_project_tags                                         | 50/s  | 45.83/s (>32.00/s)   | 751.56ms  | 823.53ms (<1500ms)   | 100.00% (>99%) | Passed 
web_user                                                 | 50/s  | 49.44/s (>24.00/s)   | 193.65ms  | 272.07ms (<4000ms)   | 100.00% (>99%) | Passed 

Metrics Snapshot - https://snapshot.raintank.io/dashboard/snapshot/9dxbJCZzUitA2p4bL2kb4uny40vgGlSM