Experiment with new private runner machine types for gitlab-org/gitlab pipeline => 100%
This issue is only for tracking purpose of gitlab-com/www-gitlab-com#10623 (closed) (for this board: https://gitlab.com/groups/gitlab-org/-/boards/978615?label_name[]=Engineering%20Productivity).
- Runners: https://console.cloud.google.com/compute/instances?project=gitlab-qa-resources&instancessize=200&instancesquery=%255B%257B_22k_22_3A_22name_22_2C_22t_22_3A10_2C_22v_22_3A_22_5C_22rymai_5C_22_22%257D_2C%257B_22k_22_3A_22name_22_2C_22t_22_3A10_2C_22v_22_3A_22_5C_22runner_5C_22_22%257D%255D
- Shared cache GCP storage bucket: https://console.cloud.google.com/storage/browser/rymai-autoscale-runner-manager-cache;tab=permissions?project=gitlab-qa-resources
- Service account: https://console.cloud.google.com/iam-admin/serviceaccounts/details/114998588489050480943/permissions?project=gitlab-qa-resources
- VM instance pricing: https://cloud.google.com/compute/vm-instance-pricing#general-purpose_machine_type_family
Preliminary work
- Set up auto-scale runner managers:
- Testing MRs:
- Ensuring caches are refreshed: https://gitlab.com/gitlab-org/gitlab/-/pipelines/265516050
- Then both MRs are set to Draft so that pipelines run for non-Merged results so that gems/packages don't change and cache can be fully used equally by all pipelines.
- Create a script to automate the analysis: gitlab-org/quality/toolbox!69 (merged)
Prices per month - https://cloud.google.com/compute/vm-instance-pricing
N1 standard machine types (General-purpose machine type family) (current GitLab shared runners)
| Machine type | Virtual CPUs | Memory | Price (USD) | Preemptible price (USD) | 1-year CUD | 3-year CUD |
|---|---|---|---|---|---|---|
| n1-standard-2 | 2 | 7.5GB | $48.54 |
$14.60 |
$43.61 |
$31.185 |
| n1-standard-4 | 4 | 15GB | $97.09 |
$29.2 |
$87.22 |
$62.37 |
E2 standard machine types (General-purpose machine type family)
| Machine type | Virtual CPUs | Memory | Price (USD) | Preemptible price (USD) | 1-year CUD | 3-year CUD |
|---|---|---|---|---|---|---|
| e2-standard-2 | 2 | 8GB | $48.91 |
$14.67 |
$30.78 |
$22 |
| e2-standard-4 | 4 | 16GB | $97.83 |
$29.35 |
$61.56 |
$44 |
N2 machine types
| Machine type | Virtual CPUs | Memory | Price (USD) | Preemptible price (USD) | 1-year CUD | 3-year CUD |
|---|---|---|---|---|---|---|
| n2-standard-2 | 2 | 8 | $56.72 |
$17.18 |
$44.68 |
$31.88 |
| n2-standard-4 | 4 | 16 | $113.43 |
$34.37 |
$89.36 |
$63.76 |
N2D machine types
| Machine type | Virtual CPUs | Memory | Price (USD) | Preemptible price (USD) | 1-year CUD | 3-year CUD |
|---|---|---|---|---|---|---|
| n2d-standard-2 | 2 | 8 | $49.34 |
$14.93 |
$38.9 |
$27.74 |
| n2d-standard-4 | 4 | 16 | $98.69 |
$29.85 |
$77.8 |
$55.48 |
| n2d-highcpu-2 | 2 | 2 | $36.43 |
$11.02 |
$28.7 |
$20.48 |
| n2d-highcpu-4 | 4 | 4 | $72.86 |
$22.04 |
$57.4 |
$40.96 |
C2 machine types
| Machine type | Virtual CPUs | Memory | Price (USD) | Preemptible price (USD) | 1-year CUD | 3-year CUD |
|---|---|---|---|---|---|---|
| c2-standard-4 | 4 | 16 | $121.9392 |
$36.8650 |
$96.03 |
$60.94 |
Automated analysis
Machine type results (based on raw durations regardless of price difference)
- c2-standard-4 (best on 44 jobs, worst on 0 jobs)
🏆 - n2d-standard-4 (best on 10 jobs, worst on 0 jobs)
- n2-standard-4 (best on 9 jobs, worst on 0 jobs)
- n2-standard-2 (best on 4 jobs, worst on 0 jobs)
- n2d-standard-2 (best on 1 jobs, worst on 0 jobs)
- n1-standard-4 (best on 1 jobs, worst on 1 jobs)
- e2-standard-2 (best on 0 jobs, worst on 7 jobs)
- e2-standard-4 (best on 0 jobs, worst on 5 jobs)
- n1-standard-2 (best on 0 jobs, worst on 56 jobs)
🐢
With no surprise the c2-standard-4 machine type is the best here since it allows for more multi-threading.
Machine type results with timings pro-rated with price coefficient compared to the n1-standard-2 un-discounted price
- n2d-standard-2 (best on 55 jobs, worst on 0 jobs)
🏆 - n2-standard-2 (best on 7 jobs, worst on 0 jobs)
- n2d-standard-4 (best on 6 jobs, worst on 0 jobs)
- e2-standard-2 (best on 1 jobs, worst on 0 jobs)
- n2-standard-4 (best on 0 jobs, worst on 3 jobs)
- n1-standard-4 (best on 0 jobs, worst on 3 jobs)
- c2-standard-4 (best on 0 jobs, worst on 14 jobs)
- e2-standard-4 (best on 0 jobs, worst on 41 jobs)
🐢 - n1-standard-2 (best on 0 jobs, worst on 8 jobs)
With no price discount, n2d-standard-2 machine type is the best.
Machine type results with timings pro-rated with price coefficient compared to the n1-standard-2 1-year CUD price
- e2-standard-2 (best on 33 jobs, worst on 0 jobs)
🏆 - n2d-standard-2 (best on 27 jobs, worst on 0 jobs)
- n2d-standard-4 (best on 5 jobs, worst on 1 jobs)
- n2-standard-2 (best on 4 jobs, worst on 0 jobs)
- n2-standard-4 (best on 0 jobs, worst on 2 jobs)
- e2-standard-4 (best on 0 jobs, worst on 1 jobs)
- c2-standard-4 (best on 0 jobs, worst on 7 jobs)
- n1-standard-4 (best on 0 jobs, worst on 49 jobs)
🐢 - n1-standard-2 (best on 0 jobs, worst on 9 jobs)
With a 1-year CUD price discount, e2-standard-2 machine type is the best, followed by the n2d-standard-2 machine type.
Machine type results with timings pro-rated with price coefficient compared to the n1-standard-2 3-year CUD price
- e2-standard-2 (best on 31 jobs, worst on 0 jobs)
🏆 - n2d-standard-2 (best on 29 jobs, worst on 0 jobs)
- n2d-standard-4 (best on 5 jobs, worst on 1 jobs)
- n2-standard-2 (best on 4 jobs, worst on 0 jobs)
- e2-standard-4 (best on 0 jobs, worst on 1 jobs)
- n2-standard-4 (best on 0 jobs, worst on 3 jobs)
- n1-standard-4 (best on 0 jobs, worst on 55 jobs)
🐢 - n1-standard-2 (best on 0 jobs, worst on 9 jobs)
With a 3-year CUD price discount, e2-standard-2 machine type is the best, followed closely by the n2d-standard-2 machine type.
Comparing exclusively e2-standard-2, and n2d-standard-2 (based on raw durations regardless of price difference)
- n2d-standard-2 (best on 66 jobs, worst on 3 jobs)
🏆 - e2-standard-2 (best on 3 jobs, worst on 66 jobs)
🐢
Comparing exclusively e2-standard-2, and n2d-standard-2 with timings pro-rated with price coefficient compared to the n1-standard-2 un-discounted price
- n2d-standard-2 (best on 66 jobs, worst on 3 jobs)
🏆 - e2-standard-2 (best on 3 jobs, worst on 66 jobs)
🐢
Comparing exclusively e2-standard-2, and n2d-standard-2 with timings pro-rated with price coefficient compared to the n1-standard-2 1-year CUD price
- e2-standard-2 (best on 41 jobs, worst on 28 jobs)
🏆 - n2d-standard-2 (best on 28 jobs, worst on 41 jobs)
🐢
Comparing exclusively e2-standard-2, and n2d-standard-2 with timings pro-rated with price coefficient compared to the n1-standard-2 3-year CUD price
- e2-standard-2 (best on 39 jobs, worst on 30 jobs)
🏆 - n2d-standard-2 (best on 30 jobs, worst on 39 jobs)
🐢
Details per job
| brakeman-sast | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 326.61440000000005 |
286.337 |
| p50 | 313.933 |
285.999 |
| p80 | 345.7472 |
292.06419999999997 |
| p90 | 354.4496 |
292.4326 |
| p95 | 358.8008 |
292.6168 |
| min | 306.301 |
278.896 |
| max | 363.152 |
292.801 |
| build-assets-image | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 96.61240000000001 |
66.108 |
| p50 | 100.594 |
64.75 |
| p80 | 100.7502 |
68.5532 |
| p90 | 100.7506 |
70.3076 |
| p95 | 100.7508 |
71.1848 |
| min | 85.908 |
62.832 |
| max | 100.751 |
72.062 |
| build-qa-image | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 115.1946 |
95.89200000000001 |
| p50 | 117.509 |
94.614 |
| p80 | 117.9986 |
98.0836 |
| p90 | 118.8178 |
99.4208 |
| p95 | 119.2274 |
100.0894 |
| min | 108.603 |
93.206 |
| max | 119.637 |
100.758 |
| compile-production-assets | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 405.9742 |
329.6418 |
| p50 | 428.206 |
363.398 |
| p80 | 434.6966 |
371.3732 |
| p90 | 442.9638 |
372.2396 |
| p95 | 447.0974 |
372.6728 |
| min | 312.289 |
255.177 |
| max | 451.231 |
373.106 |
| compile-test-assets | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 361.7408 |
335.7426 |
| p50 | 378.505 |
334.445 |
| p80 | 382.49219999999997 |
338.59459999999996 |
| p90 | 384.2926 |
345.01779999999997 |
| p95 | 385.19280000000003 |
348.2294 |
| min | 299.025 |
328.471 |
| max | 386.093 |
351.441 |
| compile-test-assets as-if-foss | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 442.1402 |
369.7812 |
| p50 | 461.109 |
385.876 |
| p80 | 463.26160000000004 |
395.8162 |
| p90 | 465.25280000000004 |
398.8966 |
| p95 | 466.2484 |
400.4368 |
| min | 372.782 |
283.534 |
| max | 467.244 |
401.977 |
| coverage-frontend | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 85.7868 |
86.5524 |
| p50 | 85.774 |
85.549 |
| p80 | 86.6388 |
90.0228 |
| p90 | 86.6564 |
94.5944 |
| p95 | 86.6652 |
96.8802 |
| min | 84.68 |
78.18 |
| max | 86.674 |
99.166 |
| danger-review | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 233.7162 |
211.22199999999998 |
| p50 | 224.54 |
209.758 |
| p80 | 248.3654 |
213.57680000000002 |
| p90 | 249.8902 |
214.6784 |
| p95 | 250.6526 |
215.2292 |
| min | 220.56 |
208.429 |
| max | 251.415 |
215.78 |
| db:check-schema | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 247.75680000000003 |
172.5972 |
| p50 | 275.907 |
130.721 |
| p80 | 278.916 |
263.638 |
| p90 | 279.41200000000003 |
264.326 |
| p95 | 279.66 |
264.67 |
| min | 135.256 |
100.572 |
| max | 279.908 |
265.014 |
| dependency_scanning bundler-audit | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 49.8096 |
42.4112 |
| p50 | 50.208 |
37.752 |
| p80 | 50.5532 |
44.120000000000005 |
| p90 | 50.8836 |
53.42799999999999 |
| p95 | 51.0488 |
58.081999999999994 |
| min | 48.559 |
36.027 |
| max | 51.214 |
62.736 |
| dependency_scanning gemnasium | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 357.9036 |
326.746 |
| p50 | 357.558 |
327.089 |
| p80 | 358.6776 |
330.81419999999997 |
| p90 | 359.8048 |
330.9266 |
| p95 | 360.3684 |
330.9828 |
| min | 355.722 |
320.843 |
| max | 360.932 |
331.039 |
| dependency_scanning gemnasium-python | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 59.051199999999994 |
49.0622 |
| p50 | 57.875 |
49.207 |
| p80 | 63.1468 |
49.7826 |
| p90 | 63.672399999999996 |
50.6458 |
| p95 | 63.935199999999995 |
51.0774 |
| min | 53.98 |
46.429 |
| max | 64.198 |
51.509 |
| dependency_scanning retire-js | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 233.12040000000002 |
201.1832 |
| p50 | 231.942 |
200.464 |
| p80 | 238.43439999999998 |
203.483 |
| p90 | 243.8652 |
204.797 |
| p95 | 246.5806 |
205.45399999999998 |
| min | 223.083 |
197.631 |
| max | 249.296 |
206.111 |
| detect-tests | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 126.502 |
146.8692 |
| p50 | 144.269 |
166.235 |
| p80 | 146.47719999999998 |
173.1258 |
| p90 | 147.0076 |
180.79739999999998 |
| p95 | 147.27280000000002 |
184.6332 |
| min | 95.866 |
93.116 |
| max | 147.538 |
188.469 |
| detect-tests as-if-foss | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 115.89020000000001 |
148.7566 |
| p50 | 103.394 |
165.865 |
| p80 | 138.88 |
170.81099999999998 |
| p90 | 143.47 |
174.069 |
| p95 | 145.765 |
175.698 |
| min | 93.713 |
92.342 |
| max | 148.06 |
177.327 |
| dont-interrupt-me | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 11.505500000000001 |
10.472 |
| p50 | 11.567 |
9.965 |
| p80 | 12.138200000000001 |
11.517199999999999 |
| p90 | 12.5516 |
12.0346 |
| p95 | 12.758299999999998 |
12.293299999999999 |
| min | 9.923 |
8.899 |
| max | 12.965 |
12.552 |
| downtime_check | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 173.5504 |
164.785 |
| p50 | 222.662 |
215.772 |
| p80 | 223.7804 |
216.92919999999998 |
| p90 | 224.4512 |
217.0536 |
| p95 | 224.78660000000002 |
217.1158 |
| min | 94.795 |
86.382 |
| max | 225.122 |
217.178 |
| eslint-sast | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 100.5392 |
74.00319999999999 |
| p50 | 98.656 |
74.28 |
| p80 | 104.6198 |
74.73599999999999 |
| p90 | 105.68939999999999 |
75.056 |
| p95 | 106.2242 |
75.21600000000001 |
| min | 94.956 |
72.437 |
| max | 106.759 |
75.376 |
| gitlab_git_test | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 110.16159999999999 |
87.04719999999999 |
| p50 | 128.762 |
93.188 |
| p80 | 129.4556 |
103.8264 |
| p90 | 129.98080000000002 |
115.6792 |
| p95 | 130.2434 |
121.6056 |
| min | 40.738 |
27.427 |
| max | 130.506 |
127.532 |
| graphql-schema-dump | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 176.946 |
163.9918 |
| p50 | 225.181 |
216.823 |
| p80 | 226.19480000000001 |
218.09879999999998 |
| p90 | 226.2464 |
219.0404 |
| p95 | 226.2722 |
219.5112 |
| min | 97.047 |
81.459 |
| max | 226.298 |
219.982 |
| graphql-verify | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 228.18179999999998 |
180.3656 |
| p50 | 234.873 |
211.999 |
| p80 | 238.698 |
225.423 |
| p90 | 241.782 |
225.525 |
| p95 | 243.324 |
225.57600000000002 |
| min | 207.418 |
93.168 |
| max | 244.866 |
225.627 |
| jest | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 968.5337499999998 |
699.9722 |
| p50 | 970.392 |
677.5060000000001 |
| p80 | 982.514 |
760.4380000000001 |
| p90 | 995.6191 |
785.9311 |
| p95 | 1041.01235 |
792.61325 |
| min | 843.147 |
636.151 |
| max | 1079.247 |
795.24 |
| jest-as-if-foss | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 996.2839 |
670.6241 |
| p50 | 983.9745 |
664.3789999999999 |
| p80 | 1012.1858 |
686.3484 |
| p90 | 1054.2455 |
703.9135 |
| p95 | 1066.99175 |
706.30525 |
| min | 964.639 |
644.171 |
| max | 1079.738 |
708.697 |
| jest-integration | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 233.19340000000003 |
146.3752 |
| p50 | 254.958 |
130.886 |
| p80 | 258.7068 |
155.24080000000004 |
| p90 | 263.7884 |
200.71839999999997 |
| p95 | 266.3292 |
223.4572 |
| min | 138.392 |
104.471 |
| max | 268.87 |
246.196 |
| karma | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 171.3346 |
91.4006 |
| p50 | 217.331 |
94.203 |
| p80 | 228.0524 |
96.071 |
| p90 | 228.8132 |
96.48899999999999 |
| p95 | 229.1936 |
96.698 |
| min | 90.129 |
81.204 |
| max | 229.574 |
96.907 |
| karma-as-if-foss | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 209.3424 |
83.1468 |
| p50 | 203.204 |
81.123 |
| p80 | 223.0464 |
89.30760000000001 |
| p90 | 223.6752 |
89.5468 |
| p95 | 223.9896 |
89.6664 |
| min | 197.693 |
75.07 |
| max | 224.304 |
89.786 |
| license_scanning | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 755.5813999999999 |
583.1214 |
| p50 | 745.188 |
580.419 |
| p80 | 757.2346 |
587.9272000000001 |
| p90 | 780.8038 |
590.2376 |
| p95 | 792.5884000000001 |
591.3928 |
| min | 739.583 |
576.075 |
| max | 804.373 |
592.548 |
| lint-yaml | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 40.5122 |
31.4296 |
| p50 | 37.776 |
31.915 |
| p80 | 45.2438 |
32.535199999999996 |
| p90 | 46.151399999999995 |
32.5856 |
| p95 | 46.605199999999996 |
32.610800000000005 |
| min | 36.266 |
29.637 |
| max | 47.059 |
32.636 |
| memory-on-boot | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 371.7934000000001 |
304.7928 |
| p50 | 379.514 |
335.036 |
| p80 | 380.6156 |
336.8598 |
| p90 | 381.6188 |
337.2654 |
| p95 | 382.1204 |
337.46819999999997 |
| min | 355.701 |
182.495 |
| max | 382.622 |
337.671 |
| memory-static | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 265.95779999999996 |
240.91440000000003 |
| p50 | 263.882 |
245.722 |
| p80 | 271.8184 |
246.9172 |
| p90 | 272.6812 |
246.9736 |
| p95 | 273.1126 |
247.0018 |
| min | 258.999 |
222.144 |
| max | 273.544 |
247.03 |
| nodejs-scan-sast | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1620.5826000000002 |
1274.8282 |
| p50 | 1617.121 |
1275.147 |
| p80 | 1637.2344 |
1277.2354 |
| p90 | 1642.1671999999999 |
1280.6462 |
| p95 | 1644.6336 |
1282.3516 |
| min | 1600.982 |
1267.055 |
| max | 1647.1 |
1284.057 |
| qa:internal | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 135.1844 |
94.4302 |
| p50 | 137.413 |
132.58 |
| p80 | 138.91819999999998 |
133.5114 |
| p90 | 139.1846 |
133.65019999999998 |
| p95 | 139.3178 |
133.71959999999999 |
| min | 127.754 |
36.072 |
| max | 139.451 |
133.789 |
| qa:internal-as-if-foss | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 110.0248 |
112.4434 |
| p50 | 139.208 |
132.91 |
| p80 | 146.2794 |
133.7212 |
| p90 | 157.61219999999997 |
133.9376 |
| p95 | 163.27859999999998 |
134.04579999999999 |
| min | 45.374 |
37.004 |
| max | 168.945 |
134.154 |
| qa:selectors | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 114.352 |
92.1884 |
| p50 | 133.539 |
130.756 |
| p80 | 135.3042 |
132.1224 |
| p90 | 135.8526 |
133.15120000000002 |
| p95 | 136.1268 |
133.6656 |
| min | 39.379 |
32.165 |
| max | 136.401 |
134.18 |
| qa:selectors-as-if-foss | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 113.46600000000001 |
109.2404 |
| p50 | 133.113 |
130.047 |
| p80 | 134.5642 |
130.3528 |
| p90 | 134.8946 |
130.4184 |
| p95 | 135.0598 |
130.4512 |
| min | 43.615 |
30.161 |
| max | 135.225 |
130.484 |
| retrieve-tests-metadata | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 84.49519999999998 |
75.069 |
| p50 | 82.986 |
75.705 |
| p80 | 91.26039999999999 |
80.1244 |
| p90 | 91.7892 |
85.58919999999999 |
| p95 | 92.0536 |
88.3216 |
| min | 74.496 |
60.597 |
| max | 92.318 |
91.054 |
| rspec fail-fast | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 355.3606 |
280.43760000000003 |
| p50 | 357.399 |
272.018 |
| p80 | 361.2748 |
331.3362 |
| p90 | 364.1104 |
334.3746 |
| p95 | 365.5282 |
335.8938 |
| min | 343.936 |
192.287 |
| max | 366.946 |
337.413 |
| rspec foss-impact | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 305.3712 |
200.7926 |
| p50 | 303.835 |
188.334 |
| p80 | 307.8934 |
263.2702 |
| p90 | 311.7342 |
277.60659999999996 |
| p95 | 313.6546 |
284.77479999999997 |
| min | 297.889 |
127.183 |
| max | 315.575 |
291.943 |
| rspec frontend_fixture | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 501.87019999999995 |
431.7192 |
| p50 | 507.313 |
437.167 |
| p80 | 522.1634 |
439.3418 |
| p90 | 522.2722 |
441.0874 |
| p95 | 522.3266 |
441.96020000000004 |
| min | 478.456 |
408.195 |
| max | 522.381 |
442.833 |
| rspec frontend_fixture as-if-foss | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 468.7853999999999 |
409.6324000000001 |
| p50 | 471.484 |
416.038 |
| p80 | 481.1438 |
417.22999999999996 |
| p90 | 484.1574 |
418.13599999999997 |
| p95 | 485.6642 |
418.589 |
| min | 440.694 |
380.891 |
| max | 487.171 |
419.042 |
| rspec integration pg11 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1345.4286499999998 |
1042.8200749999999 |
| p50 | 1331.525 |
1073.1285 |
| p80 | 1404.2066000000002 |
1096.1394 |
| p90 | 1491.0244 |
1102.6225 |
| p95 | 1534.7654499999999 |
1117.63195 |
| min | 1095.337 |
875.01 |
| max | 1747.072 |
1131.011 |
| rspec integration pg12 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1351.0507 |
1004.3312749999999 |
| p50 | 1350.4029999999998 |
1025.2305000000001 |
| p80 | 1460.8962000000001 |
1073.3666 |
| p90 | 1493.1173000000001 |
1096.8882 |
| p95 | 1545.44645 |
1122.18095 |
| min | 1085.067 |
867.277 |
| max | 1567.924 |
1152.707 |
| rspec migration pg12 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1954.2135999999998 |
1475.3336400000003 |
| p50 | 2085.844 |
1691.312 |
| p80 | 2412.8382000000006 |
1821.8792 |
| p90 | 2515.3282 |
1948.3058 |
| p95 | 2526.109 |
1957.8029999999999 |
| min | 979.897 |
767.52 |
| max | 2720.494 |
2015.438 |
| rspec system pg11 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1159.1811666666667 |
913.8451083333331 |
| p50 | 1152.3525 |
929.71 |
| p80 | 1216.9736 |
972.9874 |
| p90 | 1288.4618 |
1004.7560000000001 |
| p95 | 1335.35225 |
1056.64955 |
| min | 961.623 |
617.161 |
| max | 1431.744 |
1185.038 |
| rspec system pg12 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1176.221858333334 |
880.0642416666664 |
| p50 | 1173.5929999999998 |
892.644 |
| p80 | 1250.1914 |
960.299 |
| p90 | 1287.5820999999999 |
985.8930000000001 |
| p95 | 1306.1996 |
1021.84745 |
| min | 899.457 |
655.223 |
| max | 1440.323 |
1073.689 |
| rspec unit pg11 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1294.9866799999995 |
1006.9258699999998 |
| p50 | 1323.4965 |
1010.4490000000001 |
| p80 | 1419.736 |
1092.6198 |
| p90 | 1456.8998 |
1109.0479 |
| p95 | 1538.4694 |
1129.3073 |
| min | 950.277 |
729.133 |
| max | 1597.767 |
1196.184 |
| rspec unit pg12 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1289.8600299999996 |
983.1337777777778 |
| p50 | 1302.017 |
986.216 |
| p80 | 1414.8564000000001 |
1073.4694 |
| p90 | 1477.5217 |
1102.6453999999999 |
| p95 | 1516.8049 |
1113.3971000000001 |
| min | 915.233 |
753.506 |
| max | 1572.356 |
1154.388 |
| rspec-ee frontend_fixture | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 596.8254 |
507.88530000000003 |
| p50 | 591.7760000000001 |
452.96500000000003 |
| p80 | 710.6518 |
615.3416 |
| p90 | 728.6799 |
621.5779 |
| p95 | 734.17395 |
629.16445 |
| min | 457.652 |
397.273 |
| max | 739.668 |
636.751 |
| rspec-ee integration pg11 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1107.15345 |
847.7888500000001 |
| p50 | 1092.429 |
864.378 |
| p80 | 1219.0254 |
937.5606 |
| p90 | 1239.2442 |
952.3696 |
| p95 | 1255.1697000000001 |
964.3114500000001 |
| min | 911.395 |
681.776 |
| max | 1285.488 |
1054.304 |
| rspec-ee integration pg11 geo | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 605.9413999999999 |
384.9822 |
| p50 | 636.726 |
366.659 |
| p80 | 641.3778 |
404.4842 |
| p90 | 645.4514 |
422.96259999999995 |
| p95 | 647.4882 |
432.2018 |
| min | 511.685 |
360.248 |
| max | 649.525 |
441.441 |
| rspec-ee integration pg12 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1136.9855000000002 |
869.0492 |
| p50 | 1139.4180000000001 |
877.017 |
| p80 | 1208.5096000000003 |
919.8742000000001 |
| p90 | 1291.2767 |
967.5134 |
| p95 | 1292.4799500000001 |
992.4153 |
| min | 934.332 |
732.773 |
| max | 1296.754 |
1014.556 |
| rspec-ee integration pg12 geo | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 662.1719999999999 |
508.0924 |
| p50 | 672.055 |
534.31 |
| p80 | 692.1564 |
552.2302 |
| p90 | 701.1532 |
558.0586 |
| p95 | 705.6516 |
560.9728 |
| min | 581.978 |
367.327 |
| max | 710.15 |
563.887 |
| rspec-ee migration pg12 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1541.7215 |
1139.5934000000002 |
| p50 | 1487.8905 |
1170.232 |
| p80 | 2045.2685999999999 |
1494.644 |
| p90 | 2085.0347 |
1565.618 |
| p95 | 2128.01735 |
1593.887 |
| min | 1001.237 |
663.541 |
| max | 2171.0 |
1622.156 |
| rspec-ee system pg11 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1299.0915 |
956.3360689655171 |
| p50 | 1305.095 |
936.267 |
| p80 | 1375.3966 |
1037.4432000000002 |
| p90 | 1394.4776 |
1065.3094 |
| p95 | 1413.628 |
1073.2982 |
| min | 1113.546 |
811.28 |
| max | 1460.328 |
1083.028 |
| rspec-ee system pg11 geo | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 727.7954 |
523.0474 |
| p50 | 741.18 |
484.025 |
| p80 | 759.1673999999999 |
547.0680000000001 |
| p90 | 765.1522 |
601.564 |
| p95 | 768.1446 |
628.8119999999999 |
| min | 640.396 |
475.61 |
| max | 771.137 |
656.06 |
| rspec-ee system pg12 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1295.3683333333333 |
988.3517241379311 |
| p50 | 1316.0394999999999 |
1007.166 |
| p80 | 1394.4988 |
1065.6968 |
| p90 | 1435.632 |
1080.9508 |
| p95 | 1464.9281999999998 |
1098.6202 |
| min | 1013.374 |
737.265 |
| max | 1483.909 |
1160.328 |
| rspec-ee system pg12 geo | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 766.8055999999999 |
605.4558 |
| p50 | 775.7 |
647.512 |
| p80 | 801.6754 |
679.254 |
| p90 | 817.5441999999999 |
681.108 |
| p95 | 825.4786 |
682.035 |
| min | 706.212 |
481.069 |
| max | 833.413 |
682.962 |
| rspec-ee unit pg11 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1647.30934 |
1298.7583600000003 |
| p50 | 1594.8555000000001 |
1260.229 |
| p80 | 1937.7292000000002 |
1535.4515999999999 |
| p90 | 2130.3945 |
1635.6814000000002 |
| p95 | 2210.279 |
1709.59585 |
| min | 1152.573 |
892.967 |
| max | 2462.964 |
1771.601 |
| rspec-ee unit pg11 geo | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1083.3391 |
747.693 |
| p50 | 1054.9650000000001 |
731.6510000000001 |
| p80 | 1285.3708 |
898.7158 |
| p90 | 1289.498 |
991.3663 |
| p95 | 1307.48 |
1001.53315 |
| min | 813.657 |
433.892 |
| max | 1325.462 |
1011.7 |
| rspec-ee unit pg12 | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1704.0473800000004 |
1290.54148 |
| p50 | 1621.0915 |
1234.676 |
| p80 | 1978.4626 |
1527.6260000000002 |
| p90 | 2074.0608 |
1634.9969 |
| p95 | 2213.3034 |
1670.11975 |
| min | 1173.777 |
887.596 |
| max | 2285.96 |
1748.724 |
| rspec-ee unit pg12 geo | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 1016.5853999999999 |
811.0550999999999 |
| p50 | 960.304 |
866.567 |
| p80 | 1151.151 |
913.4354 |
| p90 | 1258.4471999999998 |
985.7231999999999 |
| p95 | 1324.4900999999998 |
1065.9230999999997 |
| min | 804.758 |
421.221 |
| max | 1390.533 |
1146.123 |
| rspec:coverage | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 329.51480000000004 |
228.32379999999998 |
| p50 | 332.479 |
229.118 |
| p80 | 364.2262 |
231.55180000000001 |
| p90 | 373.7406 |
233.0674 |
| p95 | 378.4978 |
233.8252 |
| min | 280.903 |
221.38 |
| max | 383.255 |
234.583 |
| run-dev-fixtures | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 305.78180000000003 |
217.80700000000002 |
| p50 | 305.648 |
257.996 |
| p80 | 308.8596 |
283.1222 |
| p90 | 312.0428 |
284.5606 |
| p95 | 313.63439999999997 |
285.2798 |
| min | 295.869 |
128.71 |
| max | 315.226 |
285.999 |
| run-dev-fixtures-ee | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 368.806 |
244.669 |
| p50 | 370.193 |
197.104 |
| p80 | 374.076 |
342.503 |
| p90 | 381.436 |
342.793 |
| p95 | 385.116 |
342.93800000000005 |
| min | 351.792 |
144.615 |
| max | 388.796 |
343.083 |
| secrets-sast | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 128.87960000000004 |
103.8622 |
| p50 | 128.143 |
103.627 |
| p80 | 132.459 |
104.9862 |
| p90 | 133.149 |
106.07260000000001 |
| p95 | 133.494 |
106.61580000000001 |
| min | 124.18 |
101.742 |
| max | 133.839 |
107.159 |
| setup-test-env | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 604.153 |
475.30879999999996 |
| p50 | 631.576 |
529.794 |
| p80 | 632.9726 |
531.065 |
| p90 | 635.4378 |
531.679 |
| p95 | 636.6704 |
531.986 |
| min | 493.642 |
382.55 |
| max | 637.903 |
532.293 |
| static-analysis | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 635.22725 |
535.24795 |
| p50 | 595.413 |
504.71299999999997 |
| p80 | 840.2504 |
649.0688 |
| p90 | 886.2484 |
781.7592 |
| p95 | 897.9930999999999 |
784.8962 |
| min | 448.953 |
320.431 |
| max | 904.759 |
804.451 |
| verify-tests-yml | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 40.681400000000004 |
33.4914 |
| p50 | 39.307 |
33.628 |
| p80 | 42.809599999999996 |
34.7018 |
| p90 | 43.5068 |
34.873400000000004 |
| p95 | 43.8554 |
34.9592 |
| min | 38.483 |
32.058 |
| max | 44.204 |
35.045 |
| webpack-dev-server | e2-standard-2 |
n2d-standard-2 |
|---|---|---|
| avg | 335.0364 |
259.5096 |
| p50 | 332.766 |
278.746 |
| p80 | 340.1594 |
284.10020000000003 |
| p90 | 344.9742 |
284.2346 |
| p95 | 347.3816 |
284.3018 |
| min | 322.875 |
171.79 |
| max | 349.789 |
284.369 |
For CI jobs, the n2d-standard-2 machine type seems to almost always be better than the e2-standard-2 machine type, so we might want to commit for this as we'd save already 3.4$ / instance / month (we'd save $9 / instance / month with e2-standard-2).
Pipelines list
n1-standard-2
- https://gitlab.com/gitlab-org/gitlab/pipelines/265681900
- https://gitlab.com/gitlab-org/gitlab/pipelines/265682278
- https://gitlab.com/gitlab-org/gitlab/pipelines/265852223
- https://gitlab.com/gitlab-org/gitlab/pipelines/265855733
- https://gitlab.com/gitlab-org/gitlab/pipelines/265855817
n1-standard-4
- https://gitlab.com/gitlab-org/gitlab/pipelines/267074963
- https://gitlab.com/gitlab-org/gitlab/pipelines/267081314
- https://gitlab.com/gitlab-org/gitlab/pipelines/267096130
- https://gitlab.com/gitlab-org/gitlab/pipelines/267108824
- https://gitlab.com/gitlab-org/gitlab/pipelines/267119602
e2-standard-2
- https://gitlab.com/gitlab-org/gitlab/pipelines/265923277
- https://gitlab.com/gitlab-org/gitlab/pipelines/265924017
- https://gitlab.com/gitlab-org/gitlab/pipelines/266035530
- https://gitlab.com/gitlab-org/gitlab/pipelines/266035566
- https://gitlab.com/gitlab-org/gitlab/pipelines/266036601
e2-standard-4
- https://gitlab.com/gitlab-org/gitlab/pipelines/267183916
- https://gitlab.com/gitlab-org/gitlab/pipelines/267190658
- https://gitlab.com/gitlab-org/gitlab/pipelines/267210060
- https://gitlab.com/gitlab-org/gitlab/pipelines/267225328
- https://gitlab.com/gitlab-org/gitlab/pipelines/267225789
n2d-standard-2
- https://gitlab.com/gitlab-org/gitlab/pipelines/266120165
- https://gitlab.com/gitlab-org/gitlab/pipelines/266118070
- https://gitlab.com/gitlab-org/gitlab/pipelines/266118947
- https://gitlab.com/gitlab-org/gitlab/pipelines/266161480
- https://gitlab.com/gitlab-org/gitlab/pipelines/266160716
n2d-standard-4
- https://gitlab.com/gitlab-org/gitlab/pipelines/267589342
- https://gitlab.com/gitlab-org/gitlab/pipelines/267611773
- https://gitlab.com/gitlab-org/gitlab/pipelines/267635311
- https://gitlab.com/gitlab-org/gitlab/pipelines/267706052
- https://gitlab.com/gitlab-org/gitlab/pipelines/267727213
n2-standard-2
- https://gitlab.com/gitlab-org/gitlab/pipelines/266912431
- https://gitlab.com/gitlab-org/gitlab/pipelines/266914140
- https://gitlab.com/gitlab-org/gitlab/pipelines/266926705
- https://gitlab.com/gitlab-org/gitlab/pipelines/266934615
- https://gitlab.com/gitlab-org/gitlab/pipelines/266939951
n2-standard-4
- https://gitlab.com/gitlab-org/gitlab/pipelines/267773393
- https://gitlab.com/gitlab-org/gitlab/pipelines/267783246
- https://gitlab.com/gitlab-org/gitlab/pipelines/267798990
- https://gitlab.com/gitlab-org/gitlab/pipelines/267810139
- https://gitlab.com/gitlab-org/gitlab/pipelines/267810916
c2-standard-4
Edited by Kyle Wiebers