Investigate further failures in SiteSpeed pipeline
The issue is to investigate recent failures further and analyse if failures are transient or there is a product bug.
Pipeline: http://gitlab.com/gitlab-org/quality/performance-sitespeed/-/pipelines/560453883
* Environment: 10k
* Environment Version: 15.1.0-pre `281ccf05f51`
* Date: 2022-06-10
NAME | FCP (ms) | LCP (ms) | TBT (ms) | SI (ms) | LVC (ms) | TFR SIZE (kb) | SCORE | RESULT
--------------------------------------|----------|----------------|------------------|---------|----------|---------------|-------|-------
web_group | 1506 | ✓ 1636 (<3000) | ✓ 314 (<700) | 1349 | 3466 | 194.4 | 71 | Passed
web_project | 2284 | ✓ 2386 (<2500) | ✓ 1410 (<2250) | 2850 | 4750 | 421.9 | 65 | Passed
web_project_branches | 915 | ✓ 1013 (<2500) | ✓ 105 (<300) | 918 | 1950 | 141.0 | 83 | Passed
web_project_commit | 3556 | ✓ 3642 (<4700) | ✓ 539 (<1000) | 4068 | 5133 | 366.8 | 64 | Passed
web_project_commits | 1550 | ✓ 1660 (<2500) | ✓ 122 (<300) | 1521 | 2116 | 142.1 | 72 | Passed
web_project_file_blame | 4796 | ✘ 5055 (<5000) | ✓ 661 (<1200) | 4949 | 8117 | 648.9 | 67 | FAILED
web_project_file_rendered | 2287 | ✘ 7101 (<6300) | ✓ 1480 (<1500) | 3216 | 7100 | 1458.6 | 63 | FAILED
web_project_file_source | 1453 | ✘ 9188 (<8900) | ✘ 7263 (<7000) | 2204 | 9200 | 1618.7 | 65 | FAILED
web_project_files | 1414 | ✘ 2521 (<2500) | ✓ 10992 (<11000) | 2537 | 8267 | 432.2 | 67 | FAILED
web_project_issue | 1973 | ✘ 5500 (<5000) | ✓ 2216 (<3500) | 2316 | 6933 | 685.0 | 60 | FAILED
web_project_issues | 809 | ✓ 1767 (<3700) | ✓ 416 (<600) | 1094 | 3533 | 243.0 | 73 | Passed
web_project_merge_request_changes | 2048 | ✓ 6363 (<8600) | ✘ 18102 (<18000) | 4148 | 13400 | 1208.8 | 63 | FAILED
web_project_merge_request_commits | 2353 | ✘ 3499 (<2500) | ✓ 601 (<1250) | 2843 | 6067 | 815.2 | 66 | FAILED
web_project_merge_request_discussions | 1625 | ✓ 1734 (<2500) | ✓ 5858 (<8000) | 3044 | 11133 | 771.2 | 68 | Passed
web_project_merge_requests | 2288 | ✓ 2391 (<2500) | ✓ 235 (<300) | 2224 | 3433 | 343.8 | 69 | Passed
web_project_pipelines | 873 | ✓ 3704 (<4500) | ✓ 1150 (<1600) | 1287 | 4000 | 256.5 | 61 | Passed
web_project_releases | 644 | ✓ 1848 (<2600) | ✓ 409 (<600) | 898 | 1850 | 158.7 | 72 | Passed
web_project_tags | 2646 | ✘ 2799 (<2500) | ✓ 93 (<300) | 2642 | 3200 | 142.6 | 76 | FAILED
web_user | 1106 | ✓ 1399 (<2500) | ✓ 122 (<300) | 1518 | 3583 | 34.8 | 85 | Passed
-
web_project_file_blame
-✅ - appears to be fine as it's within results from the last 90 days http://10k.testbed.gitlab.net/-/grafana/d/jH6yoWVMz/gitlab-performance-sitespeed-result[…]&var-test_name=web_project_file_blame&from=now-90d&to=now -
web_project_file_rendered
-✅ - transient #22 (comment 984898309) -
web_project_file_source
-✅ - need to bump up bug priority and increase threshold #22 (comment 984942694) -
web_project_files
-✅ - looks like a slight trend up as well but very mild, maybe it's worth raise p4 for this issue and adjust threshold #22 (comment 984956970) -
web_project_issue
-✅ - http://10k.testbed.gitlab.net/-/grafana/d/jH6yoWVMz/gitlab-performance-sitespeed-result[…]gId=1&from=now-90d&to=now&var-test_name=web_project_issue -
web_project_merge_request_commits
-✅ - create P4 LCP bug - transient violations #22 (comment 984967791) -
web_project_tags
-✅ - passed on retry, seems transient #22 (comment 984858726)
Edited by Nailia Iskhakova