CI RSpec review_specs_eks failing intermittently, possibly due to dynamic data loading on pages
Summary
We're seeing intermittent false failures of review_specs_eks
. Particularly, the first test on a project's page after restoring a backup. Capybara's screen captures and HTLM saves from the instances show that the table has not been filled with data, thus unable to find the string being searched for. This appears to be only within recent versions of GitLab codebase where we've switched to this dynamic loading.
https://gitlab.com/gitlab-org/charts/gitlab/-/jobs/579979132
Current behavior
When the page takes "too long" to load, the RSpec will fail, despite everything being perfectly functional upon manual inspection.
Expected behavior
Test completes after a complete load event.
Versions
- Chart: 22340e1a ?more
Relevant logs
Failures:
1) Restoring a backup Restored gitlab instance Navigating to testproject1 repo should work
Failure/Error: expect(page).to have_content 'Dockerfile'
expected to find text "Dockerfile" in "Skip to content\nProjects\nGroups\nMore\nT\nYou won't be able to pull or push project code via SSH until you add an SSH key to your profile\nAdd SSH key\nDon't show again\nTo help improve GitLab, we would like to periodically collect usage information. This can be changed at any time in Settings. More Information\nSend usage data | Not now\nPlease ensure your account's recovery settings are up to date.\nAdministrator\ntestproject1\nDetails\nT\ntestproject1\nProject ID: 1\nStar\n0\nFork\n0\n12\n Commits\n1\n Branch\n0\n Tags\n348 KB\n Files\nmaster\ntestproject1\nAdd to tree\nHistory\nFind file\nWeb IDE\nSelect Archive Format\nClone\nadd newline\nAhmad Hassan authored 1 year ago\n492c7be5\nCI/CD configuration\nAdd README\nAdd LICENSE\nAdd CHANGELOG\nAdd CONTRIBUTING\nAuto DevOps enabled\nAdd Kubernetes cluster\nName Last commit Last update"
# ./spec/features/backups_spec.rb:44:in `block (3 levels) in <top (required)>'
cc @twk3