Flaky Capybara tests
In the process of moving gitlab-jh repo to gitlab.cn, we encountered tons of flaky Capybara tests.
Actually I did find similar error in gitlab.com
, https://gitlab.com/gitlab-jh/gitlab/-/jobs/1785684260
Talked with @godfat-gitlab yesterday, he thought that it might be caused by instance spec difference between gitlab.com and gitlab.cn. Capybara will spin up a web server for HTML Dom testing. When the instance is not powerful enough, DOMs are not rendered when running tests, it leads to the flaky tests.
We would like to know the exact spec of gitlab-org
runners. To be more specific, Runner: #11574076 (8zCxmpPt) 2-green.shared-gitlab-org.runners-manager.gitlab.com
Besides the spec difference, we are wondering whether there is any configuration on gitlab-org
runners to avoid Capybara flaky tests?
Thanks in advance @kwiebers