`ee:sanity-framework` job is failing on master
Summary
The ee:sanity-framework job is failing on master
Job: https://gitlab.com/gitlab-org/gitlab-qa-mirror/-/jobs/529387490
Stack trace
$ ./bin/expect_exit_code_and_text "exe/gitlab-qa Test::Instance::Image ${RELEASE:=EE} -- --tag framework" 1 "2 examples, 1 failure"
/builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/docker/shellout.rb:31:in `block in execute!': Docker command `docker run -t --rm --net=test --env EE_LICENSE="$EE_LICENSE" --env GCLOUD_ACCOUNT_EMAIL="$GCLOUD_ACCOUNT_EMAIL" --env GCLOUD_ACCOUNT_KEY="$GCLOUD_ACCOUNT_KEY" --env CLOUDSDK_CORE_PROJECT="$CLOUDSDK_CORE_PROJECT" --env QA_DEBUG="$QA_DEBUG" --env QA_CAN_TEST_GIT_PROTOCOL_V2="$QA_CAN_TEST_GIT_PROTOCOL_V2" --env QA_CAN_TEST_PRAEFECT="$QA_CAN_TEST_PRAEFECT" --env GITHUB_USERNAME="$GITHUB_USERNAME" --env GITHUB_PASSWORD="$GITHUB_PASSWORD" --env CI="$CI" --env CI_RUNNER_ID="$CI_RUNNER_ID" --env CI_SERVER_HOST="$CI_SERVER_HOST" --env CI_SERVER_PERSONAL_ACCESS_TOKEN="$CI_SERVER_PERSONAL_ACCESS_TOKEN" --env CI_NODE_TOTAL="$CI_NODE_TOTAL" --env GITLAB_CI="$GITLAB_CI" --env CI_SLACK_WEBHOOK_URL="$CI_SLACK_WEBHOOK_URL" --env GITLAB_QA_FORMLESS_LOGIN_TOKEN="$GITLAB_QA_FORMLESS_LOGIN_TOKEN" --volume /var/run/docker.sock:/var/run/docker.sock:z --volume /builds/gitlab-org/gitlab-qa-mirror/gitlab-qa-run-2020-04-28-08-01-53-9dbbe95e/gitlab-ee-qa-44c85019:/home/gitlab/qa/tmp:z --name gitlab-ee-qa-44c85019 registry.gitlab.com/gitlab-org/build/omnibus-gitlab-mirror/gitlab-ee-qa:d58353db4ebcf6b564a7e15354e996b335454006 Test::Instance::All http://gitlab-ee-0d3d5b25.test -- --tag framework` failed! (Gitlab::QA::Docker::Shellout::StatusError)
from /usr/local/lib/ruby/2.6.0/open3.rb:219:in `popen_run'
from /usr/local/lib/ruby/2.6.0/open3.rb:208:in `popen2e'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/docker/shellout.rb:19:in `execute!'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/docker/command.rb:36:in `execute!'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/docker/engine.rb:22:in `block in run'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/docker/engine.rb:16:in `tap'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/docker/engine.rb:16:in `run'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/component/specs.rb:37:in `perform'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/scenario/template.rb:8:in `block in perform'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/scenario/template.rb:6:in `tap'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/scenario/template.rb:6:in `perform'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/scenario/test/instance/image.rb:20:in `block (2 levels) in perform'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/component/gitlab.rb:93:in `instance'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/scenario/test/instance/image.rb:19:in `block in perform'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/scenario/actable.rb:15:in `perform'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/scenario/test/instance/image.rb:14:in `perform'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/scenario/template.rb:8:in `block in perform'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/scenario/template.rb:6:in `tap'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/scenario/template.rb:6:in `perform'
from /builds/gitlab-org/gitlab-qa-mirror/lib/gitlab/qa/runner.rb:42:in `run'
from exe/gitlab-qa:8:in `<main>'
'exe/gitlab-qa Test::Instance::Image registry.gitlab.com/gitlab-org/build/omnibus-gitlab-mirror/gitlab-ee:d58353db4ebcf6b564a7e15354e996b335454006 -- --tag framework' exited with '1', as expected!
'exe/gitlab-qa Test::Instance::Image registry.gitlab.com/gitlab-org/build/omnibus-gitlab-mirror/gitlab-ee:d58353db4ebcf6b564a7e15354e996b335454006 -- --tag framework' was expected to output '2 examples, 1 failure', but did not!
Logs in the artifacts:
Failures:
1) Framework sanity checks Passing orchestrated example succeeds
[31mFailure/Error: [0m[32mexpect[0m(page).to have_text([31m[1;31m'[0m[31mOpen source software to collaborate on code[1;31m'[0m[31m[0m)[0m
[31m expected to find text "Open source software to collaborate on code" in "GitLab Enterprise Edition A complete DevOps platform GitLab is a single application for the entire software development lifecycle. From project planning and source code management to CI/CD, monitoring, and security. Sign in Register Username or email Password Remember me Forgot your password? Explore Help About GitLab"[0m
[36m# ./qa/specs/features/sanity/framework_spec.rb:9:in `block (3 levels) in <module:QA>'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:123:in `block in run'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `loop'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `run'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec_ext/rspec_ext.rb:12:in `run_with_retry'[0m
[36m# ./spec/spec_helper.rb:69:in `block (2 levels) in <top (required)>'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:123:in `block in run'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `loop'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `run'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec_ext/rspec_ext.rb:12:in `run_with_retry'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:37:in `block (2 levels) in setup'[0m
[36m# ./qa/specs/runner.rb:69:in `perform'[0m
[36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
[36m# ./qa/scenario/template.rb:8:in `tap'[0m
[36m# ./qa/scenario/template.rb:8:in `perform'[0m
[36m# ./qa/scenario/template.rb:33:in `perform'[0m
[36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
[36m# ./qa/scenario/template.rb:8:in `tap'[0m
[36m# ./qa/scenario/template.rb:8:in `perform'[0m
[36m# ./qa/scenario/bootable.rb:28:in `launch!'[0m
2) Framework sanity checks Failing orchestrated example fails
[31mFailure/Error: [0m[32mexpect[0m(page).to have_text([31m[1;31m"[0m[31mThese Aren't the Texts You're Looking For[1;31m"[0m[31m[0m, [35mwait[0m: [1;34m1[0m)[0m
[31m expected to find text "These Aren't the Texts You're Looking For" in "GitLab Enterprise Edition A complete DevOps platform GitLab is a single application for the entire software development lifecycle. From project planning and source code management to CI/CD, monitoring, and security. Sign in Register Username or email Password Remember me Forgot your password? Explore Help About GitLab"[0m
[36m# ./qa/specs/features/sanity/framework_spec.rb:17:in `block (3 levels) in <module:QA>'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:123:in `block in run'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `loop'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `run'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec_ext/rspec_ext.rb:12:in `run_with_retry'[0m
[36m# ./spec/spec_helper.rb:69:in `block (2 levels) in <top (required)>'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:123:in `block in run'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `loop'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `run'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec_ext/rspec_ext.rb:12:in `run_with_retry'[0m
[36m# /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:37:in `block (2 levels) in setup'[0m
[36m# ./qa/specs/runner.rb:69:in `perform'[0m
[36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
[36m# ./qa/scenario/template.rb:8:in `tap'[0m
[36m# ./qa/scenario/template.rb:8:in `perform'[0m
[36m# ./qa/scenario/template.rb:33:in `perform'[0m
[36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
[36m# ./qa/scenario/template.rb:8:in `tap'[0m
[36m# ./qa/scenario/template.rb:8:in `perform'[0m
[36m# ./qa/scenario/bootable.rb:28:in `launch!'[0m
Top 2 slowest examples (26.59 seconds, 99.9% of total time):
Framework sanity checks Passing orchestrated example succeeds
[1m22.46[0m [1mseconds[0m ./qa/specs/features/sanity/framework_spec.rb:6
Framework sanity checks Failing orchestrated example fails
[1m4.13[0m [1mseconds[0m ./qa/specs/features/sanity/framework_spec.rb:14
Finished in 26.62 seconds (files took 31.69 seconds to load)
[31m2 examples, 2 failures[0m
Failed examples:
[31mrspec ./qa/specs/features/sanity/framework_spec.rb:6[0m [36m# Framework sanity checks Passing orchestrated example succeeds[0m
[31mrspec ./qa/specs/features/sanity/framework_spec.rb:14[0m [36m# Framework sanity checks Failing orchestrated example fails[0m
Randomized with seed 20504
Screenshot / HTML page
Possible fixes
The text "Open source software to collaborate on code" that we look for on the GitLab Login page in the framework_spec has been changed to "A complete DevOps platform" in this MR:
Edited by Sanad Liaquat