11.10.0-rc6 QA Smoke testing Failures

    user creates a new project (FAILED - 2)
  HTML screenshot: file:///home/qa/tmp/qa-test-2019-04-11-21-02-16-9af48ace035ed78d/browser_ui/1_manage/project/create_project_spec.rb_2019-04-11-21-20-06.543.html
  Image screenshot: file:///home/qa/tmp/qa-test-2019-04-11-21-02-16-9af48ace035ed78d/browser_ui/1_manage/project/create_project_spec.rb_2019-04-11-21-20-06.543.png

Failures:

  1) Configure Auto DevOps enables AutoDevOps by default
     Failure/Error: expect(alert).to have_text(/.*The Auto DevOps pipeline has been enabled.*/)
       expected to find text matching /.*The Auto DevOps pipeline has been enabled.*/ in "Skip to content Projects Groups Activity Milestones Snippets 99+ P project-with-autodevops-4918325e0b470a16 Project Details Activity Security Dashboard Cycle Analytics Issues 0 Merge Requests 0 CI / CD Operations Registry Packages Wiki Snippets Settings Collapse sidebar gitlab-qa-sandbox-group qa-test-2019-04-11-21-02-16-9af48ace035ed78d project-with-autodevops-4918325e0b470a16 Details P project-with-autodevops-4918325e0b470a16 Project ID: 11812007 Star 0 Clone Add license 0 Commits 0 Branches 0 Tags 0 Bytes Files Project with AutoDevOps The repository for this project is empty If you already have files you can push them using the command line instructions below. Note that the master branch is automatically protected. Learn more about protected branches You can automatically build and test your application if you enable Auto DevOps for this project. You can automatically deploy it as well, if you add a Kubernetes cluster. Otherwise it is recommended you start with one of the options below. New file Add README Add CHANGELOG Add CONTRIBUTING Enable Auto DevOps Add Kubernetes cluster Command line instructions Git global setup git config --global user.name \"GitLab QA Bot\" git config --global user.email \"gitlab-qa@gitlab.com\" Create a new repository git clone git@gitlab.com:gitlab-qa-sandbox-group/qa-test-2019-04-11-21-02-16-9af48ace035ed78d/project-with-autodevops-4918325e0b470a16.git cd project-with-autodevops-4918325e0b470a16 touch README.md git add README.md git commit -m \"add README\" git push -u origin master Existing folder cd existing_folder git init git remote add origin git@gitlab.com:gitlab-qa-sandbox-group/qa-test-2019-04-11-21-02-16-9af48ace035ed78d/project-with-autodevops-4918325e0b470a16.git git add . git commit -m \"Initial commit\" git push -u origin master Existing Git repository cd existing_repo git remote rename origin old-origin git remote add origin git@gitlab.com:gitlab-qa-sandbox-group/qa-test-2019-04-11-21-02-16-9af48ace035ed78d/project-with-autodevops-4918325e0b470a16.git git push -u origin --all git push -u origin --tags Remove project"
     # ./qa/specs/features/browser_ui/7_configure/auto_devops/create_project_with_auto_devops_spec.rb:174:in `block (4 levels) in <module:QA>'
     # ./qa/scenario/actable.rb:14:in `perform'
     # ./qa/specs/features/browser_ui/7_configure/auto_devops/create_project_with_auto_devops_spec.rb:173:in `block (3 levels) in <module:QA>'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:123:in `block in run'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `loop'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `run'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec_ext/rspec_ext.rb:12:in `run_with_retry'
     # ./spec/spec_helper.rb:44:in `block (2 levels) in <top (required)>'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:123:in `block in run'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `loop'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `run'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec_ext/rspec_ext.rb:12:in `run_with_retry'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:37:in `block (2 levels) in setup'
     # ./qa/specs/runner.rb:38:in `perform'
     # ./qa/scenario/template.rb:8:in `block in perform'
     # ./qa/scenario/template.rb:6:in `tap'
     # ./qa/scenario/template.rb:6:in `perform'
     # ./qa/scenario/test/instance.rb:28:in `do_perform'
     # ./qa/scenario/test/instance.rb:16:in `block in perform'
     # ./qa/scenario/test/instance.rb:14:in `tap'
     # ./qa/scenario/test/instance.rb:14:in `perform'
     # ./qa/scenario/bootable.rb:14:in `launch!'

  2) Manage Project creation user creates a new project
     Failure/Error:
       created_project = Resource::Project.fabricate_via_browser_ui! do |project|
         project.name = 'awesome-project'
         project.description = 'create awesome project test'
       end
     
     Net::ReadTimeout:
       Net::ReadTimeout
     # /usr/local/bundle/gems/selenium-webdriver-3.141.0/lib/selenium/webdriver/remote/http/default.rb:121:in `response_for'
     # /usr/local/bundle/gems/selenium-webdriver-3.141.0/lib/selenium/webdriver/remote/http/default.rb:76:in `request'
     # /usr/local/bundle/gems/selenium-webdriver-3.141.0/lib/selenium/webdriver/remote/http/common.rb:62:in `call'
     # /usr/local/bundle/gems/selenium-webdriver-3.141.0/lib/selenium/webdriver/remote/bridge.rb:166:in `execute'
     # /usr/local/bundle/gems/selenium-webdriver-3.141.0/lib/selenium/webdriver/remote/oss/bridge.rb:584:in `execute'
     # /usr/local/bundle/gems/selenium-webdriver-3.141.0/lib/selenium/webdriver/remote/oss/bridge.rb:374:in `send_keys_to_element'
     # /usr/local/bundle/gems/selenium-webdriver-3.141.0/lib/selenium/webdriver/common/element.rb:154:in `send_keys'
     # /usr/local/bundle/gems/capybara-2.16.1/lib/capybara/selenium/node.rb:237:in `set_text'
     # /usr/local/bundle/gems/capybara-2.16.1/lib/capybara/selenium/node.rb:61:in `set'
     # /usr/local/bundle/gems/capybara-2.16.1/lib/capybara/node/element.rb:108:in `block in set'
     # /usr/local/bundle/gems/capybara-2.16.1/lib/capybara/node/base.rb:85:in `synchronize'
     # /usr/local/bundle/gems/capybara-2.16.1/lib/capybara/node/element.rb:106:in `set'
     # ./qa/page/component/select2.rb:16:in `search_and_select'
     # ./qa/page/project/new.rb:32:in `block in choose_test_namespace'
     # ./qa/page/base.rb:44:in `block in retry_on_exception'
     # ./qa/support/retrier.rb:15:in `retry_on_exception'
     # ./qa/page/base.rb:43:in `retry_on_exception'
     # ./qa/page/project/new.rb:28:in `choose_test_namespace'
     # ./qa/resource/project.rb:47:in `block in fabricate!'
     # ./qa/scenario/actable.rb:14:in `perform'
     # ./qa/resource/project.rb:46:in `fabricate!'
     # ./qa/resource/base.rb:70:in `block (2 levels) in fabricate_via_browser_ui!'
     # ./qa/resource/base.rb:110:in `log_fabrication'
     # ./qa/resource/base.rb:70:in `block in fabricate_via_browser_ui!'
     # ./qa/resource/base.rb:93:in `do_fabricate!'
     # ./qa/resource/base.rb:69:in `fabricate_via_browser_ui!'
     # ./qa/specs/features/browser_ui/1_manage/project/create_project_spec.rb:10:in `block (3 levels) in <module:QA>'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:123:in `block in run'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `loop'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `run'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec_ext/rspec_ext.rb:12:in `run_with_retry'
     # ./spec/spec_helper.rb:44:in `block (2 levels) in <top (required)>'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:123:in `block in run'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `loop'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:110:in `run'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec_ext/rspec_ext.rb:12:in `run_with_retry'
     # /usr/local/bundle/gems/rspec-retry-0.6.1/lib/rspec/retry.rb:37:in `block (2 levels) in setup'
     # ./qa/specs/runner.rb:38:in `perform'
/usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/docker/shellout.rb:31:in `block in execute!': Docker command `docker run -t --rm --net=bridge --env GITLAB_USERNAME="$GITLAB_USERNAME" --env GITLAB_PASSWORD="$GITLAB_PASSWORD" --env GITLAB_QA_ACCESS_TOKEN="$GITLAB_QA_ACCESS_TOKEN" --env SIGNUP_DISABLED="$SIGNUP_DISABLED" --env QA_DEBUG="$QA_DEBUG" --volume /var/run/docker.sock:/var/run/docker.sock:z --volume /builds/gitlab-com/gl-infra/deployer/gitlab-qa-run-2019-04-11-21-00-52-3826b416/gitlab-ee-qa-e54649f2:/home/qa/tmp:z --name gitlab-ee-qa-e54649f2 dev.gitlab.org:5005/gitlab/omnibus-gitlab/gitlab-ee-qa:11.9.7-ee Test::Instance https://gitlab.com --tag smoke` failed! (Gitlab::QA::Docker::Shellout::StatusError)
	from /usr/local/lib/ruby/2.5.0/open3.rb:205:in `popen_run'
	from /usr/local/lib/ruby/2.5.0/open3.rb:190:in `popen2e'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/docker/shellout.rb:19:in `execute!'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/docker/command.rb:36:in `execute!'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/docker/engine.rb:22:in `block in run'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/docker/engine.rb:16:in `tap'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/docker/engine.rb:16:in `run'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/component/specs.rb:24:in `perform'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/scenario/template.rb:8:in `block in perform'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/scenario/template.rb:6:in `tap'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/scenario/template.rb:6:in `perform'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/scenario/test/instance/production.rb:26:in `perform'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/scenario/template.rb:8:in `block in perform'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/scenario/template.rb:6:in `tap'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/lib/gitlab/qa/scenario/template.rb:6:in `perform'
	from /usr/local/bundle/gems/gitlab-qa-2.13.1/exe/gitlab-qa:26:in `<top (required)>'
	from /usr/local/bundle/bin/gitlab-qa:23:in `load'
	from /usr/local/bundle/bin/gitlab-qa:23:in `<main>'
     # ./qa/scenario/template.rb:8:in `block in perform'
     # ./qa/scenario/template.rb:6:in `tap'
     # ./qa/scenario/template.rb:6:in `perform'
     # ./qa/scenario/test/instance.rb:28:in `do_perform'
     # ./qa/scenario/test/instance.rb:16:in `block in perform'
     # ./qa/scenario/test/instance.rb:14:in `tap'
     # ./qa/scenario/test/instance.rb:14:in `perform'
     # ./qa/scenario/bootable.rb:14:in `launch!'

Top 7 slowest examples (1092.68 seconds, 100.0% of total time):
  Manage Project creation user creates a new project
    943.11 seconds ./qa/specs/features/browser_ui/1_manage/project/create_project_spec.rb:6
  Configure Auto DevOps enables AutoDevOps by default
    59.34 seconds ./qa/specs/features/browser_ui/7_configure/auto_devops/create_project_with_auto_devops_spec.rb:163
  creates a merge request user creates a new merge request
    29.77 seconds ./qa/specs/features/browser_ui/3_create/merge_request/create_merge_request_spec.rb:52
  Create SSH keys support user adds and then removes an SSH key
    17.79 seconds ./qa/specs/features/browser_ui/3_create/repository/add_ssh_key_spec.rb:8
  Plan Issue creation when using attachments in comments user comments on an issue with an attachment
    14.8 seconds ./qa/specs/features/browser_ui/2_plan/issue/create_issue_spec.rb:30
  Manage basic user login user logs in using basic credentials and logs out
    14.26 seconds ./qa/specs/features/browser_ui/1_manage/login/log_in_spec.rb:4
  Plan Issue creation user creates an issue
    13.61 seconds ./qa/specs/features/browser_ui/2_plan/issue/create_issue_spec.rb:17

Top 6 slowest example groups:
  Manage
    943.11 seconds average (943.11 seconds / 1 example) ./qa/specs/features/browser_ui/1_manage/project/create_project_spec.rb:4
  Configure
    59.34 seconds average (59.34 seconds / 1 example) ./qa/specs/features/browser_ui/7_configure/auto_devops/create_project_with_auto_devops_spec.rb:7
  creates a merge request
    29.77 seconds average (29.77 seconds / 1 example) ./qa/specs/features/browser_ui/3_create/merge_request/create_merge_request_spec.rb:51
  Create
    17.79 seconds average (17.79 seconds / 1 example) ./qa/specs/features/browser_ui/3_create/repository/add_ssh_key_spec.rb:4
  Manage
    14.26 seconds average (14.26 seconds / 1 example) ./qa/specs/features/browser_ui/1_manage/login/log_in_spec.rb:2
  Plan
    14.21 seconds average (28.41 seconds / 2 examples) ./qa/specs/features/browser_ui/2_plan/issue/create_issue_spec.rb:4

Finished in 18 minutes 13 seconds (files took 0.46405 seconds to load)
7 examples, 2 failures

Failed examples:

rspec ./qa/specs/features/browser_ui/7_configure/auto_devops/create_project_with_auto_devops_spec.rb:163 # Configure Auto DevOps enables AutoDevOps by default
rspec ./qa/specs/features/browser_ui/1_manage/project/create_project_spec.rb:6 # Manage Project creation user creates a new project

Randomized with seed 21056

Uploading artifacts...
./gitlab-qa-run-*: found 20 matching files         
Uploading artifacts to coordinator... ok            id=469828 responseStatus=201 Created token=VaEC3T7x
ERROR: Job failed: exit code 1

Job: https://ops.gitlab.net/gitlab-com/gl-infra/deployer/-/jobs/469828

Internal Slack Thread: https://gitlab.slack.com/archives/CCNNKFP8B/p1555018816001400

/cc @gitlab-org/quality

added QA label

mentioned in issue gitlab-org/release/retrospectives#17 (closed)

mentioned in issue gitlab-org/release/tasks#744 (closed)

this particular failure was fixed with https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/26254/diffs . what needs to be done on my end?

Can we add the Pick to 11.10 label for that merge request such that we can pluck it for the next RC?

assigned to @ddavison

mentioned in issue gitlab-org/release/tasks#748 (closed)

As noted by @stan: https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/26254#note_160415421

The above fix is already in place. We may need to revisit this and investigate further if the next canary QA job fails.

Can we enable the Capybara screenshot captures for the canary QA job? That would make it easier to debug what's wrong.

Oh, I see the screenshots are availble. :)

closed from https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/28765#note_174670036

closed