Flaky tests in work_items_spec.rb
These two specs fail locally on master:
rspec './spec/features/projects/work_items/work_item_spec.rb[1:1:11:1:6:1]' # Work item for signed in user behaves like work items description for work_items_mvc_2 FF on conflict shows conflict message when description changes
rspec './spec/features/projects/work_items/work_item_spec.rb[1:1:12:2:1]' # Work item for signed in user behaves like work items milestone on work_items_mvc_2 FF on passes axe automated accessibility testing in closed state
Screnshots from Capybara:
Full output:
➜ gitlab git:(431932-work-item-new-todo-notification-buttons) ✗ bundle exec rspec spec/features/projects/work_items/work_item_spec.rb
warning: parser/current is loading parser/ruby32, which recognizes 3.2.2-compliant syntax, but you are running 3.2.3.
Please see https://github.com/whitequark/parser#compatibility-with-ruby-mri.
Run options: include {:focus=>true}
All examples were filtered out; ignoring {:focus=>true}
Test environment set up in 4.972063 seconds
Starting the Capybara driver server...
Capybara starting Puma...
* Version 6.4.0, codename: The Eagle of Durango
* Min threads: 0, max threads: 4
* Listening on unix:///var/folders/8y/g5_qjf4x6ql12n2h6nt2tvbr0000gn/T/20240228-88347-nix4zn
...........................................F HTML screenshot: /Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/capybara/work_item_for_signed_in_user_behaves_like_work_items_description_for_work_items_mvc_2_ff_on_conflict.html
Image screenshot: /Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/capybara/work_item_for_signed_in_user_behaves_like_work_items_description_for_work_items_mvc_2_ff_on_conflict.png
.F HTML screenshot: /Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/capybara/work_item_for_signed_in_user_behaves_like_work_items_milestone_on_work_items_mvc_2_ff_on_passes_axe_.html
Image screenshot: /Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/capybara/work_item_for_signed_in_user_behaves_like_work_items_milestone_on_work_items_mvc_2_ff_on_passes_axe_.png
...........
Failures:
1) Work item for signed in user behaves like work items description for work_items_mvc_2 FF on conflict shows conflict message when description changes
Got 1 failure:
Shared Example Group: "work items description" called from ./spec/features/projects/work_items/work_item_spec.rb:114
1.1) Failure/Error: expect(page).to have_text(expected_warning)
expected to find text "Someone edited the description at the same time you did." in "Skip to main content Primary navigation Homepage Create new... Sidney Jones1 user’s menu D Default Search or go to… Project P Project-1 Name Pinned Issues 2 Manage Plan Code Build Secure Deploy Operate Monitor Analyze Help Sidney Jones2 Project-1 Name Issues #1 My title 1 More actions Open Issue created 7 minutes ago by Sidney Jones2 Updated just now Assignees Add assignee Labels Add labels Milestone Add to milestone Dates Start date Add start date Due date Add due date Parent None 2 Participants Description Preview Insert comment template Switch to rich text editing Save Cancel 👍 1 👎 0 Linked Items Show labels Add Link items together to show that they're related or that one is blocking others. Learn more. Activity All activity Oldest first Sidney Jones2 @namespace1 · 7 minutes ago Author Owner More actions My title 29 Edited 7 minutes ago by Sidney Jones2 Preview Insert comment template Switch to rich text editing Make this an internal note Comment Close issue"
Timeout (10s) reached while running a waiting Capybara finder.
Consider using a non-waiting finder.
See https://www.cloudbees.com/blog/faster-rails-tests
# ./spec/support/shared_examples/features/work_items_shared_examples.rb:504:in `block (5 levels) in <main>'
# ./spec/spec_helper.rb:436:in `block (3 levels) in <top (required)>'
# ./spec/support/sidekiq_middleware.rb:9:in `with_sidekiq_server_middleware'
# ./spec/spec_helper.rb:427:in `block (2 levels) in <top (required)>'
# ./spec/spec_helper.rb:423:in `block (3 levels) in <top (required)>'
# ./lib/gitlab/application_context.rb:68:in `with_raw_context'
# ./spec/spec_helper.rb:423:in `block (2 levels) in <top (required)>'
# ./spec/spec_helper.rb:270:in `block (2 levels) in <top (required)>'
# ./spec/support/system_exit_detected.rb:7:in `block (2 levels) in <main>'
# ./spec/support/database/prevent_cross_joins.rb:106:in `block (3 levels) in <main>'
# ./spec/support/database/prevent_cross_joins.rb:60:in `with_cross_joins_prevented'
# ./spec/support/database/prevent_cross_joins.rb:106:in `block (2 levels) in <main>'
2) Work item for signed in user behaves like work items milestone on work_items_mvc_2 FF on passes axe automated accessibility testing in closed state
Got 0 failures and 2 other errors:
Shared Example Group: "work items milestone" called from ./spec/features/projects/work_items/work_item_spec.rb:115
2.1) Failure/Error: expect(page).to be_axe_clean.within(work_item_milestone_selector)
UncaughtThrowError:
uncaught throw {"errorMessage"=>"No elements found for include in page Context", "passes"=>[], "timestamp"=>"Wed Feb 28 2024 17:01:23 GMT-0500 (Eastern Standard Time)", "url"=>"", "violations"=>[]}
# ./spec/support/shared_examples/features/work_items_shared_examples.rb:577:in `block (3 levels) in <main>'
# ./spec/spec_helper.rb:436:in `block (3 levels) in <top (required)>'
# ./spec/support/sidekiq_middleware.rb:9:in `with_sidekiq_server_middleware'
# ./spec/spec_helper.rb:427:in `block (2 levels) in <top (required)>'
# ./spec/spec_helper.rb:423:in `block (3 levels) in <top (required)>'
# ./lib/gitlab/application_context.rb:68:in `with_raw_context'
# ./spec/spec_helper.rb:423:in `block (2 levels) in <top (required)>'
# ./spec/spec_helper.rb:270:in `block (2 levels) in <top (required)>'
# ./spec/support/system_exit_detected.rb:7:in `block (2 levels) in <main>'
# ./spec/support/database/prevent_cross_joins.rb:106:in `block (3 levels) in <main>'
# ./spec/support/database/prevent_cross_joins.rb:60:in `with_cross_joins_prevented'
# ./spec/support/database/prevent_cross_joins.rb:106:in `block (2 levels) in <main>'
2.2) Failure/Error: raise JSConsoleError, message
JSConsoleError:
Unexpected browser console output:
http://127.0.0.1:53503/vite-dev/@fs/Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/cache/vite/deps/chunk-YWPSIREP.js?v=c01be1d1 76:16 "[@gitlab/ui] The following translations have not been given, so will fall back to their default US English strings:"
https://www.gravatar.com/avatar/f1850ce7cfc130a6a45cf08360329214ee505b9873e748b1ae7b80960c967786?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
http://127.0.0.1:53503/vite-dev/@fs/Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/cache/vite/deps/chunk-5GYWXZKQ.js?v=c01be1d1 133:12 "GlDisclosureDropdown/GlCollapsibleListbox: Toggle is missing a 'tabindex' and cannot be focused.\n Use 'a' or 'button' element instead or make sure to add 'role=\"button\"' along with 'tabindex' otherwise." div.gl-new-dropdown
http://127.0.0.1:53503/vite-dev/@fs/Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/cache/vite/deps/chunk-5GYWXZKQ.js?v=c01be1d1 133:12 "GlDisclosureDropdown/GlCollapsibleListbox: Toggle is missing a 'tabindex' and cannot be focused.\n Use 'a' or 'button' element instead or make sure to add 'role=\"button\"' along with 'tabindex' otherwise." div.gl-new-dropdown
https://www.gravatar.com/avatar/af7a1ff1d96b39d9db8cdcac4f6159dabf5118f0e39fac4795acf1f394ce3ef7?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
https://www.gravatar.com/avatar/6dbc6cbc2beab4e357f8a479c870de0f3f80ac18237dd1dd6295771efe0fb2ac?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
https://www.gravatar.com/avatar/af7a1ff1d96b39d9db8cdcac4f6159dabf5118f0e39fac4795acf1f394ce3ef7?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
http://127.0.0.1:53503/vite-dev/@fs/Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/cache/vite/deps/chunk-YWPSIREP.js?v=c01be1d1 76:16 "[@gitlab/ui] The following translations have not been given, so will fall back to their default US English strings:"
https://www.gravatar.com/avatar/f1850ce7cfc130a6a45cf08360329214ee505b9873e748b1ae7b80960c967786?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
http://127.0.0.1:53503/vite-dev/@fs/Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/cache/vite/deps/chunk-5GYWXZKQ.js?v=c01be1d1 133:12 "GlDisclosureDropdown/GlCollapsibleListbox: Toggle is missing a 'tabindex' and cannot be focused.\n Use 'a' or 'button' element instead or make sure to add 'role=\"button\"' along with 'tabindex' otherwise." div.gl-new-dropdown
http://127.0.0.1:53503/vite-dev/@fs/Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/cache/vite/deps/chunk-5GYWXZKQ.js?v=c01be1d1 133:12 "GlDisclosureDropdown/GlCollapsibleListbox: Toggle is missing a 'tabindex' and cannot be focused.\n Use 'a' or 'button' element instead or make sure to add 'role=\"button\"' along with 'tabindex' otherwise." div.gl-new-dropdown
https://www.gravatar.com/avatar/af7a1ff1d96b39d9db8cdcac4f6159dabf5118f0e39fac4795acf1f394ce3ef7?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
https://www.gravatar.com/avatar/6dbc6cbc2beab4e357f8a479c870de0f3f80ac18237dd1dd6295771efe0fb2ac?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
https://www.gravatar.com/avatar/f1850ce7cfc130a6a45cf08360329214ee505b9873e748b1ae7b80960c967786?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
https://www.gravatar.com/avatar/af7a1ff1d96b39d9db8cdcac4f6159dabf5118f0e39fac4795acf1f394ce3ef7?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
http://127.0.0.1:53503/vite-dev/@fs/Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/cache/vite/deps/chunk-YWPSIREP.js?v=c01be1d1 76:16 "[@gitlab/ui] The following translations have not been given, so will fall back to their default US English strings:"
https://www.gravatar.com/avatar/f1850ce7cfc130a6a45cf08360329214ee505b9873e748b1ae7b80960c967786?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
http://127.0.0.1:53503/vite-dev/@fs/Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/cache/vite/deps/chunk-5GYWXZKQ.js?v=c01be1d1 133:12 "GlDisclosureDropdown/GlCollapsibleListbox: Toggle is missing a 'tabindex' and cannot be focused.\n Use 'a' or 'button' element instead or make sure to add 'role=\"button\"' along with 'tabindex' otherwise." div.gl-new-dropdown
http://127.0.0.1:53503/vite-dev/@fs/Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/cache/vite/deps/chunk-5GYWXZKQ.js?v=c01be1d1 133:12 "GlDisclosureDropdown/GlCollapsibleListbox: Toggle is missing a 'tabindex' and cannot be focused.\n Use 'a' or 'button' element instead or make sure to add 'role=\"button\"' along with 'tabindex' otherwise." div.gl-new-dropdown
https://www.gravatar.com/avatar/af7a1ff1d96b39d9db8cdcac4f6159dabf5118f0e39fac4795acf1f394ce3ef7?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
https://www.gravatar.com/avatar/6dbc6cbc2beab4e357f8a479c870de0f3f80ac18237dd1dd6295771efe0fb2ac?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
https://www.gravatar.com/avatar/af7a1ff1d96b39d9db8cdcac4f6159dabf5118f0e39fac4795acf1f394ce3ef7?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
http://127.0.0.1:53503/vite-dev/@fs/Users/chadlavi/Dev/gitlab-development-kit/gitlab/tmp/cache/vite/deps/chunk-YWPSIREP.js?v=c01be1d1 76:16 "[@gitlab/ui] The following translations have not been given, so will fall back to their default US English strings:"
https://www.gravatar.com/avatar/f1850ce7cfc130a6a45cf08360329214ee505b9873e748b1ae7b80960c967786?s=80&d=identicon - Failed to load resource: net::ERR_PROXY_CONNECTION_FAILED
# ./spec/support/capybara.rb:208:in `block (2 levels) in <main>'
# ./spec/spec_helper.rb:436:in `block (3 levels) in <top (required)>'
# ./spec/support/sidekiq_middleware.rb:9:in `with_sidekiq_server_middleware'
# ./spec/spec_helper.rb:427:in `block (2 levels) in <top (required)>'
# ./spec/spec_helper.rb:423:in `block (3 levels) in <top (required)>'
# ./lib/gitlab/application_context.rb:68:in `with_raw_context'
# ./spec/spec_helper.rb:423:in `block (2 levels) in <top (required)>'
# ./spec/spec_helper.rb:270:in `block (2 levels) in <top (required)>'
# ./spec/support/system_exit_detected.rb:7:in `block (2 levels) in <main>'
# ./spec/support/database/prevent_cross_joins.rb:106:in `block (3 levels) in <main>'
# ./spec/support/database/prevent_cross_joins.rb:60:in `with_cross_joins_prevented'
# ./spec/support/database/prevent_cross_joins.rb:106:in `block (2 levels) in <main>'
Finished in 10 minutes 3 seconds (files took 19.19 seconds to load)
57 examples, 2 failures
Failed examples:
rspec './spec/features/projects/work_items/work_item_spec.rb[1:1:11:1:6:1]' # Work item for signed in user behaves like work items description for work_items_mvc_2 FF on conflict shows conflict message when description changes
rspec './spec/features/projects/work_items/work_item_spec.rb[1:1:12:2:1]' # Work item for signed in user behaves like work items milestone on work_items_mvc_2 FF on passes axe automated accessibility testing in closed state
Randomized with seed 3560