Multiple failures in /spec/ui/self_managed/ in CustomersDot
### Summary Failing job(s): https://gitlab.com/gitlab-org/customers-gitlab-com/-/jobs/2287042980 Failing spec(s): ``` 14 examples, 7 failures Failed examples: rspec ./spec/ui/self_managed/add_seats_spec.rb:19 # User add seats to active license for self-managed instance successfully added user in subscription in GitLab instance using cloud license rspec ./spec/ui/self_managed/purchase_license_spec.rb:19 # User purchase license for self-managed instance with online activation activates subscription successfully with activation code rspec ./spec/ui/self_managed/purchase_license_spec.rb:82 # User purchase license for self-managed instance with strict cloud license feature flag when disabled activates subscription successfully with license file rspec ./spec/ui/self_managed/remove_license_spec.rb:29 # User remove current active license file successfully switches to use a cloud license rspec ./spec/ui/self_managed/renew_license_spec.rb:101 # User renews premium license for self-managed instance successfully renewed using license file rspec ./spec/ui/self_managed/trial_license_spec.rb:14 # User uploads trial ultimate license activates subscription successfully with correct expiration date rspec ./spec/ui/self_managed/upgrade_license_spec.rb:53 # User upgrade premium license for self-managed instance successfully upgraded to ultimate and syncs to GitLab with license file ``` Corresponding test case(s): ### Stack trace ``` Failures: 1) User add seats to active license for self-managed instance successfully added user in subscription in GitLab instance using cloud license Failure/Error: expect(license).to have_subscription_record(subscription.plan, expiration_date, total_seats, Vendor::GitLab::Page::SubscriptionPage::CLOUD_LICENSE) expected `#<QA::Vendor::GitLab::Page::SubscriptionPage:0x00007f045f34e148 @site=#<QA::Runtime::Site:0x00007f045...http://docker:32769/admin/subscription" title="Subscription · Admin Area · GitLab">, @url_param=nil>.has_subscription_record?({:name=>"premium", :plan_id=>"2c92a01176f0d50a0176f3043c4d4a53", :price=>19, :rate_charge_id=>"2c92a01176f0d50a0176f3043c6a4a58", :yearly_price=>228}, "2023-04-04", 26, "cloud license")` to be truthy, got false # ./spec/ui/self_managed/add_seats_spec.rb:42:in `block (4 levels) in <module:QA>' # ./spec/ui/self_managed/add_seats_spec.rb:38:in `block (3 levels) in <module:QA>' # ./page/base.rb:18:in `perform' # ./spec/ui/self_managed/add_seats_spec.rb:35:in `block (2 levels) in <module:QA>' 2) User purchase license for self-managed instance with online activation activates subscription successfully with activation code Failure/Error: Page::ManageSubscriptionPage.perform(&:copy_activation_code) QA::Runtime::Retrier::ExceededMaxAttemptsError: QA::Runtime::Retrier::ExceededMaxAttemptsError # ./runtime/retrier.rb:37:in `retry_until' # ./page/manage_subscription_page.rb:101:in `wait_for_activation_code' # ./page/manage_subscription_page.rb:92:in `copy_activation_code' # ./page/base.rb:18:in `perform' # ./spec/ui/self_managed/purchase_license_spec.rb:30:in `block (3 levels) in <module:QA>' 3) User purchase license for self-managed instance with strict cloud license feature flag when disabled activates subscription successfully with license file Failure/Error: expect(cloud_license_page).to have_subscription_record(plan, expiration_date, 1, Vendor::GitLab::Page::SubscriptionPage::LICENSE_FILE) expected `#<QA::Vendor::GitLab::Page::SubscriptionPage:0x00007f045dd25fb0 @site=#<QA::Runtime::Site:0x00007f045...http://docker:32769/admin/subscription" title="Subscription · Admin Area · GitLab">, @url_param=nil>.has_subscription_record?({:name=>"ultimate", :plan_id=>"2c92a00c76f0c6c20176f2f9328b33c9", :price=>99, :rate_charge_id=>"2c92a00c76f0c6c20176f2fcbb645b5f", :yearly_price=>1188}, "2023-04-04", 1, "license file")` to be truthy, got false # ./spec/ui/self_managed/purchase_license_spec.rb:105:in `block (5 levels) in <module:QA>' # ./spec/ui/self_managed/purchase_license_spec.rb:102:in `block (4 levels) in <module:QA>' 4) User remove current active license file successfully switches to use a cloud license Failure/Error: portal_sign_in_as(customer.email, customer.password) Watir::Wait::TimeoutError: timed out after 30 seconds, waiting for true condition on #<Watir::Button: located: false; {:text=>/Sign in with your GitLab.com account/, :tag_name=>"button"}> # ./page/base.rb:162:in `find_element' # ./page/base.rb:33:in `block (3 levels) in singleton class' # ./page/base.rb:43:in `block (3 levels) in singleton class' # ./helper/flow.rb:14:in `portal_sign_in_as' # ./spec/ui/self_managed/remove_license_spec.rb:11:in `block (2 levels) in <module:QA>' 5) User renews premium license for self-managed instance successfully renewed using license file Failure/Error: expect(license).to have_subscription_record(subscription.plan, expiration_date, renew_quantity, Vendor::GitLab::Page::SubscriptionPage::LICENSE_FILE) expected `#<QA::Vendor::GitLab::Page::SubscriptionPage:0x00007f045dde1b98 @site=#<QA::Runtime::Site:0x00007f045...http://docker:32769/admin/subscription" title="Subscription · Admin Area · GitLab">, @url_param=nil>.has_subscription_record?({:name=>"premium", :plan_id=>"2c92a01176f0d50a0176f3043c4d4a53", :price=>19, :rate_charge_id=>"2c92a01176f0d50a0176f3043c6a4a58", :yearly_price=>228}, "2023-04-18", 50, "license file")` to be truthy, got false # ./spec/ui/self_managed/renew_license_spec.rb:131:in `block (4 levels) in <module:QA>' # ./spec/ui/self_managed/renew_license_spec.rb:128:in `block (3 levels) in <module:QA>' # ./page/base.rb:18:in `perform' # ./spec/ui/self_managed/renew_license_spec.rb:127:in `block (2 levels) in <module:QA>' 6) User uploads trial ultimate license activates subscription successfully with correct expiration date Failure/Error: expect(cloud_license_page.visit.subscription_title).to include('You do not have an active subscription') Watir::Wait::TimeoutError: timed out after 30 seconds, waiting for true condition on #<Watir::Heading: located: false; {:"data-testid"=>"subscription-activation-title", :tag_name=>"h3"}> # ./page/base.rb:162:in `find_element' # ./page/base.rb:33:in `block (3 levels) in singleton class' # ./page/base.rb:43:in `block (3 levels) in singleton class' # ./spec/ui/self_managed/trial_license_spec.rb:19:in `block (3 levels) in <module:QA>' # ./page/base.rb:18:in `perform' # ./spec/ui/self_managed/trial_license_spec.rb:18:in `block (2 levels) in <module:QA>' 7) User upgrade premium license for self-managed instance successfully upgraded to ultimate and syncs to GitLab with license file Failure/Error: expect(license).to have_subscription_record(new_plan, expiration_date, quantity, Vendor::GitLab::Page::SubscriptionPage::LICENSE_FILE) expected `#<QA::Vendor::GitLab::Page::SubscriptionPage:0x00007f045d0b9e98 @site=#<QA::Runtime::Site:0x00007f045...http://docker:32769/admin/subscription" title="Subscription · Admin Area · GitLab">, @url_param=nil>.has_subscription_record?({:name=>"ultimate", :plan_id=>"2c92a00c76f0c6c20176f2f9328b33c9", :price=>99, :rate_charge_id=>"2c92a00c76f0c6c20176f2fcbb645b5f", :yearly_price=>1188}, "2023-04-04", 10, "license file")` to be truthy, got false # ./spec/ui/self_managed/upgrade_license_spec.rb:86:in `block (4 levels) in <module:QA>' # ./spec/ui/self_managed/upgrade_license_spec.rb:83:in `block (3 levels) in <module:QA>' # ./page/base.rb:18:in `perform' # ./spec/ui/self_managed/upgrade_license_spec.rb:82:in `block (2 levels) in <module:QA>' Finished in 46 minutes 35 seconds (files took 1.32 seconds to load) ``` ### Screenshot / HTML page [artifacts.zip](/uploads/9dbbe78a8586d70b8497e7c46545d420/artifacts.zip) <!-- Attach the screenshot and HTML snapshot of the page from the job's artifacts: 1. Download the job's artifacts and unarchive them. 1. Open the `gitlab-qa-run-2020-*/gitlab-{ce,ee}-qa-*/{,ee}/{api,browser_ui}/<path to failed test>` folder. 1. Select the `.png` and `.html` files that appears in the job logs (look for `HTML screenshot: /path/to/html/page.html` / `Image screenshot: `/path/to/html/page.png`). 1. Drag and drop them here. Note: You don't need to include a screenshot if the information it contains can be included as text. Include the text instead. E.g., error 500/404, "Retry later" errors, etc. If you include multiple screenshots it can be helpful to hide all but the first in a details/summary element, to avoid excessive scrolling: <details><summary>Expand for screenshot</summary> drag and drop the screenshot here </details> --> ### Possible fixes <!-- Choose the stage that appears in the test path, e.g. gitlab~3103452 for `qa/specs/features/browser_ui/3_create/web_ide/add_file_template_spec.rb`. --> <!-- Select a label for where the failure was found, e.g. if the failure occurred in a nightly pipeline, select gitlab~12204998. --> <!-- https://about.gitlab.com/handbook/engineering/quality/guidelines/#priorities: - gitlab~3857370: Tests that are needed to verify fundamental GitLab functionality. - gitlab~3857523: Tests that deal with external integrations which may take a longer time to debug and fix. --> <!-- Select the current milestone if gitlab~3857370 or the next milestone if gitlab~3857523. -->
issue