Multiple failures in /spec/ui/self_managed/ in CustomersDot
### Summary
Failing job(s): https://gitlab.com/gitlab-org/customers-gitlab-com/-/jobs/2287042980
Failing spec(s):
```
14 examples, 7 failures
Failed examples:
rspec ./spec/ui/self_managed/add_seats_spec.rb:19 # User add seats to active license for self-managed instance successfully added user in subscription in GitLab instance using cloud license
rspec ./spec/ui/self_managed/purchase_license_spec.rb:19 # User purchase license for self-managed instance with online activation activates subscription successfully with activation code
rspec ./spec/ui/self_managed/purchase_license_spec.rb:82 # User purchase license for self-managed instance with strict cloud license feature flag when disabled activates subscription successfully with license file
rspec ./spec/ui/self_managed/remove_license_spec.rb:29 # User remove current active license file successfully switches to use a cloud license
rspec ./spec/ui/self_managed/renew_license_spec.rb:101 # User renews premium license for self-managed instance successfully renewed using license file
rspec ./spec/ui/self_managed/trial_license_spec.rb:14 # User uploads trial ultimate license activates subscription successfully with correct expiration date
rspec ./spec/ui/self_managed/upgrade_license_spec.rb:53 # User upgrade premium license for self-managed instance successfully upgraded to ultimate and syncs to GitLab with license file
```
Corresponding test case(s):
### Stack trace
```
Failures:
1) User add seats to active license for self-managed instance successfully added user in subscription in GitLab instance using cloud license
Failure/Error:
expect(license).to have_subscription_record(subscription.plan, expiration_date, total_seats,
Vendor::GitLab::Page::SubscriptionPage::CLOUD_LICENSE)
expected `#<QA::Vendor::GitLab::Page::SubscriptionPage:0x00007f045f34e148 @site=#<QA::Runtime::Site:0x00007f045...http://docker:32769/admin/subscription" title="Subscription · Admin Area · GitLab">, @url_param=nil>.has_subscription_record?({:name=>"premium", :plan_id=>"2c92a01176f0d50a0176f3043c4d4a53", :price=>19, :rate_charge_id=>"2c92a01176f0d50a0176f3043c6a4a58", :yearly_price=>228}, "2023-04-04", 26, "cloud license")` to be truthy, got false
# ./spec/ui/self_managed/add_seats_spec.rb:42:in `block (4 levels) in <module:QA>'
# ./spec/ui/self_managed/add_seats_spec.rb:38:in `block (3 levels) in <module:QA>'
# ./page/base.rb:18:in `perform'
# ./spec/ui/self_managed/add_seats_spec.rb:35:in `block (2 levels) in <module:QA>'
2) User purchase license for self-managed instance with online activation activates subscription successfully with activation code
Failure/Error: Page::ManageSubscriptionPage.perform(&:copy_activation_code)
QA::Runtime::Retrier::ExceededMaxAttemptsError:
QA::Runtime::Retrier::ExceededMaxAttemptsError
# ./runtime/retrier.rb:37:in `retry_until'
# ./page/manage_subscription_page.rb:101:in `wait_for_activation_code'
# ./page/manage_subscription_page.rb:92:in `copy_activation_code'
# ./page/base.rb:18:in `perform'
# ./spec/ui/self_managed/purchase_license_spec.rb:30:in `block (3 levels) in <module:QA>'
3) User purchase license for self-managed instance with strict cloud license feature flag when disabled activates subscription successfully with license file
Failure/Error:
expect(cloud_license_page).to have_subscription_record(plan, expiration_date, 1,
Vendor::GitLab::Page::SubscriptionPage::LICENSE_FILE)
expected `#<QA::Vendor::GitLab::Page::SubscriptionPage:0x00007f045dd25fb0 @site=#<QA::Runtime::Site:0x00007f045...http://docker:32769/admin/subscription" title="Subscription · Admin Area · GitLab">, @url_param=nil>.has_subscription_record?({:name=>"ultimate", :plan_id=>"2c92a00c76f0c6c20176f2f9328b33c9", :price=>99, :rate_charge_id=>"2c92a00c76f0c6c20176f2fcbb645b5f", :yearly_price=>1188}, "2023-04-04", 1, "license file")` to be truthy, got false
# ./spec/ui/self_managed/purchase_license_spec.rb:105:in `block (5 levels) in <module:QA>'
# ./spec/ui/self_managed/purchase_license_spec.rb:102:in `block (4 levels) in <module:QA>'
4) User remove current active license file successfully switches to use a cloud license
Failure/Error: portal_sign_in_as(customer.email, customer.password)
Watir::Wait::TimeoutError:
timed out after 30 seconds, waiting for true condition on #<Watir::Button: located: false; {:text=>/Sign in with your GitLab.com account/, :tag_name=>"button"}>
# ./page/base.rb:162:in `find_element'
# ./page/base.rb:33:in `block (3 levels) in singleton class'
# ./page/base.rb:43:in `block (3 levels) in singleton class'
# ./helper/flow.rb:14:in `portal_sign_in_as'
# ./spec/ui/self_managed/remove_license_spec.rb:11:in `block (2 levels) in <module:QA>'
5) User renews premium license for self-managed instance successfully renewed using license file
Failure/Error:
expect(license).to have_subscription_record(subscription.plan, expiration_date, renew_quantity,
Vendor::GitLab::Page::SubscriptionPage::LICENSE_FILE)
expected `#<QA::Vendor::GitLab::Page::SubscriptionPage:0x00007f045dde1b98 @site=#<QA::Runtime::Site:0x00007f045...http://docker:32769/admin/subscription" title="Subscription · Admin Area · GitLab">, @url_param=nil>.has_subscription_record?({:name=>"premium", :plan_id=>"2c92a01176f0d50a0176f3043c4d4a53", :price=>19, :rate_charge_id=>"2c92a01176f0d50a0176f3043c6a4a58", :yearly_price=>228}, "2023-04-18", 50, "license file")` to be truthy, got false
# ./spec/ui/self_managed/renew_license_spec.rb:131:in `block (4 levels) in <module:QA>'
# ./spec/ui/self_managed/renew_license_spec.rb:128:in `block (3 levels) in <module:QA>'
# ./page/base.rb:18:in `perform'
# ./spec/ui/self_managed/renew_license_spec.rb:127:in `block (2 levels) in <module:QA>'
6) User uploads trial ultimate license activates subscription successfully with correct expiration date
Failure/Error: expect(cloud_license_page.visit.subscription_title).to include('You do not have an active subscription')
Watir::Wait::TimeoutError:
timed out after 30 seconds, waiting for true condition on #<Watir::Heading: located: false; {:"data-testid"=>"subscription-activation-title", :tag_name=>"h3"}>
# ./page/base.rb:162:in `find_element'
# ./page/base.rb:33:in `block (3 levels) in singleton class'
# ./page/base.rb:43:in `block (3 levels) in singleton class'
# ./spec/ui/self_managed/trial_license_spec.rb:19:in `block (3 levels) in <module:QA>'
# ./page/base.rb:18:in `perform'
# ./spec/ui/self_managed/trial_license_spec.rb:18:in `block (2 levels) in <module:QA>'
7) User upgrade premium license for self-managed instance successfully upgraded to ultimate and syncs to GitLab with license file
Failure/Error:
expect(license).to have_subscription_record(new_plan, expiration_date, quantity,
Vendor::GitLab::Page::SubscriptionPage::LICENSE_FILE)
expected `#<QA::Vendor::GitLab::Page::SubscriptionPage:0x00007f045d0b9e98 @site=#<QA::Runtime::Site:0x00007f045...http://docker:32769/admin/subscription" title="Subscription · Admin Area · GitLab">, @url_param=nil>.has_subscription_record?({:name=>"ultimate", :plan_id=>"2c92a00c76f0c6c20176f2f9328b33c9", :price=>99, :rate_charge_id=>"2c92a00c76f0c6c20176f2fcbb645b5f", :yearly_price=>1188}, "2023-04-04", 10, "license file")` to be truthy, got false
# ./spec/ui/self_managed/upgrade_license_spec.rb:86:in `block (4 levels) in <module:QA>'
# ./spec/ui/self_managed/upgrade_license_spec.rb:83:in `block (3 levels) in <module:QA>'
# ./page/base.rb:18:in `perform'
# ./spec/ui/self_managed/upgrade_license_spec.rb:82:in `block (2 levels) in <module:QA>'
Finished in 46 minutes 35 seconds (files took 1.32 seconds to load)
```
### Screenshot / HTML page
[artifacts.zip](/uploads/9dbbe78a8586d70b8497e7c46545d420/artifacts.zip)
<!--
Attach the screenshot and HTML snapshot of the page from the job's artifacts:
1. Download the job's artifacts and unarchive them.
1. Open the `gitlab-qa-run-2020-*/gitlab-{ce,ee}-qa-*/{,ee}/{api,browser_ui}/<path to failed test>` folder.
1. Select the `.png` and `.html` files that appears in the job logs (look for `HTML screenshot: /path/to/html/page.html` / `Image screenshot: `/path/to/html/page.png`).
1. Drag and drop them here.
Note: You don't need to include a screenshot if the information it contains can be included as text. Include the text instead.
E.g., error 500/404, "Retry later" errors, etc.
If you include multiple screenshots it can be helpful to hide all but the first in a details/summary element, to avoid excessive scrolling:
<details><summary>Expand for screenshot</summary>
drag and drop the screenshot here
</details>
-->
### Possible fixes
<!--
Choose the stage that appears in the test path, e.g. gitlab~3103452 for
`qa/specs/features/browser_ui/3_create/web_ide/add_file_template_spec.rb`.
-->
<!--
Select a label for where the failure was found, e.g. if the failure occurred in
a nightly pipeline, select gitlab~12204998.
-->
<!--
https://about.gitlab.com/handbook/engineering/quality/guidelines/#priorities:
- gitlab~3857370: Tests that are needed to verify fundamental GitLab functionality.
- gitlab~3857523: Tests that deal with external integrations which may take a longer time to debug and fix.
-->
<!-- Select the current milestone if gitlab~3857370 or the next milestone if gitlab~3857523. -->
issue