Multiple failures in /spec/ui/self_managed/ in CustomersDot
Summary
Failing job(s): https://gitlab.com/gitlab-org/customers-gitlab-com/-/jobs/2287042980
Failing spec(s):
14 examples, 7 failures
Failed examples:
rspec ./spec/ui/self_managed/add_seats_spec.rb:19 # User add seats to active license for self-managed instance successfully added user in subscription in GitLab instance using cloud license
rspec ./spec/ui/self_managed/purchase_license_spec.rb:19 # User purchase license for self-managed instance with online activation activates subscription successfully with activation code
rspec ./spec/ui/self_managed/purchase_license_spec.rb:82 # User purchase license for self-managed instance with strict cloud license feature flag when disabled activates subscription successfully with license file
rspec ./spec/ui/self_managed/remove_license_spec.rb:29 # User remove current active license file successfully switches to use a cloud license
rspec ./spec/ui/self_managed/renew_license_spec.rb:101 # User renews premium license for self-managed instance successfully renewed using license file
rspec ./spec/ui/self_managed/trial_license_spec.rb:14 # User uploads trial ultimate license activates subscription successfully with correct expiration date
rspec ./spec/ui/self_managed/upgrade_license_spec.rb:53 # User upgrade premium license for self-managed instance successfully upgraded to ultimate and syncs to GitLab with license fileCorresponding test case(s):
Stack trace
Failures:
1) User add seats to active license for self-managed instance successfully added user in subscription in GitLab instance using cloud license
Failure/Error:
expect(license).to have_subscription_record(subscription.plan, expiration_date, total_seats,
Vendor::GitLab::Page::SubscriptionPage::CLOUD_LICENSE)
expected `#<QA::Vendor::GitLab::Page::SubscriptionPage:0x00007f045f34e148 @site=#<QA::Runtime::Site:0x00007f045...http://docker:32769/admin/subscription" title="Subscription · Admin Area · GitLab">, @url_param=nil>.has_subscription_record?({:name=>"premium", :plan_id=>"2c92a01176f0d50a0176f3043c4d4a53", :price=>19, :rate_charge_id=>"2c92a01176f0d50a0176f3043c6a4a58", :yearly_price=>228}, "2023-04-04", 26, "cloud license")` to be truthy, got false
# ./spec/ui/self_managed/add_seats_spec.rb:42:in `block (4 levels) in <module:QA>'
# ./spec/ui/self_managed/add_seats_spec.rb:38:in `block (3 levels) in <module:QA>'
# ./page/base.rb:18:in `perform'
# ./spec/ui/self_managed/add_seats_spec.rb:35:in `block (2 levels) in <module:QA>'
2) User purchase license for self-managed instance with online activation activates subscription successfully with activation code
Failure/Error: Page::ManageSubscriptionPage.perform(&:copy_activation_code)
QA::Runtime::Retrier::ExceededMaxAttemptsError:
QA::Runtime::Retrier::ExceededMaxAttemptsError
# ./runtime/retrier.rb:37:in `retry_until'
# ./page/manage_subscription_page.rb:101:in `wait_for_activation_code'
# ./page/manage_subscription_page.rb:92:in `copy_activation_code'
# ./page/base.rb:18:in `perform'
# ./spec/ui/self_managed/purchase_license_spec.rb:30:in `block (3 levels) in <module:QA>'
3) User purchase license for self-managed instance with strict cloud license feature flag when disabled activates subscription successfully with license file
Failure/Error:
expect(cloud_license_page).to have_subscription_record(plan, expiration_date, 1,
Vendor::GitLab::Page::SubscriptionPage::LICENSE_FILE)
expected `#<QA::Vendor::GitLab::Page::SubscriptionPage:0x00007f045dd25fb0 @site=#<QA::Runtime::Site:0x00007f045...http://docker:32769/admin/subscription" title="Subscription · Admin Area · GitLab">, @url_param=nil>.has_subscription_record?({:name=>"ultimate", :plan_id=>"2c92a00c76f0c6c20176f2f9328b33c9", :price=>99, :rate_charge_id=>"2c92a00c76f0c6c20176f2fcbb645b5f", :yearly_price=>1188}, "2023-04-04", 1, "license file")` to be truthy, got false
# ./spec/ui/self_managed/purchase_license_spec.rb:105:in `block (5 levels) in <module:QA>'
# ./spec/ui/self_managed/purchase_license_spec.rb:102:in `block (4 levels) in <module:QA>'
4) User remove current active license file successfully switches to use a cloud license
Failure/Error: portal_sign_in_as(customer.email, customer.password)
Watir::Wait::TimeoutError:
timed out after 30 seconds, waiting for true condition on #<Watir::Button: located: false; {:text=>/Sign in with your GitLab.com account/, :tag_name=>"button"}>
# ./page/base.rb:162:in `find_element'
# ./page/base.rb:33:in `block (3 levels) in singleton class'
# ./page/base.rb:43:in `block (3 levels) in singleton class'
# ./helper/flow.rb:14:in `portal_sign_in_as'
# ./spec/ui/self_managed/remove_license_spec.rb:11:in `block (2 levels) in <module:QA>'
5) User renews premium license for self-managed instance successfully renewed using license file
Failure/Error:
expect(license).to have_subscription_record(subscription.plan, expiration_date, renew_quantity,
Vendor::GitLab::Page::SubscriptionPage::LICENSE_FILE)
expected `#<QA::Vendor::GitLab::Page::SubscriptionPage:0x00007f045dde1b98 @site=#<QA::Runtime::Site:0x00007f045...http://docker:32769/admin/subscription" title="Subscription · Admin Area · GitLab">, @url_param=nil>.has_subscription_record?({:name=>"premium", :plan_id=>"2c92a01176f0d50a0176f3043c4d4a53", :price=>19, :rate_charge_id=>"2c92a01176f0d50a0176f3043c6a4a58", :yearly_price=>228}, "2023-04-18", 50, "license file")` to be truthy, got false
# ./spec/ui/self_managed/renew_license_spec.rb:131:in `block (4 levels) in <module:QA>'
# ./spec/ui/self_managed/renew_license_spec.rb:128:in `block (3 levels) in <module:QA>'
# ./page/base.rb:18:in `perform'
# ./spec/ui/self_managed/renew_license_spec.rb:127:in `block (2 levels) in <module:QA>'
6) User uploads trial ultimate license activates subscription successfully with correct expiration date
Failure/Error: expect(cloud_license_page.visit.subscription_title).to include('You do not have an active subscription')
Watir::Wait::TimeoutError:
timed out after 30 seconds, waiting for true condition on #<Watir::Heading: located: false; {:"data-testid"=>"subscription-activation-title", :tag_name=>"h3"}>
# ./page/base.rb:162:in `find_element'
# ./page/base.rb:33:in `block (3 levels) in singleton class'
# ./page/base.rb:43:in `block (3 levels) in singleton class'
# ./spec/ui/self_managed/trial_license_spec.rb:19:in `block (3 levels) in <module:QA>'
# ./page/base.rb:18:in `perform'
# ./spec/ui/self_managed/trial_license_spec.rb:18:in `block (2 levels) in <module:QA>'
7) User upgrade premium license for self-managed instance successfully upgraded to ultimate and syncs to GitLab with license file
Failure/Error:
expect(license).to have_subscription_record(new_plan, expiration_date, quantity,
Vendor::GitLab::Page::SubscriptionPage::LICENSE_FILE)
expected `#<QA::Vendor::GitLab::Page::SubscriptionPage:0x00007f045d0b9e98 @site=#<QA::Runtime::Site:0x00007f045...http://docker:32769/admin/subscription" title="Subscription · Admin Area · GitLab">, @url_param=nil>.has_subscription_record?({:name=>"ultimate", :plan_id=>"2c92a00c76f0c6c20176f2f9328b33c9", :price=>99, :rate_charge_id=>"2c92a00c76f0c6c20176f2fcbb645b5f", :yearly_price=>1188}, "2023-04-04", 10, "license file")` to be truthy, got false
# ./spec/ui/self_managed/upgrade_license_spec.rb:86:in `block (4 levels) in <module:QA>'
# ./spec/ui/self_managed/upgrade_license_spec.rb:83:in `block (3 levels) in <module:QA>'
# ./page/base.rb:18:in `perform'
# ./spec/ui/self_managed/upgrade_license_spec.rb:82:in `block (2 levels) in <module:QA>'
Finished in 46 minutes 35 seconds (files took 1.32 seconds to load)Screenshot / HTML page
Possible fixes
Edited by Sofia Vistas