Follow-up: Restrict license removal for GitLab.com (SaaS)

As a part of the discussion here and here, we learned that we might be able to implement a better experience. This issue is to follow up on this.