Display packages navigation in left sidebar to a cohort of net new .com signups
Hypothesis
Some free users do not know that the GitLab platform offers the ability to utlize Packages.
Supporting data
When a net-new user signs up for GitLab.com account, the only way the can discover the Package features is by reading the documentation on their own, talking to someone at GitLab, starting a trial or upgrading.
Experiment design
We split net new sign-ups into two groups. The control gets the standard experience today where we do not display Packages in the navigation. The experiment group will get the same onboarding experience as the control but the Packages navigation item will be present in the left-hand side navigation. If a user selects the Packages options we will display a paywall state where we pitch the value of Packages and highlight some of the features it offers while providing them with the opportunity to upgrade or start a trial.
Internal approvals for navigation changes
The handbook states the navigation is a shared space across the product organization based on who owns a particular feature. The Plan PM has signed off on us running this experiment in this issue product#97.
Design
We will use this locked feature page design and instead of displaying an image we will list the five core features:
- Package registry
- Container registry
- Helm chart registry
- Dependency proxy
- Dependency firewall
Title copy:
Package Create a consistent and dependable software supply chain with built-in universal package management
Main body copy: GitLab enables teams to package their applications and dependencies, manage containers, and build artifacts with ease. The private, secure container registry and artifact repositories are built-in and preconfigured out-of-the box to work seamlessly with GitLab source code management and CI/CD pipelines. Ensure DevOps acceleration with automated software pipelines that flow freely without interruption.
CTAs: Primary CTA: Start a free trial
Primary CTA URL: https://customers.gitlab.com/trials/new?gl_com=true
Secondary CTA: Upgrade now
Secondary CTA URL: https://gitlab.com/profile/billings
Success metric
We will compare the upgrade and trials rates of the control vs experiment group at both the user and account (namespace) levels. We will also want to track the page view to CTA section to action taken (i.e. trail started or upgrade succeeded) so we have a baseline to compare to for any future iterations to this experiment.
ICE score
| Impact | Confidence | Ease | Score |
|---|---|---|---|
| 6 | 5 | 8* | 6.33 |
- Needs to be revised after UX design