Skip to content

[ENG Parent] Display active trial status

Overview

The purpose of this issue is to represent the required engineering work for this parent epic. The parent epic contains the full rational behind the experiment.

Design Specs

Implementation

MVC implementation: The new experience will primarily be experienced by viewing it in the left nav and interacting with it on hover. On hover, a user will have the ability to select a CTA to upgrade.

  • The existing trial expired banner should be removed for the experiment group (related issue)
  • This trial countdown should only be visible to Owners of the namespace

This will be delivered in the following issues:

  1. growth experiment Add current trial status for namespace to sidebar
    • No popover on hover, we’ll make the whole sidebar item clickable and take them to the billing page for that namespace
    • Track which namespaces on in the control vs. experimental cohorts
    • Track click rate of the info-button
    • Track the trial upgrade rate of the control vs. experimental cohorts
  2. growth experiment Show more info on hover of trial status in sidebar
    • Include the buttons to [Upgrade {group name} to Gold] & [Compare all plans]
    • I would run this as a separate experiment in addition to or after the previous one
    • It could be interesting to A/B test the whole sidebar item being clickable as the expected action to take and the sidebar item not being clickable but hover-able to show a popover which then has buttons of actions to take
    • Track which namespaces on in the control vs. experimental cohorts
    • Track the view rate of the popover by the experiment group
    • Track the view-to-click rate by the experiment group
    • The average and median number of views per user or namespace for the experiment group
    • Track the trial upgrade rate of the control vs. experimental cohorts
  3. growth experiment Remind user of trial status when 14 & 3 days remain
    • I would recommend running this as a separate experiment, either in addition to or after the preceding one
    • Track which namespaces on in the control vs. experimental cohorts
    • The view-to-click rate when the modal is automatically opened at the 14 & 3 days remaining marks in the experiment group
    • Track the trial upgrade rate of the control vs. experimental cohorts

Future Iteration:

In the future in a separate experiment we can test the following:

  • Pop the modal at time-specific time intervals, to remind the Owners:
    • When the trial has <= 14 days remaining
    • When the trial has <= 3 days remaining

Experiment Tracking

To track this experiment we're going to need to be able to see the following:

  • The number of namespaces in the control vs experiment group
  • The view rate of the popover with information by the experiment group
  • The view of the popover to CTA click rate by the experiment group
  • The average and median number of views per user or namespace for the experiment group
  • The trial upgrade rate of the control vs the experiment group

Future Iteration:

  • The view to click rate when the modal is automatically opened at the 14 and 3 days remaining mark in the experiment group
Edited by Dallas Reedy