Add ability to segment experiment tracking for free vs trial
It was discovered that we implemented the experiment on both free & trial registration flows. Originally, the intent was only to display on trial registration but I probably miscommunicated this (sorry!).
As we have implemented it on free and trial registration flows, we want to ensure the implemented tracking allows us to discern any differences in success metrics & signup intent selection for free vs trial.
Current Behaviour
- Signup intent dropdown displays on both free & trial registration flow (Step 1)
Free | Trial |
---|---|
-
@syarynovskyi
I think we show signup intent dropdown for free and trial, but we track submitted_intent only for trial registrations
- The current experiment results do not show the free and trial breakdown for Step completion, only intent selection
Expected Behaviour
- The originally implemented tracking is updated so we are able to:
- track Step 1 --> 2/3 (Identity Verification) and Step 1 --> 4 (/welcome) for both Free & Trial
- track Signup Intent selection for both Free & Trial
- The experiment results we get after we re-run show the free and trial breakdown for Step completion and intent selection on the GLEX dashboard.
Updated Tracking Details
-
json schema used in
gitlab-experiment
tracking. -
What should we use to distinguish free vs trial?
sequence | activity | action | label |
---|---|---|---|
1 | experiment assignment |
control or candidate
|
|
2 | intent selection on step one | select_signup_intent_dropdown_new_team_registration_step_one |
free or trial
|
select_signup_intent_dropdown_new_personal_account_registration_step_one |
free or trial
|
||
select_signup_intent_dropdown_join_existing_team_registration_step_one |
free or trial
|
||
select_signup_intent_dropdown_contribute_public_project_registration_step_one |
free or trial
|
||
3 | identity verification renders | render_identity_verification |
free or trial
|
4 | welcome page renders | render_welcome |
free or trial
|