A/B testing Problem Validation
What’s this issue all about?
We want to develop an A/B testing solution as an expansion of feature flags
A/B Testing can be thought about as an extension of feature flags. A/B testing allows the testing of variables on different groups of data and monitoring which is the preferred method. Take for example a website that wants to increase sales and want to check which workflow will result with users adding more items to their cart. Developers can experiment with different user flows each one sending the user through different routes in the Websites UI. The developers monitor the website for sometime and see which flow resulted in the most revenue, and this will be the chosen workflow for all users once the experiment is done. This is efficient to test the change on usability, bast on the test results, which can be business goals, better performance, customer engagement and more.
Who is the target user of the feature?
- Growth Teams
- Developers
- Product Managers
What hypotheses and/or assumptions do you have?
What decisions will you make based on the research findings?
When do you need this research to be completed? (Milestone or date)
Task list
-
Create the discussion guide -
Create the Dovetail project -
Internal recruitment -
Internal interviewing -
P1 -
P2 -
P3 -
P4 -
P5 -
P6 -
P7
-
-
Internal interview dovetail tagging -
P1 -
P2 -
P3 -
P4 -
P5 -
P6 -
P7
-
-
External Recruitment issue -
External interviewing -
P8 -
P9 -
P10 (1/2) -
P10 (2/2) -
P11 -
P12 -
P13
-
-
External interview dovetail tagging -
P8 -
P9 -
P10 -
P11 -
P12 -
P13(This interview will sadly mostly not be relevant to the research as the customer only focuses on data analysis and none of the other activities we are targeting. They do data gathering by phone call for more traditional research.)
-
-
Insights synthesis -
Insight issue creation -
Whiteboard session -
[optional] Second interview round (with internal participants) -
Additional interviewing -
Additional interview dovetail tagging -
Additional Insights synthesis
-
-
Whiteboard session -
Feature issue creation -
Think Big Figma Design document -
Whiteboard session -
Creation of roadmap epic and individual implementation issues -
Record video / UX showcase