[WIP] Explore Self-Hosted Experiments

Parent: #207538 (moved)

Overview

We currently can run experiments on GitLab.com however this is not possible on self-hosted instances. This issue can be used to explore the best approach to self-hosted experiments.

Questions to answer

Are self-hosted experiments valuable?

• Self-hosted experiments are MORE valuable than experiments on .com. 90% of our revenue comes from self-hosted instances, and as a result learnings from self hosted instances can make a much larger impact for the company that learnings from .com.

How to opt in?

• Can we include this in feature preview mode where users opt in to preview early features and experiments on self-hosted?

How to toggle experiments on / off and adjust experiment ratios

• ...

How to collect experiment results (group size, conversion rate, etc.)

• ...