Design of experiments.rb

Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.

I looked at experiments.rb and its behavior while working on !31610 (closed)

This raised a following questions:

  • Would it be better to name a feature flag to be _experiment, as otherwise we put in a name the type of evaluation being done
  • I believe we put the expirements in .rb in order to have mapping for Growth::Acquisition::Experiment::SignUpFlow. Maybe the above could simply generate from a feature flag name?
  • Can we fallback to Flipper instead of doing MOD on experimentation_subject_index and experiment_percentage?
  • Wouldn’t it be better to tie the experiment to user or session instead of experiment cookie?
  • Usage of enable_percentage_of_time in docs is confusing, as we use this to effectively implement enable_percentage_of_actors
  • I think we have a ton of logic being reimplemented, where all of that seems to be implemented in Flipper already?
Edited by 🤖 GitLab Bot 🤖