Experiment tracking: invite_members_version_b in assignee dropdown
Overview
This is an experiment tracking issue for: https://gitlab.com/gitlab-org/gitlab/-/issues/235979 using the scoped experiment labels.
As well as defining the experiment rollout and cleanup, this issue incorporates the relevant
Feature Flag Roll Out
steps.
Owners
- Team:
group::expansion
- Most appropriate slack channel to reach out to:
#g_expansion
- Best individual to reach out to: @s_awezec
Expectations
What are we expecting to happen?
When enabled, users who are not Owners or Maintainers will see:
What might happen if this goes wrong?
What can we monitor to detect problems with this?
Staging Test
To force this experiment on staging use ?force_experiment=<experiment-key>
See link to staging environment test
Rollout plan:
- Runtime: 30 days or until we reach statistical significance
- We will roll this out behind a feature flag and expose this to 20% of users to start then ramp it up from there.
- Experiment key
invite_members_version_b
(seeexperimentation.rb
in GitLab, append '_experiment_percentage' for feature flag name)
/chatops run feature set invite_members_version_b_experiment_percentage <INITIAL_PERCENTAGE>
-
2021-02-08 enable at 20% in production #214 (comment 502960953)
Beta groups/projects
- ...
- ...
Roll Out Steps
-
Enable on staging -
Test on staging -
Ensure that documentation has been updated -
Enable on GitLab.com for individual groups/projects listed above and verify behavior. -
Announce on the issue an estimated time this will be enabled on GitLab.com -
Enable on GitLab.com by running chatops command in #production
-
Cross post chatops slack command to #support_gitlab-com
(more guidance when this is necessary in the dev docs) and in your team channel -
Announce on the issue that the flag has been enabled -
Remove feature flag and add changelog entry -
After the flag removal is deployed, clean up the feature flag by running chatops command in #production
channel
Results:
Results can be viewed in this Sisense dashboard (GitLab internal).
Edited by Phil Calder