Revise Optimize GMAU Q4 target to 10% lift
Why is this change being made?
Previously, we didn't have a reliable GMAU for Optimize and we needed to validate the data we were collecting in usage ping. We've successfully validated the accuracy of the counter (analytics_unique_visits_for_any_target_monthly
) and can set a target.
Since usage data only works moving forward (we can't go back in time and retroactively study any the impact of any counters added), so setting a target is challenging. In Product#1603 (comment 429240058), I pulled some data from Snowplow based on total pageviews; in that issue, I proposed making our goal +10%, which would put our numbers back around May - July levels and motivate us to research into the reason for the decline.
I propose setting our Q4 target to increase the number of unique users viewing analytics page to +10% of October's level, or about 40,150 unique viewers on SaaS.
This doesn't include self-managed data, since we're JUST seeing users upgrade after making a self-managed feature flag default-on. After we see more data from self-managed users, we'll adjust this goal accordingly.
Author Checklist
-
Provided a concise title for the MR -
Added a description to this MR explaining the reasons for the proposed change, per say-why-not-just-what -
Assign this change to the correct DRI - If the DRI for the page/s being updated isn’t immediately clear, then assign it to your manager.
- If your manager does not have merge rights, please ask someone to merge it AFTER it has been approved by your manager in #mr-buddies.
- If the changes relate to any part of the project other than updates to content and/or data files please make sure to ping
@gl-static-site-editor
in a comment for a review and merge. For example changes to.gitlab-ci.yml
, JavaScript/CSS/Ruby code or the layout files.