Skip to content

Revise Optimize GMAU Q4 target to 10% lift

Jeremy Watson (ex-GitLab) requested to merge jeremy-master-patch-29950 into master

Why is this change being made?

Previously, we didn't have a reliable GMAU for Optimize and we needed to validate the data we were collecting in usage ping. We've successfully validated the accuracy of the counter (analytics_unique_visits_for_any_target_monthly) and can set a target.

Since usage data only works moving forward (we can't go back in time and retroactively study any the impact of any counters added), so setting a target is challenging. In Product#1603 (comment 429240058), I pulled some data from Snowplow based on total pageviews; in that issue, I proposed making our goal +10%, which would put our numbers back around May - July levels and motivate us to research into the reason for the decline.

I propose setting our Q4 target to increase the number of unique users viewing analytics page to +10% of October's level, or about 40,150 unique viewers on SaaS.

This doesn't include self-managed data, since we're JUST seeing users upgrade after making a self-managed feature flag default-on. After we see more data from self-managed users, we'll adjust this goal accordingly.

Author Checklist

  • Provided a concise title for the MR
  • Added a description to this MR explaining the reasons for the proposed change, per say-why-not-just-what
  • Assign this change to the correct DRI
    • If the DRI for the page/s being updated isn’t immediately clear, then assign it to your manager.
    • If your manager does not have merge rights, please ask someone to merge it AFTER it has been approved by your manager in #mr-buddies.
    • If the changes relate to any part of the project other than updates to content and/or data files please make sure to ping @gl-static-site-editor in a comment for a review and merge. For example changes to .gitlab-ci.yml, JavaScript/CSS/Ruby code or the layout files.
Edited by Jeremy Watson (ex-GitLab)

Merge request reports