Skip to content

馃摵 Usage Ping with AMAU and updated SMAU - Parent Issue

Background and Overview

The current SMAU dashboards are incorrect:

  • Self managed - The current reported SMAU is overestimated as it does not count unique users performing actions within a stage. Currently, If 1 user uses 1 feature from a stage, we count every user on the instance as a Monthly Active User for that stage. Usage ping is also struggling to do basic SELECT COUNT(*) on large instances; many of these queries time out on GitLab.com

  • .Com - SMAU is currently blocked due to:

    • User_id is not available for snowplow events
    • Structured events are not in place. Currently we have unstructured, self-describing events, which requires parsing through the unstructured data and the process will break whenever the CSS or JS changes on the site, there is no stability in these types of events

The proposal is to fix the time out issue for larger instances on usage ping and update the SMAU definition to be highest AMAU (Actions Monthly Active User) for a stage. The .com SMAU and AMAU will also be based on the usage ping data.

Outcomes

  • Improve accuracy of SMAU
  • Improve completeness of usage ping dataset
  • Internally consistent view of SMAU between self-managed and .com
  • Measure active use in a Periscope dashboard
  • Enable us to improve SMAU

Other Resources

SMAU and AMAU discussion

Problems To Solve:

  • A) Fix usage ping: Usage ping has been broken on GitLab.com since Jan 2019 due to an uncaught error.
  • B) Stage specific counters: Some stages currently do not have usage ping counters.
  • C) Query optimizations: Usage ping counters are timing out due to very large tables.
  • D) Dashboards: All of this data is being used to create SMAU dashboards in Sisense.
  • E) Documentation: The current documentation is lacking making it hard for stage teams to implement usage ping.
  • F) Harden Usage Ping: Usage ping in it's current state is fragile and we need to increase it's stability.

Next Steps

--- 12.9 ---

A) Fix usage ping:

B) Stage specific counters:

C) Query optimizations:

  • Fix priority counters on GitLab.com, all these should work on self-managed with or without the optimization fixes
Milestone Status Assignee Weight Title Issue Merge request
12.9 verified working on gprd @a_akgun 3 Optimize todos counters gitlab-org/gitlab#208891 (closed) gitlab-org/gitlab!26442 (merged)
12.9 verified working on gprd @a_akgun 3 Optimize notes and suggestions counters gitlab-org/gitlab#208890 (closed) gitlab-org/gitlab!26871 (merged)
12.9 verified working on gprd @a_akgun 3 Optimize event counters gitlab-org/gitlab#208889 (closed) gitlab-org/gitlab!26444 (merged)
12.9 verified working on gprd @a_akgun 3 Optimize service_desk_issue counters related to the ::Issue gitlab-org/gitlab#208888 (closed) gitlab-org/gitlab!26445 (merged)
12.9 verified working on gprd @alinamihaila 3 Optimize deployment counters related to the ::Deployment gitlab-org/gitlab#208886 (closed) gitlab-org/gitlab!26757 (merged)
12.9 verified working on gprd @dstull 3 Optimize project counters related to the ::Project gitlab-org/gitlab#208887 (closed) gitlab-org/gitlab!26686 (merged) gitlab-org/gitlab!26698 (merged) gitlab-org/gitlab!26802 (merged) gitlab-org/gitlab!27115 (merged)
12.9 verified working on gprd @a_akgun 3 Optimize ci_pipeline counters related to the ::Ci::Pipeline gitlab-org/gitlab#208885 (closed) gitlab-org/gitlab!26774 (merged)
12.9 verified working on gprd @a_akgun 3 Optimize services_usage counters gitlab-org/gitlab#210007 (closed) gitlab-org/gitlab!26973 (merged)
12.9 verified working on gprd @alinamihaila 5 Approximate counters are not working on gitlab.com gitlab-org/gitlab#210332 (closed) gitlab-org/gitlab!27218 (merged)
12.9 removed, duplicate @alinamihaila 3 Optimize protected branch counters gitlab-org/gitlab#210052 (closed) gitlab-org/gitlab!27017 (closed)

E) Documentation:

--- 12.10 ---

A) Fix usage ping:

  • Reenable automated usage ping on .com

C) Query optimizations:

  • Fix priority counters on GitLab.com, all these should work on self-managed with or without the optimization fixes
Milestone Status Assignee Weight Title Issue Merge request
12.10 verification, waiting for gprd deployment @alexbuijs 13 Enable batch counting for some individual queries gitlab-org/gitlab#208923 (closed) gitlab-org/gitlab!26887 (merged) gitlab-org/gitlab!26972 (merged) gitlab-org/gitlab!26982 (merged) gitlab-org/gitlab!27093 (merged) gitlab-org/gitlab!27110 (merged) gitlab-org/gitlab#210559 (closed) gitlab-org/gitlab!27352 (merged) gitlab-org/gitlab!27455 (merged) gitlab-org/gitlab!27526 (merged) gitlab-org/gitlab!27533 (merged) gitlab-org/gitlab!27540 (merged) gitlab-org/gitlab!27544 (merged)
12.10 verification, already on gprd @dstull 2 Follow-up from "Optimize ZoomMeeting batch query" gitlab-org/gitlab#210559 (closed) gitlab-org/gitlab!27236 (merged)
12.10 verification, already on gprd @a_akgun 5 Optimize ci_builds counters related to the ::Ci::Build gitlab-org/gitlab#208884 (closed) gitlab-org/gitlab!26596 (closed) gitlab-org/gitlab!27770 (merged) gitlab-org/gitlab!28027 (merged)
12.10 verification, already on gprd @alinamihaila 3 Optimize or remove ldap_users counter gitlab-org/gitlab#210051 (closed) gitlab-org/gitlab!27197 (merged)
12.10 verification, already on gprd @alinamihaila 3 Optimize service_desk_enabled_projects counter in usage_data gitlab-org/gitlab#211802 (closed) gitlab-org/gitlab!27589 (merged)
12.10 verification, already on gprd @alinamihaila 3 Optimize service_desk_enabled_projects counter in usage_data gitlab-org/gitlab#211474 (closed) gitlab-org/gitlab!27309 (merged)
12.10 removed, duplicate @a_akgun @alinamihaila Improve usage data for Leaky Index gitlab-org/gitlab#208234 (closed)
12.10 verification, waiting for gprd deployment @a_akgun 3 Optimize notes and suggestions counters gitlab-org/gitlab#208890 (closed) gitlab-org/gitlab!26443 (merged)

D) Dashboards:

F) Harden usage ping:

--- 13.0 ---

F) Harden usage ping:

Edited by Jerome Z Ng