Proof of Concept: Fill out product category information in metrics dictionary

Problem

Currently, the metrics dictionary has no information on which product category a specific metric belongs to.

We do have the product group information but this give a team-wise breakdown of metrics, not a feature and category wise.

This makes it difficult to answer questions like "which product area has good/bad instrumentation coverage".

Furthermore, there are thousands of metrics without this information: manually inspecting the code to determine this would be time-consuming.

Desired Outcome

Come up with a mechanism to retrospectively label all the events using Duo Agent Platform.

Potential Solutions

See how we can use the Duo Agent Platform to automate:

• Product category discovery:
• Code change (update the metrics definition)
• Review (get the team owning the metric to review)

Break down this effort:

• by metric type:
• Start with lighthouse metrics
• expand to health score, leading indicators etc
• by team
  • Start with one team, analize patterns
  • expand to more teams, standardize the process

How to verify

• We have a plan to get to 100% coverage on product category information for both service ping as well as internal events in metrics dictionary.