Skip to content

Prep for Ops Section PI Review - 2020-08-06

📖 References

🎯 Intent

We are organizing for and regularly reviewing Performance Indicators (PIs) in order to enable a dialog between ourselves (all of R&D) about most effective use of our R&D efforts towards the most impactful improvements. As a result we should:

  • focus on singular Performance Indicators
  • focus on the art of the possible, what we can measure and get react to quickly
  • focus on business metrics, particularly SMAU
  • continue beyond measurement and review of our Performance Indicators to building a Growth Model, a Growth funnel and supporting metrics and segmentation

As a communication tool, Performance Indicators are only as useful as the range of the audience. As a result we should:

  • store PI metrics, funnels, growth models, status and next steps handbook first (avoid content only living in slides)
  • expose our product groups to PI metrics regularly
  • communicate transparently about adjustments to PIs within our groups
  • reference PIs in planning issues and prioritization discussions

Tasks

Opening Tasks

  • Set a due date to this issue as 2 days prior to the scheduled review - @kencjohnston
  • Update the reference to the this Prep issue in the first slide of the presentation - @kencjohnston
  • Add a restrospective thread to this issue - @kencjohnston
  • Update Agenda - @kencjohnston

Other Tasks

Performance Indicator YAML Updates

Each product stage or group should update the Performance Indicators YAML file with:

  • Update your health: and instrumentation: levels
  • Review your definition to include both what specifically is being measured and the rationale for why you chose that measurement
  • Update any urls: to reference stage/group direction or handbook pages for the growth model and funnel
  • Update any urls: to reference additional Sisense dashboards for more details
  • Update health: reasons: with Insight - prefixed comments about insights gained from the last month of data
  • Update health: reasons: with Improvement - prefixed comments about planned improvements to reach your goals over the next month
  • If there have been recent updates to the definition, growth model, funnel highlight those and include those as reasons: under health:
  • If you don't have a defined metric, rationale, growth model or funnel in the handbook reference issues for creating those and provide status on blockers in the reasons: under instrumentation:.

Group Updates

2️⃣ Second Round Updates

We missed the mark on insights and improvements in the first round of updates.

Please focus on these specific instructions.

  • Update health: reasons: with Insight - prefixed comments about insights gained from the last month of data
  • Update health: reasons: with Improvement - prefixed comments about planned improvements to reach your goals over the next month
  • If there have been recent updates to the definition, growth model, funnel highlight those and include those as reasons: under health:
  • If you don't have a defined metric, rationale, growth model or funnel in the handbook reference issues for creating those and provide status on blockers in the reasons: under instrumentation:.

I'd really like to see Insight -s for any instrumented metrics, Improvement -s for all metrics, and issue references for all next steps. If you haven't instrumented the metric reference an issue for doing so, if you don't have a growth model have an issue for creating one.

Closing Tasks

Edited by Kenny Johnston