Reevaluate Respond Group GMAU
How is GMAU Calculated Today?
Monitor:Respond GMAU is unique users that interact with Alerts and Incidents.
What users actions are included for GMAU?
- incident_created
- incident_reopened
- incident_closed
- incident_assigned
- incident_todo
- incident_comment
- incident_zoom_meeting
- incident_published
- incident_relate
- incident_unrelate
- incident_change_confidential
- alert_status_changed
- alert_assigned
- alert_todo
- incident_management_timeline_event_created
- incident_management_timeline_event_edited
- incident_management_timeline_event_deleted
What actions are available?
| Event Category | Event Action |
| Incident Management | counts.issues_created_gitlab_alerts |
| Incident Management | counts.incident_issues |
| Incident Management | counts.issues_created_from_alerts |
| Incident Management | counts.alert_bot_incident_issues |
| Incident Management | counts.issues_created_manually_from_alerts |
| Incident Management | counts.issues_with_embedded_grafana_charts_approx |
| Incident Management | counts.issues_with_associated_zoom_link |
| Incident Management | counts.issues_using_zoom_quick_actions |
| Incident Management | redis_hll_counters.quickactions.i_quickactions_promote_to_incident_monthly |
| Incident Management | redis_hll_counters.quickactions.i_quickactions_publish_monthly |
| Incident Management | redis_hll_counters.quickactions.i_quickactions_severity_monthly |
| Incident Management | counts.projects_with_alerts_created |
| Incident Management | counts.projects_with_enabled_alert_integrations |
| Incident Management | usage_activity_by_stage.monitor.projects_with_incidents |
| Incident Management | usage_activity_by_stage_monthly.monitor.projects_with_incidents |
| Incident Management | usage_activity_by_stage.monitor.projects_with_alert_incidents |
| Incident Management | usage_activity_by_stage_monthly.monitor.projects_with_alert_incidents |
| Incident Management | redis_hll_counters.incident_management.incident_management_alert_todo_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_alert_todo_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_comment_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_comment_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_todo_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_todo_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_relate_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_relate_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_assigned_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_alert_assigned_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_alert_assigned_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_alert_status_changed_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_alert_status_changed_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_change_confidential_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_created_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_created_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_zoom_meeting_weekly |
| Incident Management | redis_hll_counters.incident_management_alerts.incident_management_alert_create_incident_monthly |
| Incident Management | counts_monthly.aggregated_metrics.incident_management_alerts_total_unique_counts |
| Incident Management | counts_monthly.aggregated_metrics.incident_management_incidents_total_unique_counts |
| Incident Management | redis_hll_counters.incident_management_alerts.incident_management_alert_create_incident_weekly |
| Incident Management | counts_weekly.aggregated_metrics.incident_management_alerts_total_unique_counts |
| Incident Management | counts_weekly.aggregated_metrics.incident_management_incidents_total_unique_counts |
| Incident Management | redis_hll_counters.incident_management.incident_management_total_unique_counts_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_total_unique_counts_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_unrelate_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_reopened_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_reopened_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_published_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_published_weekly |
| Incident Management | redis_hll_counters.incident_management_oncall.i_incident_management_oncall_notification_sent_weekly |
| Incident Management | redis_hll_counters.incident_management_oncall.i_incident_management_oncall_notification_sent_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_assigned_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_change_confidential_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_closed_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_closed_weekly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_zoom_meeting_monthly |
| Incident Management | redis_hll_counters.incident_management.incident_management_incident_unrelate_monthly |
| Incident Management | redis_hll_counters.quickactions.i_quickactions_publish_weekly |
| Incident Management | redis_hll_counters.quickactions.i_quickactions_severity_weekly |
| Incident Management | redis_hll_counters.quickactions.i_quickactions_promote_to_incident_weekly |
| Incident Management | counts.projects_creating_incidents |
| Incident Management | redis_hll_counters.incident_management.issuable_resource_links_total_unique_counts_monthly |
| Incident Management | redis_hll_counters.incident_management.issuable_resource_links_total_unique_counts_weekly |
| Incident Management | redis_hll_counters.incident_management.timeline_event_total_unique_counts_weekly |
| Incident Management | redis_hll_counters.incident_management.timeline_event_total_unique_counts_monthly |
| Incident Management | counts.status_page_incident_publishes |
| Incident Management | counts.status_page_incident_unpublishes |
| Incident Management | usage_activity_by_stage.monitor.projects_with_enabled_alert_integrations_histogram |
| Incident Management | counts.status_page_issues |
| Incident Management | counts_monthly.projects_with_alerts_created |
| Incident Management | usage_activity_by_stage.monitor.projects_incident_sla_enabled |
| Incident Management | counts.status_page_projects |
| On-Call Schedule Management | redis_hll_counters.quickactions.i_quickactions_page_monthly |
| On-Call Schedule Management | redis_hll_counters.quickactions.i_quickactions_page_weekly |
Available Monthly Options
- alert_create_incident
alert_assignedalert_status_changedalert_todoincident_assignedincident_change_confidentialincident_closedincident_commentincident_createdincident_publishedincident_relateincident_reopenedincident_todoincident_unrelateincident_zoom_meeting- resource_links_total_unique_counts
timeline_event_total_unique_counts- quickactions_promote_to_incident
- quickactions_publish
- quickactions_severity
Additional metrics to add
- alert_create_incident
- resource_links_total_unique_counts
- quickactions_promote_to_incident
- quickactions_publish
- quickactions_severity
Problem
- Monitor:Respond GMAU growth has been stagnant since February 2021.
- Users interacting with alerts and incidents might not be the best proxy for adoption.
- Users want less alerts and incidents.
Proposed Solution
-
Cross check what is included in GMAU? Are we capturing all metrics available? Should there be more? -
Brainstorm additional ideas about how GMAU could be measured.
Conclusion
We decided against add ALL available metrics to Respond GMAU. Additional context can be found on the closed MR (Updating Respond Group GMAU (gitlab-org/gitlab!98245 - closed)) and in this thread.
TL;DR;
Comparing the same aggregate pre-MR and post-MR will be an apples to oranges comparison. It will be difficult to discern if changes in a metric are due to actual changes in user behavior or due solely to users upgrading GitLab versions and the broader scope of the the aggregate. It is best to introduce a new aggregate metric with these changes, rather than updating the existing metric. The older metric could continue to be used for historical comparisons and the new metric be used going forward.
What are we doing instead?
Edited by Alana Bellucci