QA & Review the preliminary SMAU dashboard
Dashboard
https://app.periscopedata.com/app/gitlab/604621/GitLab.com-Postgres-SMAU
Background
In order to create SMAU dashboard, we asked each stage PM/Director to pick an usage ping event to be the SMAU metric.
The list of definition is here
We are able to create a draft periscope SMAU dashboard for .com only using data that is currently in our data warehouse.
Because .com is an instance, so we have data collected into our data warehouse already, so this provides a quick view into .com metrics, without having to wait for usage ping fix .
Here is the WIP dashboard created from Usage Ping (.com and Self-hosted)
Action Item
We want to ask PMs/Directors to help review & QA the dashboard to identify:
- Does the number for SMAU for your stage make sense to you? Please help cross-check with any other data sources and against your knowledge
- Now that you see the data, does the event you pick still make sense to you?
Current status:
Stage | SMAU Candidate based on usage ping | Event details | Confirmed by |
---|---|---|---|
configure | clusters_applications_helm | :Clusters::Applications::Helm.distinct_by_user | @kencjohnston |
create | merge_requests | :MergeRequest.distinct_count_by(:author_id) | @ebrinkman |
manage | User creation | users_created: distinct_count(::User.where(time_period), :id) | @jeremy |
monitor | projects_prometheus_active | :Project.with_active_prometheus_service.distinct_count_by(:creator_id) | @kencjohnston |
plan | issues | :Issue.distinct_count_by(:author_id) | @ebrinkman |
release | deployments | :Deployment.distinct_count_by(:user_id) | @jmeshell |
secure | adding tracking | ||
verify | ci_pipelines | :Ci::Pipeline.distinct_count_by(:user_id) | @jyavorska |
* To be included in a future iteration:
The following are passive actions that are not measuring user activity, these are actions like administrative setting, an action that is configured once and then there is no direct interaction with it for awhile. These are temporary until a more viable action is defined that is tracking actions that measure active usage
Stage | SMAU Candidate based on usage ping | Event details | Confirmed by |
---|---|---|---|
configure | clusters_applications_helm | :Clusters::Applications::Helm.distinct_by_user | @kencjohnston |
monitor | projects_prometheus_active | :Project.with_active_prometheus_service.distinct_count_by(:creator_id) | @kencjohnston |
Next steps:
- Monitor : Explore metrics while we wait for other user-fied north start metrics
- Configure : Explore metrics while we wait for users creating pipeline deploys
The following stages do not have a SMAU metric.
Stage | SMAU Candidate based on usage ping | Event details | Confirmed by |
---|---|---|---|
defend | Pending | @stkerr | |
enablement | Pending | @joshlambert | |
package | Pending | @trizzi |
Next steps:
- Defend - Vulnerability Management category will have a metric measuring user activity. TBD for other categories.
- Enablement - No SMAU candidate that is a good representation of the stage
- Package - Requires instrumentation, Unique users that have published Docker images to the Container Registry