AI Impact analytics - [UX] adding "Overview tiles" at the top of the page
Problem
Engineering leadership (Director/VP/CTO) need to demonstrate the ROI from the investments in AI features. To quantify the impact of adding AI and to demonstrate the ROI, they need to:
- Analyze the effectiveness of the Code Suggestion functionality.
- Understand the level of usage of Code Suggestion.
- During Duo evaluation, customers need the ability to compare and report on the trial's success.
Proposal
- Adding to the "AI Impact view" page, new overview tiles:
- Tile 1:
GitLab Duo Pro seats: Assigned and used
- Tile 2:
Code Suggestions: Unique Users
- Tile 3:
Code Suggestions: Acceptance Rate %
- Tile 1:
- Next iterations:
- Adding
change % badge
. - Adding sparklines
- Tile 4:
Duo Chat: Unique Users
- Adding
Preview |
---|
|
Tile UI copy
-
GitLab Duo Pro seats: Assigned and used
-
ℹ ️ 50 out of 100 GitLab Duo assigned seats used at least one AI feature as of today. - See docs
-
-
Code Suggestions: Unique users
-
ℹ ️ 23 out of 100 GitLab Duo users used Code Suggestions in the last 30 days. - See docs
-
-
Code Suggestions: Acceptance Rate
-
ℹ ️ 16,245 out of 23,890 code suggestions were accepted in the last 30 days. - See docs
-
-
Duo Chat: Unique users
-
ℹ ️ 50 out of 100 GitLab Duo users interacted with Duo Chat in the last 30 days. - See docs
-
Open questions
-
Which time aggregation should be displayed in the tiles? last_month? month-to-date? -
~~Can we reuse groupproduct analytics single statas the Visualization for these tiles?~~
Data sources for the data
- Tile 1:
GitLab Duo seats: Assigned and used
- subscription_user_add_on_purchase_assignments - Tile 2:
Code Suggestions: Unique Users
- #443696 (closed) - Tile 3:
Code Suggestions: Acceptance Rate
- tbd - Tile 4:
Duo Chat: Unique users
(AI Impact: collect Duo chat usage data (#459967 - closed) • Pavel Shutsin • 17.2)
Edited by Haim Snir