AI Impact: collect Duo chat usage data
Problem
Engineering leadership (Director/VP/CTO) need to demonstrate the ROI Monthly Code Suggestions Usage rate.
Also, customers need the ability to know how many chat queries are made and how many were useful.
Related to the AI Impact epic problem-to-solve
Proposal
- Adding a new metric to the formula for the AI Impact analytics -
Duo Chat usage. Similar to [VSD] - Adding a new metric - "AI (Code Suggest... (#443696 - closed) • Pavel Shutsin • 16.11 - The formula for the new metric - (
Monthly unique users of Duo Chat/Monthly unique contributors) =Duo Chat usage. - Collect the "Monthly unique users of Duo Chat" via request_duo_chat_response event.
Technical details
- Add new model
Ai::ChatUsageand new event to AiTracking module.
Related information
For production we can't use Snowflake and service ping.
Edited by Pavel Shutsin