Skip to content

AI Impact export API

Problem

AI Impact dashboard is currently only available if ClickHouse is configured. We currently don't have an OOTB solution for ClickHouse for Self Managed or Dedicated, and the AI Impact dashboard is therefore not available. We also don't have a self service option for customers to export this data themselves and make use of their own BI tools.

Proposal

Provide raw AI metrics via an export API. The data will be captured in postgres and the API will have data retention of 3 months. We can provided detailed documentation on how to use the export API and how we calculate the metrics in the AI Impact dashboard.

  1. Data sources: PostgreSQL
  2. Data pipeline:
    1. From the user IDE, the events arrive to GL analytics endpoint.
    2. Events are written to a memory buffer (Redis)
    3. Periodically, this buffer is flushed to PostgreSQL.
  3. Events list:
    • user_id
    • event (requested, accepted, rejected)
    • namespace_path (group/project pointer)
    • timestamp
    • unique_tracking_id
    • language
    • suggestion_size (LoC count)
  4. Pros:
    • Will be available for .com, SM and Dedicated.
    • No depend on CH.
    • We can open this to Duo Pro, and this can address the need of https://gitlab.com/gitlab-org/gitlab/-/issues/473013+. (Still need to validate)
    • Customers will be able to analyze usage themselves more easily.
  5. Cons:
    • Only raw data, customers required to aggregate the data on their own.
    • No UI, the data will be exported via API.
    • The AI Impact dashboard will not be available and customers can't understand the impact of AI on SDLC.
    • Only 3 months of data.
    • Application Limits - TBD.

Validation

Edited by Gabe Weaver