Estimate timeline to deliver "Users can ask documentation questions on SM Chat"
In the initial iteration of GitLab Chat (beta) for self-managed, we descoped the ability for users to ask questions about GitLab's documentation.
Long-term, this is a capability GitLab would like to support. We would like to understand the level of effort and estimated timelines to help decide whether this will ship as part of Chat's GA scope, or post-Chat-GA. groupcloud connector and groupai framework should collaborate to align on estimated technical timelines to enable Chat questions about documentation on self-managed.
Scope
- SM Users should be able to ask documentation questions related to their specific GitLab version (ie, 16.1 users should not receive instructions that only work on 17.0) via GitLab Chat.
- A general embeddings solution that also works for private / dynamic data is acceptable, but not required
- Technical solution should be extensible to cover future use cases where SM users can ask questions about private / dynamic data. (ie, issues, MRs, etc)
- Backwards compatibility is a nice-to-have, but not required. It is acceptable to say "SM versions need to upgrade to <versionX> in order to ask documentation questions".
Deliverables
- What is the work required to enable SM users to ask Chat questions about GitLab's documentation? It sounds like there are several solutions being explored.
- What other teams do we need to loop in? (ie, if embeddings are required, we should include Global Search).
- How long do we estimate this effort will take?
Results
Retrieve from Vertex AI Search | Retrieve from PgVector | Retrieve from Elasticsearch | |
---|---|---|---|
Estimated total milestone | 1 (1 engineering DRI) | 2-3 (2 engineering DRIs) | 3-? |
Required work | #438330 (comment 1780358230) | #438330 (comment 1780393655) | #438330 (comment 1780413012) |
Groups | AI Framework, Duo Chat | Database, AI Framework, Duo Chat | Global Search, AI Framework, Duo Chat |
Architecture | https://gitlab.com/gitlab-org/gitlab/-/blob/rag-for-duo-chat/doc/architecture/blueprints/gitlab_duo_rag/vertex_ai_search.md | https://gitlab.com/gitlab-org/gitlab/-/blob/rag-for-duo-chat/doc/architecture/blueprints/gitlab_duo_rag/postgresql.md | https://gitlab.com/gitlab-org/gitlab/-/blob/rag-for-duo-chat/doc/architecture/blueprints/gitlab_duo_rag/elasticsearch.md |
Edited by Shinya Maeda