Accelerate Code Suggestions (#9814) · Epics · Epics · GitLab.org

Accelerate Code Suggestions

_This page may contain information related to upcoming products, features and functionality. It is important to note that the information presented is for informational purposes only, so please do not rely on the information for purchasing or planning purposes. Just like with all projects, the items mentioned on the page are subject to change or delay, and the development, release, and timing of any products, features, or functionality remain at the sole discretion of GitLab Inc._ --- **Below is a list of activities to support the acceleration of Code Suggestions to a Generally Available offering. We are actively working on every item below. We will keep the details table at the bottom of this epic updated with the various people/teams involved and their current statuses** # Resources - Code Suggestions Direction page: https://about.gitlab.com/direction/modelops/ai_assisted/code_suggestions/ - Code Suggestions Documentation: https://docs.gitlab.com/ee/user/project/repository/code_suggestions.html - Feature Demo: https://youtu.be/ILJeqWoVswM?t=17 - ~"group::ai assisted" team: https://about.gitlab.com/handbook/product/categories/#ai-assisted-group # Increase Usage (:chart_with_upwards_trend: CMAU) ### Additional IDE Support and improve UX for VSCode https://gitlab.com/groups/gitlab-org/-/epics/10542 Code Suggestions today supports VS Code via an extension that authenticates with GitLab.com via personal access token. - Extend support for Code Suggestions to more IDEs to increase usage of code suggestions. - JetBrains IntelliJ-based IDEs, Visual Studio support (different from VS code), ~~VIM support~~ - Bring Code Suggestions in their existing form to these Additional IDEs as quickly as possible. - Enhance the existing VS Code experience to reflect early UX feedback. We’d also like to simplify the authentication experience via OAuth to make it easier to auth with GitLab.com (and eventually GitLab Plus) as well ### GitLab Plus for SM (access to GitLab.com required) https://gitlab.com/groups/gitlab-org/-/epics/308 75% of our customer base is self-managed; few Code generation solutions in the market currently work in local-only environments. We’re actively accelerating plans to support self-managed customers who are willing to connect to GitLab.com to receive Code suggestions. Iteration 1: https://gitlab.com/groups/gitlab-org/-/epics/10528 ### :white_check_mark: Support more languages &10561 (closed) To drive increased usage of Code Suggestions, we want to continue adding languages and supporting more frameworks within existing supported languages on top of the current list of 6 high confidence languages currently support. ### :white_check_mark: Enable Free users &10560 In order to increase feedback and get more customers using Code Suggestions, we are extending support to Free customers for free while in beta. ### :white_check_mark: WebIDE support &10549 GitLab is heavily investing in remote development capabilities through the new WebIDE, VS Code in the cloud. We are working to enable Code Suggestions natively in that experience when it launches on May 22 with GitLab 16. # Improve Suggestions :heart_decoration: ### Support Anthropic and Google Codey API (:rocket:) https://gitlab.com/groups/gitlab-org/-/epics/10752 We would like to use the Anthropic and Google models possibly to achieve the best-in-class comparison for the quality of code suggestions if a customer doesn’t allow 3rd party AI Continue using GitLab’s private model until Google offers a private GCP instance. ### Higher quality suggestions https://gitlab.com/groups/gitlab-org/-/epics/10562 We want to increase the quality of suggestions to drive increased retention of Code Suggestions users. This will include work to expand to other use cases to make code suggestions more flexible, including natural language interface to code generation (i.e. code comments to suggestions) and other ideas. The goal is to continuously week by week increase the efficacy of suggestions. ### Quality comparison https://gitlab.com/groups/gitlab-org/-/epics/10563 To support more languages and higher accuracy, we need repeatable and scalable analysis of suggestion quality. This must be done at scale across our supported languages and with known outputs with spot human evaluation. We'll also investigate adding human feedback loops for end users. # Enterprise Readiness :classical_building: ### Scale & Stability https://gitlab.com/groups/gitlab-org/-/epics/10564 As we onboard more code suggestions users, we will increase the load on the inference API; we need to continue scaling that service and enabling more visibility into the performance, stability, and health of this service. ### Add-on available https://gitlab.com/groups/gitlab-org/-/epics/10336 During beta code, suggestions are offered as a free service. We will introduce pricing and packaging details and support through fulfillment for billing, contracting, and invoicing. - Details of Pricing and Packaging will be confidential until announced publicly. ### GA Readiness https://gitlab.com/groups/gitlab-org/-/epics/10565 With all the above improvements in flight, we also need to decide at what point we are confident in the quality of code suggestions to make it generally available and confidently support it based on the GA requirements. ### Post GA https://gitlab.com/groups/gitlab-org/-/epics/11059 ### Marketing Code Suggestions https://gitlab.com/groups/gitlab-org/-/epics/10567 Go to Market activities to support Code Suggestions Release. ### Customer Quotes https://gitlab.com/groups/gitlab-org/-/epics/10557 We'd like to have referencable customers. # Status Please see [Epic board](https://gitlab.com/groups/gitlab-org/-/epic_boards/44053?label_name%5B%5D=AI-Priority&label_name%5B%5D=Accelerate%20Code%20Suggestions)  \*This page may contain information related to upcoming products, features and functionality. It is important to note that the information presented is for informational purposes only, so please do not rely on the information for purchasing or planning purposes. Just like with all projects, the items mentioned on the page are subject to change or delay, and the development, release, and timing of any products, features, or functionality remain at the sole discretion of GitLab Inc.\*

epic