### Self-Hosted Code Suggestions GA This epic tracks the tasks required to take Self-Hosted Code Suggestions GA. These issues can also be found on the [Code Suggestions GA](https://gitlab.com/groups/gitlab-org/-/boards/7744409?label_name%5B%5D=group%3A%3Acustom%20models&label_name%5B%5D=prototype%3A%3Ageneral_availability) board. The top level self-hosted Code Suggestions epic can be found [here](https://gitlab.com/groups/gitlab-org/-/epics/13730). This epic captures only the work for initial GA. **Supported models** * [Mistral 7B-it](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) * [Mixtral 8x7B-it](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) * [Mixtral 8x22B-it](https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1) * Anthropic Claude 3.5 Sonnet * GPT 4o * GPT 4o Turbo * GPT 4o-mini **Supported model platforms** * [AWS Bedrock](https://aws.amazon.com/bedrock/) (Mistral, Anthropic) * [vLLM](https://blog.vllm.ai/2023/06/20/vllm.html) (Mistral) * [Azure AI ](https://azure.microsoft.com/en-us/products/ai-services)(GPTs) <table> <tr> <td>Theme</td> <td>Epic/Issue</td> <td>Status</td> <td>Milestone</td> <td>Team/DRI</td> </tr> <tr> <td rowspan="2"> https://gitlab.com/groups/gitlab-org/-/epics/15488+s </td> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/493932+s </td> <td> :white_check_mark: </td> <td>17.6</td> <td>Custom Models</td> </tr> <tr> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/463917+s </td> <td> :white_check_mark: </td> <td>17.4</td> <td>Custom Models</td> </tr> <tr> <td rowspan="2"> https://gitlab.com/groups/gitlab-org/-/epics/15489+s </td> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/485605+s </td> <td> :white_check_mark: </td> <td>17.5</td> <td>Custom Models</td> </tr> <tr> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/495789+s </td> <td> :white_check_mark: </td> <td>17.6</td> <td>Custom Models</td> </tr> <tr> <td>AWS Bedrock</td> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/497190+s </td> <td> :white_check_mark: </td> <td>17.6</td> <td>Custom Models</td> </tr> <tr> <td rowspan="3">Licensing</td> <td> https://gitlab.com/groups/gitlab-org/-/epics/14666+ </td> <td> :white_check_mark: </td> <td>17.4</td> <td>Fullfilment</td> </tr> <tr> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/478038+ </td> <td> :white_check_mark: </td> <td>17.4</td> <td>Fullfilment</td> </tr> <tr> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/487377+ </td> <td> :white_check_mark: </td> <td>17.5</td> <td>Custom Models</td> </tr> <tr> <td rowspan="3"> https://gitlab.com/groups/gitlab-org/-/epics/15490+s </td> <td> https://gitlab.com/groups/gitlab-org/-/epics/13849+ </td> <td> :white_check_mark: </td> <td>17.4</td> <td> @timnoah </td> </tr> <tr> <td> https://gitlab.com/groups/gitlab-org/-/epics/15330+s </td> <td> :white_check_mark: </td> <td>17.5</td> <td> @timnoah </td> </tr> <tr> <td> https://gitlab.com/groups/gitlab-org/-/epics/15193+s </td> <td> :white_check_mark: </td> <td>17.5 / 17.6</td> <td>Custom Models</td> </tr> <tr> <td> https://gitlab.com/groups/gitlab-org/-/epics/14715+ </td> <td> https://gitlab.com/groups/gitlab-org/-/epics/14715+ </td> <td> :white_check_mark: </td> <td>17.4</td> <td>Custom Models</td> </tr> <tr> <td rowspan="3"> [Enable Customer-Hosted Logging](https://gitlab.com/groups/gitlab-org/-/epics/14718) </td> <td> [UX Design](https://gitlab.com/gitlab-org/gitlab/-/issues/467446) * [turn logging on/off](https://gitlab.com/gitlab-org/gitlab/-/issues/478808) </td> <td> :white_check_mark: </td> <td>17.5</td> <td> @timnoah </td> </tr> <tr> <td>FE issue to enable logging toggle</td> <td></td> <td>17.7</td> <td>Custom Models</td> </tr> <tr> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/477469+s </td> <td> :white_check_mark: </td> <td>17.5</td> <td>AI Framework</td> </tr> <tr> <td rowspan="2"> https://gitlab.com/groups/gitlab-org/-/epics/14190+ </td> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/482451+ </td> <td> :white_check_mark: </td> <td>17.4</td> <td>Custom Models</td> </tr> <tr> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/486527+ </td> <td> :octagonal_sign: </td> <td>17.5</td> <td>Won't do</td> </tr> <tr> <td>GTM confidence</td> <td> https://gitlab.com/groups/gitlab-org/-/epics/15195+ </td> <td> :white_check_mark: </td> <td> @susie.bee </td> <td></td> </tr> <tr> <td>Pricing</td> <td> based on conversation with @SeanHall, self-hosted features will be part of Enterprise and will not require a separate SKU </td> <td> :white_check_mark: </td> <td>N/A</td> <td>N/A</td> </tr> <tr> <td rowspan="2">Testing</td> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/493447+s </td> <td> :white_check_mark: </td> <td>17.6</td> <td>Custom Models</td> </tr> <tr> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/493450+s </td> <td> :white_check_mark: </td> <td>17.6</td> <td>Custom Models</td> </tr> <tr> <td rowspan="5"> https://gitlab.com/groups/gitlab-org/-/epics/15326+s </td> <td> [Adding Self-Hosted Model Deployment to feature list](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/165240#top) </td> <td> :white_check_mark: </td> <td>17.4</td> <td> @susie.bee </td> </tr> <tr> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/480741+s </td> <td> :white_check_mark: </td> <td>17.5</td> <td>Custom Models</td> </tr> <tr> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/490040+s </td> <td> :white_check_mark: </td> <td>17.6</td> <td>Custom Models</td> </tr> <tr> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/488513+s </td> <td> :white_check_mark: </td> <td>17.6</td> <td>Custom Models</td> </tr> <tr> <td> https://gitlab.com/gitlab-org/gitlab/-/issues/488450+s </td> <td> :white_check_mark: </td> <td>17.5</td> <td>Custom Models</td> </tr> </table> # References [Meeting Notes](https://docs.google.com/document/d/14q4oP5ECNWCRkxCojSJaJiH6DuMPxhZWu6d6IeFRfc8/edit?pli=1) This issue replaces https://gitlab.com/groups/gitlab-org/-/epics/14806+