[Feedback] Self-Hosted GitLab Duo Chat and Code Suggestions
Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.
GitLab 17.9 released with GitLab Duo Self-Hosted available in GA
This issue is to provide feedback on self-hosted GitLab Duo Chat and Code Suggestions. This feature enables self-managed customers to leverage Gitlab Duo features on-prem, or form within a supported private cloud environment.
The following GitLab-supported large language models (LLMs) are generally available.
- Fully compatible: The model can likely handle the feature without any loss of quality.
- Largely compatible: The model supports the feature, but there might be compromises or limitations.
- Not compatible: The model is unsuitable for the feature, likely resulting in significant quality loss or performance issues.
| Model Family | Model | Supported Platforms | Code completion | Code generation | GitLab Duo Chat |
|---|---|---|---|---|---|
| Mistral Codestral | Codestral 22B v0.1 | vLLM |
|
|
N/A |
| Mistral | Mistral 7B-it v0.3 | vLLM |
|
|
|
| Mistral | Mixtral 8x7B-it v0.1 | vLLM, AWS Bedrock |
|
|
|
| Mistral | Mixtral 8x22B-it v0.1 | vLLM |
|
|
|
| Claude 3 | Claude 3.5 Sonnet | AWS Bedrock |
|
|
|
| GPT | GPT-4 Turbo | Azure OpenAI |
|
|
|
| GPT | GPT-4o | Azure OpenAI |
|
|
|
| GPT | GPT-4o-mini | Azure OpenAI |
|
|
|
Asks
Please leave feedback about this feature. We're interested in learning what concerns you have or the impacts you see. The below are some suggested areas for feedback, but any feedback at all is appreciated.
- What models and model platform are you using to support self-hosted models?
- What models or model platforms would you love to see added?
- How was the process for setting up self-hosted models on your environment?
- What is working and not working for your organization?
Edited by 🤖 GitLab Bot 🤖