[Feedback] Self-Hosted Code Suggestions
Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.
This issue is to provide feedback on the new self-hosted Code Suggestions. This feature enables self-managed customers to leverage Gitlab Duo features on-prem, or form within a supported private cloud environment.
Self-hosted Code Suggestions supports use of the following models on the following model platforms.
| Model | vLLM | AWS Bedrock |
|---|---|---|
| Mistral 7B | ||
| Mixtral 8x7B | ||
| Mixtral 8x22B | ||
| Codestral | ||
| Anthropic Claude 3.5 Sonnet |
Asks
Please leave feedback about this feature. We're interested in learning what concerns you have or the impacts you see. The below are some suggested areas for feedback, but any feedback at all is appreciated.
- What models and model platform are you using to support self-hosted models?
- What models or model platforms would you love to see added?
- How was the process for setting up self-hosted models on your environment?
- What is working and not working for your organization?
Edited by 🤖 GitLab Bot 🤖