[Release Note] Self-Hosted Duo Chat Beta

Release Notes

You can now host your own supported large language models (LLMs) and configure them to enable self-hosted GitLab Duo Chat. This feature is now in beta and available with an Ultimate and Duo Enterprise subscription on self-managed GitLab environments.

With self-hosted models, you can use models hosted either on-premise or in a private cloud to enable GitLab Duo Chat or Code Suggestions (previously beta'd in 17.5). We currently support open-source Mistral models via vLLM or AWS Bedrock, Claude 3.5 Sonnet on AWS Bedrock, and OpenAI models on AzureOpenAI. By enabling self-hosted models, you can leverage the power of generative AI while maintaining complete data sovereignty and privacy.

Documentation: https://docs.gitlab.com/ee/administration/self_hosted_models/

Please leave feedback in the feedback issue.

add label: release-post item top