Documentation on what models are supported for which features for GL.com or dedicated

@fneill @susie.bee The documentation on supported models may need more clarifications.

https://docs.gitlab.com/administration/gitlab_duo_self_hosted/supported_models_and_hardware_requirements/

We have questions about which models are supported on what platforms and on what features.

For example, two of the questions that may be good to capture in the doc are:

Question 1: See Slack thread below

Hey Susie, do you know what are all models that are part of custom model selection GA?

Annie Ying  
Zeehan wants to know what models are supported for Model Selection

I know for different level (namespace, instance level and user-level) it's different. So I want to include Susie because I know I will not get the details right.

User-Level Models Selection for GL Agentic Chat (stretch goal, still some MRs to be in), it's a limited scope of Claude 3.5 Sonnet, Claude 3.7 Sonnet, and Claude 4 Sonnet (Epic) (edited) 

Instance-Level Model Selection Configuration for SM and Dedicated using GitLab.com AIG/WFS (Planned, still some MRs to be in): Model selection options will include GitLab AI Vendor model defaults for each feature/sub-feature, as well as Claude 3.5 Sonnet (Epic) (edited) 

Zeeshan  8:23 AM
Thanks Annie, I think the question came to me is for the GA which is mainly focused on the namespace level

sbitters  9:52 AM

It varies per feature.  This GA is implemented for classic Duo feature. The Claude series are all in there, but the actual total list of models will change per feature. You can see the supported models for each feature on its documentation page. For example - https://docs.gitlab.com/user/project/repository/code_suggestions/

COde Suggestions supports Codestral, in addition to the Claude models that are available for all features

most other features are just the Claude models, however

Zeeshan  10:03 AM
This is not helping me get the answer unfortunately

Annie Ying  

What do you need to do?

Is this a question from someone or for the demo video?

Zeeshan  

I need list of supported models for Selection process that we are GAing.. if its per feature then a list per feature that connects to models

This question is from @David Tuan

he is mainly looking into the custom models procurement and legality work. I think he worked on getting approvals for OpenAI models too

and He would want to know what models are going to be actually used when we are doing this Model Selection GA

I am fine getting the union of all models - irrespective of which feature they can be used from

Codestral and Claud code? is that all?

LLMs: Code completion: Fireworks Codestral (default), Vertex AI-hosted Codestral | Code generation: Claude Sonnet 4 |

Annie Ying  

Also, Claude models (Claude 3.5 Sonnet, Claude 3.7 Sonnet, and Claude 4 Sonnet) are available for all the features.

sbitters
@Zeeshan Claude Code is a separate thing.  We support the Anthropic Claude models that Annie mentioned + Codestral for Code Suggestions

We do need answers on OpenAI and Gemini as model providers in the near future, but those are not part of the Model Selection GA for this milestone (note that I am referring to GL AI Vendor models here, and not Self-Hosted models)

Zeeshan  
do you know which features are going to use GPT OSS models, GPT-5 ?

considering the fact that we are marking them done for 18.4, how users can use these after 18.5 release.

sbitters

These are only for self.hosted, and legacy Duo features. This doesn't include DAP, although users can configure them at compatible models using the general prompt

Question 2

Dan Eckhardt

Hi all! I have a question related to the recently released GitLab Duo Model Selection feature for GitLab.com and GitLab Dedicated. I'm wondering if someone could help me identify which models our GitLab.com and GitLab Dedicated customers can currently choose from and if it includes any OpenAI models? Asking because we need to identify relevant subservice providers as a part of our SOC 2 Type 2 external audits that are coming up.Also, this question is only for GitLab.com and GitLab Dedicated platforms. Self-Managed is not in scope for our SOC 2 reports. Thanks so much! (edited) 

Jessie Young  

I can paste screenshots of what is available right now but yes these should be publicly documented cc @Annie Ying

these are the options available.I didn't take a screenshot of every single dropdown but confirmed that there are no models available for other features that I didn't already capture in these screenshots