Docs: List models per feature for GL.com and SM on the GitLab AI gateway

  • Start this issue's title with Docs: or Docs feedback:.

Problem to solve

The documentation doesn't yet include a list of available models for each feature. LLMs are documented in the availability details for each feature, and displayed in the dropdown in the UI, but there is no central location for users to view all models for all features.

Further details

Slack conversation related to this issue

Hey Susie, do you know what are all models that are part of custom model selection GA?

Annie Ying  
Zeehan wants to know what models are supported for Model Selection

I know for different level (namespace, instance level and user-level) it's different. So I want to include Susie because I know I will not get the details right.

User-Level Models Selection for GL Agentic Chat (stretch goal, still some MRs to be in), it's a limited scope of Claude 3.5 Sonnet, Claude 3.7 Sonnet, and Claude 4 Sonnet (Epic) (edited) 

Instance-Level Model Selection Configuration for SM and Dedicated using GitLab.com AIG/WFS (Planned, still some MRs to be in): Model selection options will include GitLab AI Vendor model defaults for each feature/sub-feature, as well as Claude 3.5 Sonnet (Epic) (edited) 

Zeeshan  8:23 AM
Thanks Annie, I think the question came to me is for the GA which is mainly focused on the namespace level

sbitters:palm_tree:  9:52 AM

It varies per feature.  This GA is implemented for classic Duo feature. The Claude series are all in there, but the actual total list of models will change per feature. You can see the supported models for each feature on its documentation page. For example - https://docs.gitlab.com/user/project/repository/code_suggestions/

COde Suggestions supports Codestral, in addition to the Claude models that are available for all features

most other features are just the Claude models, however

Zeeshan  10:03 AM
This is not helping me get the answer unfortunately

Annie Ying  

What do you need to do?

Is this a question from someone or for the demo video?

Zeeshan  

I need list of supported models for Selection process that we are GAing.. if its per feature then a list per feature that connects to models

This question is from @David Tuan

he is mainly looking into the custom models procurement and legality work. I think he worked on getting approvals for OpenAI models too

and He would want to know what models are going to be actually used when we are doing this Model Selection GA

I am fine getting the union of all models - irrespective of which feature they can be used from

Codestral and Claud code? is that all?

LLMs: Code completion: Fireworks Codestral (default), Vertex AI-hosted Codestral | Code generation: Claude Sonnet 4 |

Annie Ying  

Also, Claude models (Claude 3.5 Sonnet, Claude 3.7 Sonnet, and Claude 4 Sonnet) are available for all the features.

sbitters
@Zeeshan Claude Code is a separate thing.  We support the Anthropic Claude models that Annie mentioned + Codestral for Code Suggestions

We do need answers on OpenAI and Gemini as model providers in the near future, but those are not part of the Model Selection GA for this milestone (note that I am referring to GL AI Vendor models here, and not Self-Hosted models)

Zeeshan  
do you know which features are going to use GPT OSS models, GPT-5 ?

considering the fact that we are marking them done for 18.4, how users can use these after 18.5 release.

sbitters

These are only for self.hosted, and legacy Duo features. This doesn't include DAP, although users can configure them at compatible models using the general prompt

Question 2

Dan Eckhardt

Hi all! I have a question related to the recently released GitLab Duo Model Selection feature for GitLab.com and GitLab Dedicated. I'm wondering if someone could help me identify which models our GitLab.com and GitLab Dedicated customers can currently choose from and if it includes any OpenAI models? Asking because we need to identify relevant subservice providers as a part of our SOC 2 Type 2 external audits that are coming up.Also, this question is only for GitLab.com and GitLab Dedicated platforms. Self-Managed is not in scope for our SOC 2 reports. Thanks so much! (edited) 

Jessie Young  

I can paste screenshots of what is available right now but yes these should be publicly documented cc @Annie Ying

these are the options available.I didn't take a screenshot of every single dropdown but confirmed that there are no models available for other features that I didn't already capture in these screenshots

Screenshot_2025-09-19_at_9.32.16_AM

Screenshot_2025-09-19_at_9.32.23_AM

Screenshot_2025-09-19_at_9.32.44_AM

Screenshot_2025-09-19_at_9.33.06_AM

Screenshot_2025-09-19_at_9.33.20_AM

Screenshot_2025-09-19_at_9.33.27_AM

Screenshot_2025-09-19_at_9.33.31_AM

Screenshot_2025-09-19_at_9.33.36_AM

Proposal

  1. Add tables that list available models per feature for:

    • GitLab.com in the Model selection section
    • SM in Supported models and hardware page.
      • We already have other lists of supported and compatible models so we need to ensure that its clear what this list is for.
    • Automation: To reduce maintenance overhead and to ensure accuracy with the code base, if possible, this could be automated in the docs. The YAML with the list of models is located on AIGW so it isn't currently possible to automate the documentation. Automation might be possible when #572469 has been completed (moves model description to the UI).

  2. These lists should replace the LLMs in the availability details as the SSOT about LLMs available per feature. This has the added benefit of reducing the amount of content in the availability details, which already lists a considerable amount of information and has started to become bloated with content.

Who can address the issue

  • TW for custom models with assistance from engineering to setup automation.

Other links/references

Edited by Fiona Neill