Custom Models Terms
Purpose
There are several terms being used in the context of Custom Models that are overlapping or may have different meanings in different contexts. This issue is a place to discuss what the GitLab terms should be, and the final table of definition will be added to GitLab documentation.
Feedback and suggestions welcome!
Terms
Term | Definition |
---|---|
Model | A Large Language Model (LLM). For GitLab Duo features, GitLab is currently working with Frozen models hosted at Google and Anthropic |
GitLab Managed Model | A LLM that is managed by GitLab. Currently all GitLab Managed Models are hosted externally and accessed via the AI Gateway. GitLab-owned API keys are used to access the models. |
Frozen Model | A LLM which cannot be Fine-Tuned (also Frozen LLM) |
Local Model | A LLM running on a user's workstation. More info |
Self-Hosted Model | A LLM hosted externally to GitLab by an organisation. |
Open Source Model | Models that are published with their source code and weights and are available for modifications and distribution. Examples: Llama / Llama 2, BLOOM, Falcon |
BYOM | Bring Your Own Model: bring a third-party model to be connected to one or more GitLab Duo features. Could be an off-the-shelf Open Source Model, a Fine-Tuned or a Closed Source Model. |
Closed Source Model | A private model fine-tuned or built from scratch by an organisation |
Air-Gapped Model | The GitLab server has no internet connectivity and is within the org. Model is connected to an air-gapped GitLab instance and is internal to an organisations intranet only. |
Fine Tuning | Open and update the layer weights in an existing model |
Adapters | A variation on Fine Tuning. Instead of opening the model and adjusting the layer weights, new layers trained are added onto the model or in a standalone model. |
RAG | Retrieval Augmented Generation. Provide contextual data to a Frozen LLM as part of a query to personalise results |
Custom Model | Any of Self-Hosted Model, BYOM, Closed Source Model, Fine-Tuned Model, RAG-enhanced Model, Adapter-based Model (above) |
Offline Model | Offline: No internet or intranet connection (e.g. you are on a plane) |
Some discussions using terms in context can be found in these videos:
Edited by Sean Carroll