Skip to content
Snippets Groups Projects

Update AI Gateway Blueprint

Merged David O'Regan requested to merge ai_gateway_blueprint_update into master
All threads resolved!
1 file
+ 1
1
Compare changes
  • Side-by-side
  • Inline
@@ -558,7 +558,7 @@ For more details, refer to the [Initial Set of Unit Primitives](https://gitlab.c
@@ -558,7 +558,7 @@ For more details, refer to the [Initial Set of Unit Primitives](https://gitlab.c
### Self Managed AI Gateway
### Self Managed AI Gateway
Self-managed instances should have their own AI Gateway, with Runway likely being the deployment method. This means part of our work will be to ensure that the AI Gateway can be deployed in a self-managed environment. This work will go hand-in-hand with the work to support locally hosted models (local inference) in support of GitLab AI features.
Self-managed instances can either use centralized AI Gateway or have their own AI Gateway if they want to use self-deployed models, with Runway likely being the deployment method. This means part of our work will be to ensure that the AI Gateway can be deployed in a self-managed environment. This work will go hand-in-hand with the work to support locally hosted models (local inference) in support of GitLab AI features.
- [Self Managed AI Gateway](https://gitlab.com/groups/gitlab-org/-/epics/13162)
- [Self Managed AI Gateway](https://gitlab.com/groups/gitlab-org/-/epics/13162)
Loading