Update AI Gateway Blueprint
All threads resolved!
All threads resolved!
Compare changes
- David O'Regan authored
@@ -558,7 +558,7 @@ For more details, refer to the [Initial Set of Unit Primitives](https://gitlab.c
@@ -558,7 +558,7 @@ For more details, refer to the [Initial Set of Unit Primitives](https://gitlab.c
Self-managed instances should have their own AI Gateway, with Runway likely being the deployment method. This means part of our work will be to ensure that the AI Gateway can be deployed in a self-managed environment. This work will go hand-in-hand with the work to support locally hosted models (local inference) in support of GitLab AI features.
Self-managed instances can either use centralized AI Gateway or have their own AI Gateway if they want to use self-deployed models, with Runway likely being the deployment method. This means part of our work will be to ensure that the AI Gateway can be deployed in a self-managed environment. This work will go hand-in-hand with the work to support locally hosted models (local inference) in support of GitLab AI features.