Blueprint for Self-Hosted Model Deployment
- Perform customer research to Inventory which GitLab deployments customers are using (.com, Dedicated, Self-Managed) and how they would like to leverage self-hosted models
- Determine architectures for enabling Enterprise users to leverage their self-hosted models for Duo functionality
- key assumption is that self-managed customer is already hosting or has capacity to host our curated list of OS models
- deployed AI Gateway to self-hosted
- configure AI Gateway to enable bring your own API
- determine what functionality will reside in the AI Gateway for each feature
- determine what security, compliance, and requirements to be considered based on the inventory we’ve built (see above bullet)
- determine what governance features can we offer in this environment
Edited by Susie Bitters