Update Developer Documentation for Setting Up Self-hosted Models Environment Locally
Description
There is a gap in documentation for GitLab developers in external teams who are wishing to get started with GitLab Duo Self-Hosted features. While we have some dev docs in the Custom Models repo, these docs are not updated regularly and have plenty of gaps too.
While we do have customer-facing documentation that are regularly updated and are a source of truth, it does not cover nuances of working with the feature from a GitLab developer perspective E.g internal setup scripts, dev ENV variables, workarounds etc.
Potential gaps to cover:
- Active feature flags
- ENV variables and their nuances e.g when to use
CLOUD_CONNECTOR_SELF_SIGN_TOKENS=1and when not to? - Setup scripts e.g
GITLAB_SIMULATE_SAAS=0 bundle exec 'rake gitlab:duo:setup[duo_enterprise]for creating Enterprise environment - Guidance on getting access to AWS credentials for Bedrock models
- Guidance on getting access to staging-ref for testing
- Guidance on best models for local testing
Definition of done
-
Developer documentation for working with GitLab Duo Self-Hosted is up to date and useful for other teams when setting up their development environment
Edited by 🤖 GitLab Bot 🤖