Add developer documentation on how to use self-hosted models

Manoj M J [OOO]requested to merge
mmj-model-platformization-docs into master

What does this MR do and why?

For #537076 (closed) and #539403 (closed)

Review app link: https://docs.gitlab.com/upstream-review-mr-ee-191915/development/ai_features/developing_ai_features_for_duo_self_hosted/

This document adds a new guide for GitLab team members on developing AI features for Duo Self-Hosted. It explains how to access hosted models (currently limited to Claude models on AWS Bedrock), set up the development environment, and configure custom models in the UI. The guide details the process for requesting AWS access, generating access keys, configuring environment variables, and setting up models in the GitLab interface. It also provides instructions for moving existing features from SaaS/Self-Managed to Self-Hosted Duo, which involves making features configurable for self-hosted models and adding appropriate prompts. The document includes references to example merge requests and screenshots to help developers implement these changes.

NOTE: This MR does not involve steps to run evaluations. That will be added in a follow-up MR.

Navigation link added in gitlab-org/technical-writing/docs-gitlab-com!721 (merged)

References

Screenshots or screen recordings

Before After

How to set up and validate locally

MR acceptance checklist

Evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Manoj M J [OOO]

Merge request reports