Document Self-Hosted Platform Tools and Processes
This issue is to capture work to document the processes and tool tradecraft for leveraging the Self-Hosted models platforms.
Documentation Activities:
-
Self-Hosted Feature Development
- How to add a new feature (configuration lists, compatible models)
- How to evaluate across Duo Self-Hosted models using Evaluation Runner
- How to use a provisioned model
- How to properly set variables to ensure that testing environment reflects customer environment - reference
-
Prompt Engineering Guidelines:
- How to write prompts for different model families
- Best practices for creating prompts that can be adapted to other models
- How to run evaluations on evaluation-runner for Self-Hosted models
Definition of Done
- GItLab developers have an SSOT for understanding Self-Hosted feature development, tools, and processes
Edited by Susie Bitters