GPT OSS for DAP
Evaluate OSS Models with the following two evaluations:
- SWE-bench
- Issue-to-MR evaluation flow
Models
License
- Apache 2.0 license
Supported platforms
- vLLM
- Fireworks
- Azure OpenAI
Definition of Done
- GPT oss 120b has been added to Evaluation Runner for use by GitLab developers for Agentic features
- GPT oss 120b has been evaluated for all available Duo features, to include DAP use cases, as enabled in Agentic Feature Evaluation Platform (gitlab-org/modelops/ai-model-validation-and-research/ai-evaluation&54) • Unassigned
Edited by 🤖 GitLab Bot 🤖