Adding Mistral OS Mixtral Models to Prompt Library
Problems to solve
Add the Mistral OS models to the CEF and assess for all Prompt Library use cases - to include Duo Chat and Code Suggestion tasks.
For the first iteration, we added Mixtral 8X7B to the prompt library and assessed against Duo Chat tasks. We will also assess for Code Suggestion
Our second iteration will add Mixtral 8x22B to the CEF.
Proposal
- Decide which variants of Mistral model to deploy (2B, 7B-Instruct).
- Decide which variants of Mixtral model to deploy (8x7B, 8x7B-Instruct, 8x22B)
- Deploy Mistral model to available compute.
- Verify that it is supported by Vertex AI SDK (we use this SDK in Prompt Library).
Progress
References
- Technical papers
- Mistral 7B (http://arxiv.org/abs/2310.06825)
- Mixtral of Experts (http://arxiv.org/abs/2401.04088)
- Model card
Edited by Susie Bitters