Duo Chat on Mistral 7B-it
Duo Chat is currently based off of a Zero Shot Agent, which is a prompt that defines the available tools the underlying LLM may choose from, directs a ReAct Chain-of-Thought, parses the final LLM response, defines default error messages, and sets resource limits (10% of total limit).
Our initial iteration for Chat will use Mixtral 8x7B-it to serve as the zero shot agent, and this issue extends support to Mistral 7B-it as a zero-shot agent.
-
create prompt for Mixtral 7B-it to act as a zero shot agent
here
Results: Please Review themEdited by Mohamed Hamda