Research: OS Models for Conversational Handling
Background
When users engage with Duo Chat, a zero-shot agent is used to determine the routing of the user's input. The zero-shot agent directs the user's query as appropriate to one or many of a series of specialized prompts (aka tools).
- Zero Shot Agent: this prompt defines for the LLM the tools it may choose from (defined below), directs a ReAct Chain-of-Thought, parses the final LLM response, defines default error messages, sets resource limits (10% of total limit).
Proposal
Using the procedure outlined in Document how to identify Open Source Models for... (#461070 - closed), Identify one or many OS models with strong conversational and reasoning skills that can serve as a zero-shot prompt.
Edited by Susie Bitters