Convert documentation tool for Claude 3
The documentation took uses TanukiBot code here (ugh that still needs a rename, we have an existing issue for renames here). That code finds the relevant embeddings and, using this prompt, sends the request to the AI Gateway.
The other tools all include AiDependent
, which makes an LLM request using this method and sends it through the AI Gateway.
The documentation tool, on the other hand, makes a request using the Anthropic client directly (rather than going through the AI Gateway), which uses Claude 2.1.
This tool was an oversight because of how it behaves differently than the other tools. Thanks for catching that, @tlinz !
It will be easier to convert the documentation tool once those requests go through the AI Gateway. That work is in flight now. Would it make sense to wait?