Have the summarize_comments tool call the AI-Gateway instead of Anthropic.
Proposal
We want all our AI features to call the AI-Gateway directly instead of making the following Anthropic API directly. The following work would unblock us for calling Claude 3 for the summarize_comments
tool. Waiting to move the summarize_comments
tool isn't a major block given it's not a Duo Chat feature. We unintentionally grouped within the initial parent issue which should be more adeptly called migrating all Duo Chat features.
Feature Work
The simplest approach to moving the summarize_tools
to Claude 3 would be replacing the client's request from Anthropic to the AI-Gateway here. However, we don't want to do that because all request point to the v1/chat/agent
endpoint. Those are for Duo Chat and the summarize tool an experimental feature not used by Duo Chat.
The long-term approach would move the summarize_chat
call to the AI-Gateway. To do that, we need the following work of creating a proxy endpoint to be done beforehand. At that point, we should have endpoints that we could call that aren't grouped with Duo Chat endpoints in the AI-Gateway.