Duo Workflow - parallel tool calling with parallel requests to Duo Workflow Executor
Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.
It seems like langchain and Anthropic support parallel tool calling https://python.langchain.com/docs/how_to/tool_calling_parallel/ . If we're not using this today we should investigate if it speeds up some workflows. I notice that the LLM often wants to grep for files and then open several files in a row. If it could open all those files in parallel and if we paralleled the call to the Executor we might be able to speed up certain workflows a lot.
Technical details
gitlab-org/modelops/applied-ml/code-suggestions/ai-assist#1122
Edited by 🤖 GitLab Bot 🤖