Performance Bottleneck: Repeated pydantic.create_model() calls in bind_tools() blocking asyncio loop
Read more at https://gitlab.com/gitlab-org/quality/quality-engineering/team-tasks/-/issues/3794#note_2838923664 .
This is a significant factor in throughput of Duo Workflow Service. What is it doing? Can it be optimized? Can we cache certain things related to schema construction/validation?
Edited by 🤖 GitLab Bot 🤖