Skip to content

Performance Bottleneck: Repeated pydantic.create_model() calls in bind_tools() blocking asyncio loop

Read more at https://gitlab.com/gitlab-org/quality/quality-engineering/team-tasks/-/issues/3794#note_2838923664 .

This is a significant factor in throughput of Duo Workflow Service. What is it doing? Can it be optimized? Can we cache certain things related to schema construction/validation?

Edited by 🤖 GitLab Bot 🤖