Trace Duo Chat process flow with Langsmith
What does this MR do and why?
This MR introduces a tracer for Duo Chat process flow. This is helpful for engineers to identify where exactly the chain failed.
We use Langsmith as the tracer. We've already been using it in evaluations like !146634 (comment 1802765711) and gitlab-org/modelops/ai-model-validation-and-research/ai-evaluation/ai-experiments#12 (comment 1802706938).
See the development doc for more information.
Related to Document how to evaluate prompt improvements an... (#444948 - closed)
MR acceptance checklist
Please evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.
Screenshots or screen recordings
See the development doc for more information.
How to set up and validate locally
See the development doc for more information.
Related to
Edited by Shinya Maeda