RCA prompt iteration to improve responses and reduce verbosity
Problem
We spot checked RCA with human judges to see how it is performing currently.
https://docs.google.com/spreadsheets/d/1z4gHUnOs-v2PN5CQzwNBZ996dGY-JEfi8mhwkBigmic/edit?gid=0#gid=0
We were asked to put some of the poorly performing or very unhelpful responses through langsmith.
This issue is to capture that work.
Current Proposal
Feature flag the prompt iteration and then run it through CEF by enabling the new prompt just for the CEF users.
Edited by Allison Browne (PTO 12/19-1/2)