Skip to content

Write judge's response to the output table for more visibility

Hongtao Yang requested to merge write-judge-response into main

What does this merge request do and why?

This MR writes the judge's response to the output table for more visibility. This can help determine how many responses are incorrectly formatted, how many are empty (due to rate limits)

Ref: https://gitlab.com/gitlab-org/modelops/ai-model-validation-and-research/ai-evaluation/prompt-library/-/issues/429

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

Merge request checklist

  • I've ran the affected pipeline(s) to validate that nothing is broken.
  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Hongtao Yang

Merge request reports