Skip to content
  • filter_haystack_for_distractors(self, haystack: str, query_keyword: str) -> could use sentence embeddings and cosine similarity for filtering.

    evaluate_model_response(self, model_response: str, correct_answer: str, uses_cot: bool) -> could be based on exact match, regex, or a separate QA model for answer extraction.

0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment