-
💬 @Huge1filter_haystack_for_distractors(self, haystack: str, query_keyword: str) -> could use sentence embeddings and cosine similarity for filtering.
evaluate_model_response(self, model_response: str, correct_answer: str, uses_cot: bool) -> could be based on exact match, regex, or a separate QA model for answer extraction.
Please register or sign in to comment