feat: Add configurable output formats with JSONL default

Andy Ryanrequested to merge
feature/configurable-results-formats into master

Overview

Adds configurable output formats for results files with JSONL as the new default format.

Changes

  • Added --results-format option to control main results file format
  • Support for JSONL (default), CSV, TSV, and Parquet formats
  • Updated report_generator.py to read all format types with auto-detection
  • Updated evaluate_existing_results.py for multi-format support
  • Fixed results file format from pipe-delimited to proper structured formats
  • Added comprehensive documentation with usage examples
  • Clarified report_generator.py dataset name parameter usage

Breaking Changes

⚠️ Default results format changed from pipe-delimited to JSONL

  • Migration: Use --results-format csv for CSV output
  • Backward compatible: Report generator auto-detects all formats

Documentation

  • Updated usage guide with all new options
  • Added results format changes guide
  • Clarified common mistakes with examples

Merge request reports