llm-batch

Project information

Single-header C++17: run a JSONL file of prompts through a thread pool with rate limiting and resumable checkpoints. Part of llm-cpp.

Created on

September 30, 2026

Loading