B

batch-processing

Single-header C++17: run a JSONL file of prompts through a thread pool with rate limiting and resumable checkpoints. Part of llm-cpp.