llm-cache

Project information

Single-header C++17: LRU response cache with TTL and hit/miss stats, so identical prompts skip the API. Part of llm-cpp.

Created on

September 30, 2026

Loading