llm-cpp

Project information

Single-header C++17 libraries for LLM features: OpenAI and Anthropic streaming, retries, caching, cost estimates, RAG, structured JSON output and tool-calling agents. Copy one .hpp, no SDK, no package manager.

cpp cpp17 header-only single-header llm llm-cpp openai anthropic RAG

23 Commits
1 Branch
2 Tags
1 Release

README
MIT License
CONTRIBUTING

Created on

September 30, 2026

Loading