Projects with this topic
Sort by:
-
Terminal dashboard for LLM spend: feed it a log of your model calls and see cost per request, cost per model, budget used and a projected monthly bill, priced from a built-in table of 83 models. Runs locally, no account.
Updated -
GitLab CI/CD components for LLM apps: fail the pipeline on likely hallucinations, prompts over their token budget, padded prompts, an LLM bill heading over budget, or slow and flaky models. Tested on every push.
Updated -
Single-header C++17: token counts and dollar cost estimates for OpenAI and Anthropic models before you send, with budget checks. Part of llm-cpp.
Updated -