B

benchmark

Zambo: the cross-AI execution layer. 136 native MCP tools over one endpoint, with a verifiable execution receipt for every call (AER-1 open draft). Free: generous free tier, no account. Day Pass $0.99 USDC on Base for 24h; Zambo Pass $29/month ($19/month for verified $ZAMBO holders). https://zambo.dev

Collection of Verification Tasks

Open dataset: bitHuman avatar render speed (× real time) by device, from docs.bithuman.ai/performance. Code Apache-2.0, data CC BY 4.0.

Droid Tune-Up — an unofficial open-source evaluation harness for Factory Droid. Drives droid exec headless, hides tests and the solution from the agent, and grades only the committed worktree with deterministic behavioral tests. Not affiliated with Factory.

CPU/System/Algorithm benchmarking framework

Command-line benchmark for LLM APIs: send the same prompts to OpenAI and Anthropic models concurrently and compare p50/p99 latency, tokens per second, cost per request and success rate. Rust.

Raw benchmark results and statistical analysis.

GitLab CI/CD components for LLM apps: fail the pipeline on likely hallucinations, prompts over their token budget, padded prompts, an LLM bill heading over budget, or slow and flaky models. Tested on every push.

Объектив · Исследование распознавания техники: эталон, прогоны пайплайнов, метрики, лидерборд, выводы

Evaluation harness for measuring how well AI models perform on SysML v2 modeling tasks.

Model Verification Layer is a modular system for evaluating, comparing, and validating the behavior of large language models using structured benchmarks, logic consistency checks, cross-model consensus analysis, and policy-aware constraints. It provides a transparent framework for understanding how different AI models perform under identical conditions, enabling more reliable model selection, safer deployment, and user-adaptive decision making. https://roxanneardary.com/model-verification-layer/

Public evidence datasets, claim atlases, and reproducible benchmarks for ClaimBound.

Header-only C++17 least-squares solver by Householder QR

An Extensible Benchmark Framework for Real-Time Applications

Documentation: https://rt-bench.gitlab.io/rt-bench/

The QR benchmark set: QR codes under damage, hand-shake and rotation, each with its expected text; a viewer that runs any scanner through it on a monitor and a scorer. Verdetto's own, CC0.

Every symbology Zint encodes, rendered clean and put through graded damage: 100 formats, 10,840 images, each with the exact text its symbol carries. A ceiling test for a barcode reader. Images CC0, scripts MIT.

Helm Charts for various benchmarks

The repository contains the code used in an extensive benchmark of co-occurence based inference methods to recover the interaction structure of microbial communities from metabarcoding data (16S rDNA-seq data)

Agent-shape testing harness that measures how an LLM-driven agent uses a tool's CLI, scored by an LLM judge.

Empirical validation of C4 geometric defense against 16 Agents of Chaos. 550 adversarial prompts. 4 defense systems. 96.7% block rate. LLM validation on GPT-4o-mini + Mistral 7B. MIT.