12 projects
inferencebench-leaderboard
Static-site leaderboard renderer for signed InferenceBench envelopes
inferencebench-hf-publisher
Publish signed InferenceBench envelopes to the Hugging Face Hub as datasets
inferencebench-code
Code-generation plugin for InferenceBench Suite (HumanEval-style execution-based scoring).
inferencebench-embeddings
Embeddings retrieval plugin for InferenceBench Suite (deterministic ranking skeleton; real embedding-model invocation deferred)
inferencebench-mt
Machine-translation plugin for InferenceBench Suite (chrF/BLEU/exact-match on bundled fixtures)
inferencebench-quality
LLM quality plugin for InferenceBench Suite (deterministic fixture scoring; LLM-as-judge deferred)
inferencebench-vision
Vision-language understanding plugin for InferenceBench Suite (multimodal accuracy on bundled image+question fixtures)
inferencebench-llm
LLM inference plugin for InferenceBench Suite (vLLM in Phase 1; SGLang/TRT-LLM/llama.cpp/MLX in Phase 2+)
inferencebench-voice
Voice transcription plugin for InferenceBench Suite (deterministic fixture-driven WER/CER skeleton)
inferencebench
InferenceBench Suite CLI — vendor-neutral, signed-envelope AI benchmarks
inferencebench-harness
Core measurement engine for InferenceBench — drivers, telemetry, percentiles, fingerprinting
inferencebench-envelope
Canonical signed-envelope spec + Sigstore signer/verifier for InferenceBench
