4 projects
inferencebench
InferenceBench Suite CLI — vendor-neutral, signed-envelope AI benchmarks
inferencebench-llm
LLM inference plugin for InferenceBench Suite (vLLM in Phase 1; SGLang/TRT-LLM/llama.cpp/MLX in Phase 2+)
inferencebench-harness
Core measurement engine for InferenceBench — drivers, telemetry, percentiles, fingerprinting
inferencebench-envelope
Canonical signed-envelope spec + Sigstore signer/verifier for InferenceBench