https://pypi.org/project/benchspec/ Recent updates to the Python Package Index for benchspec en https://pypi.org/project/benchspec/0.0.1/ benchspec is a framework for evaluating AI agents with repeatable, isolated benchmarks. Write evals as Markdown, run each eval across named benchmark arms, and compare how agent behavior changes by harness, model, effort, and environment. swift@majorleaguehacking.com Sat, 05 Sep 2026 01:49:14 GMT