arcbench-runtime

ARC-Bench agent runtime SDK. Handles event reporting, git integration, and traceability for custom agent adapters on ARC-Bench.

Install

pip install arcbench-runtime

Usage

from arcbench_agent_runtime import AgentRuntime

runtime = AgentRuntime.from_env(project_dir="/workspace/template")
runtime.events.mark_run_started("agent started")

# ... drive your agent ...

runtime.events.mark_implementation_done("REQ-1", "implemented feature X")
runtime.git.commit("feat: implement REQ-1")
runtime.events.mark_run_completed("done")

What this does

ARC-Bench expects agents to report progress through files in the .arc/ directory:

• runner-events.jsonl — run lifecycle and per-requirement-node status events
• traceability/*.json — requirement/scenario/test mapping
• git commits — the platform tracks changes via commit history

This library handles all of that. Adapter code only needs to call AgentRuntime methods at the right points.

Context

This library was originally bundled inside octos-org/arc-adapter. It is agent-neutral — any ARC-Bench adapter can use it, regardless of which agent it drives.