Skip to main content

Millrace runtime rewrite baseline package

Project description

Millrace

PyPI Python 3.11+ License

Millrace signal mark

Other agents win sprints. Millrace wins marathons.

Raw agent harnesses - Codex, Claude Code, Gemini - are built for sprints. Give them a tight spec in a greenfield repo, let them rip, ship the result. They are very good at this.

Millrace starts where those runs end. When the work spans sessions, accumulates state, needs to survive a crash without losing context, or has to gate on real acceptance criteria rather than "the agent said it was done", that is the problem Millrace was built for.

Millrace is a governed runtime for long-running agent work. The harness still does the local stage work. Millrace owns the queue, the compiled plan, runtime state, recovery paths, and closure behavior around that work.

If you are an agent and your harness supports repo-local skills, for example Codex or Claude Code, install docs/skills/millrace-ops-agent-manual/SKILL.md to become a Millrace Operator before deciding whether work should enter Millrace. It teaches when to use Millrace, when not to, and how to run, monitor, and intervene safely.

Agent Install Examples

  • Codex: if your environment supports repo-local skills, load docs/skills/millrace-ops-agent-manual/ as the local skill package. The entry file is docs/skills/millrace-ops-agent-manual/SKILL.md.
  • Claude Code: use the same package path or entry file as the local project skill, then follow the autonomy handshake inside the skill before deciding whether work should enter Millrace.
  • Other harnesses: if the harness accepts a SKILL.md, point it at docs/skills/millrace-ops-agent-manual/SKILL.md; if it supports directory packages, prefer docs/skills/millrace-ops-agent-manual/.

Runtime Lifecycle

Need the full implementation-accurate flow instead of the landing-page view? See the standalone lifecycle chart.

flowchart TD
    A["Initialize workspace, then compile the plan"] --> B{"Deterministic tick loop"}
    B --> C["Process control inputs:<br/>mailbox commands, watcher intake, reconciliation"]
    C --> D{"Scheduler claim decision"}
    D -- planning incident or spec --> E["Planning loop:<br/>interpret specs and incidents,<br/>govern remediation, emit executable work"]
    D -- execution task --> F["Execution loop:<br/>build, verify, repair, recover, update"]
    D -- learning request --> K["Learning loop:<br/>analyze runtime evidence,<br/>propose skill improvements,<br/>curate accepted updates"]
    D -- nothing claimable --> G{"Completion behavior eligible?"}
    G -- yes --> H["Arbiter closure pass"]
    G -- no --> I["Idle until the next tick"]
    E --> J["Runtime applies results,<br/>persists state, and routes the next action"]
    F --> J
    K --> J
    H --> J
    J --> B
    I --> B

Millrace does not try to replace raw harness reasoning with a thicker prompt. It wraps long-horizon work in a real runtime:

  • workspace bootstrap is explicit: run millrace init before operator commands
  • runtime package updates are separate from workspace baseline refreshes: use the deployment package manager to update millrace-ai, then run millrace upgrade only when managed workspace assets should be refreshed
  • managed baseline refresh is explicit: run millrace upgrade to preview or apply packaged workspace asset updates
  • removed managed assets can be explicitly localized during upgrade when an operator wants the workspace copy to become local content
  • compile happens at startup and again only on explicit config reload
  • compile tracks input fingerprints so operators can see whether the persisted compiled plan is current or stale
  • daemon mode uses a compiled plane scheduler; default modes remain serial, while learning-enabled modes may run one Learning stage concurrently with one permitted foreground Planning or Execution stage
  • runtime-owned mutation remains single-writer and serialized even when stage runner workers execute concurrently
  • stage results are routed by the runtime, not by direct stage-to-stage handoffs
  • Arbiter activates only when the scheduler finds no lineage work left and closure behavior is actually ready
  • the shipped v1 usage-governance surface can pause and auto-resume between stages when configured token or subscription quota rules are reached
  • runtime startup and config reload refuse to keep running on a stale last-known-good plan when current compile inputs no longer match
  • opt-in usage governance can pause between stages from token or subscription quota rules without clearing operator-owned pauses and applies config-reload changes at the next runtime tick with status/monitor visibility

The shipped core already includes separate planning and execution loops, typed terminal results, compiler-governed completion behavior, and persisted run artifacts for post-run inspection. Learning-enabled modes also ship the Analyst, Professor, and Curator stages for evidence-backed skill improvement flows.

Early Proof

Millrace already has a useful public benchmark, and the right read is not "Millrace already beats raw Codex on absolute final quality." The useful read is that framework-driven orchestration is already competitive on hard, long-horizon work while being much more efficient.

On the first substantive public A/B benchmark, both systems were aimed at the same target: a parity-first modern Fabric port of Aura Cascade, a ten-year-old Minecraft mod. The stronger direct-agent condition, raw Codex on gpt-5.4 xhigh, finished at 95 / 100. Millrace, running as a staged daemon workflow on routed gpt-5.3-codex high / xhigh, finished at 94 / 100.

Metric Raw Codex Millrace
Final score 95 / 100 94 / 100
Total tokens 1,071,700,018 241,046,303
Wall-clock span 72h 23m 20.320s 28h 02m 36.972s
Active runtime 18h 04m 07.914s 12h 36m 15.515s

That means raw Codex used about 4.45x Millrace's total tokens, took about 2.58x the wall-clock span, and still used about 1.43x Millrace's active runtime.

That wall-clock gap is not pure model speed. The raw Codex run needed repeated manual continuation prompts whenever the operator was away from the keyboard, while Millrace kept progressing through a staged runtime. Even after accounting for that, the active-runtime gap still favors Millrace.

Read the full public evidence pack here:

How Millrace Fits With Raw Harnesses

Millrace is not a replacement for Codex, Claude Code, Aider, or similar raw agent harnesses. It is the runtime layer you put around them when the work is too long-running, stateful, or recovery-sensitive to trust to a single session.

Think of the split this way:

  • the raw harness reasons locally, edits code, and emits a stage result
  • Millrace decides which stage runs next and what contract that stage receives
  • Millrace persists queue state, runtime snapshots, artifacts, and recovery context after each handoff
  • the operator or ops agent decides when work enters the runtime and how the workspace is configured

If a direct Codex or Claude Code session is enough, use the direct session. Millrace matters when the work has crossed out of sprint territory.

When To Use Millrace

Use Millrace when:

  • the work will outlast a single agent session
  • you want explicit stage gates instead of "done enough" chat conclusions
  • recovery and resumability matter
  • you need durable state, queue artifacts, and run history under <workspace>/millrace-agents/
  • completion has to clear a real closure pass rather than informal optimism
  • an operator or ops agent is intentionally managing intake and runtime control

Do not use Millrace when:

  • the task is small, bounded, and cleanly handled in one direct session
  • the work is exploratory and governance would add more overhead than value
  • single-session throughput matters more than persistence and recovery
  • nobody is available to manage runtime configuration, intake, and workspace hygiene

60-Second Proof

Install:

pip install millrace-ai

Then point Millrace at a workspace:

export WORKSPACE=/absolute/path/to/your/workspace

millrace init --workspace "$WORKSPACE"
millrace compile validate --workspace "$WORKSPACE"
millrace run once --workspace "$WORKSPACE"
millrace status --workspace "$WORKSPACE"

That flow proves seven things quickly:

  • workspace bootstrap is explicit and creates the managed baseline under millrace-agents/
  • the selected mode compiles into one persisted compiled_plan.json before execution
  • compile output fingerprints the selected mode, runtime config, and packaged assets so compile show / status can report whether the plan is current or stale
  • that compiled plan carries node bindings, intake entries, recovery policies, closure-target activation, and post-stage routing
  • the shipped default_codex mode freezes closure behavior directly into that single compiled artifact
  • status and run inspection carry compiled-plan identity so operators can tie runtime activity back to the compiled plan that produced it
  • the runtime can execute a deterministic tick and report persisted status

For a visible long-running session, use millrace run daemon --monitor basic. The default daemon remains quiet unless that monitor is requested explicitly. The basic monitor is a human-facing stream: it compacts stage labels, shortens long run ids for display, omits unknown token filler, and leaves full ids and artifacts to millrace runs ... inspection commands. The basic monitor prints the first idle reason=no_work line immediately, then throttles repeated no_work idles to a 120-second heartbeat until runtime activity or a different idle reason appears. Use --monitor-log <path> when you want the same clean monitor stream written to a file without necessarily printing live monitor lines to stdout.

When the packaged workspace baseline changes, use millrace upgrade first to preview the managed-file classifications, then millrace upgrade --apply to apply safe baseline updates. This does not update the installed Python package; for runtime-code fixes, update millrace-ai through the environment's package manager first and verify with millrace --version or millrace version. If compile inputs drift and the persisted plan is stale, runtime startup and config reload refuse to keep running on the stale plan.

Stage config supports all execution, planning, and learning stage names. For Codex-backed stages, stages.<stage>.model_reasoning_effort sets the per-stage Codex reasoning effort that compile, runner invocation artifacts, and run inspection will surface.

Canonical shipped modes today:

  • default_codex
  • default_pi

Learning-enabled shipped modes:

  • learning_codex
  • learning_pi

The learning modes use the same execution and planning topology as the default modes, add learning.standard, and freeze learning trigger rules into the compiled plan.

Compatibility alias:

  • standard_plain -> default_codex

Read By Journey

Need the single dense system explainer first? Start with docs/millrace-technical-overview.md.

Start Here

  • docs/runtime/README.md
  • docs/skills/millrace-ops-agent-manual/SKILL.md if you are operating Millrace as an agent

Run It

  • docs/runtime/millrace-cli-reference.md
  • docs/runtime/millrace-runtime-architecture.md
  • docs/runtime/millrace-usage-governance.md

Understand It

  • docs/runtime/millrace-compiler-and-frozen-plans.md
  • docs/runtime/millrace-modes-and-loops.md
  • docs/runtime/millrace-arbiter-and-completion-behavior.md
  • docs/runtime/millrace-runner-architecture.md

Extend It

  • docs/runtime/millrace-entrypoint-mapping.md
  • docs/runtime/millrace-loop-authoring.md
  • docs/skills/millrace-loop-authoring/SKILL.md
  • docs/source-package-map.md

Status

Millrace ships as a maintained pre-1.0 runtime line. If you depend on exact behavior, pin to a patch version and verify against the current CLI and docs rather than assuming every newer build is identical.

License

See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

millrace_ai-0.16.0.tar.gz (244.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

millrace_ai-0.16.0-py3-none-any.whl (363.9 kB view details)

Uploaded Python 3

File details

Details for the file millrace_ai-0.16.0.tar.gz.

File metadata

  • Download URL: millrace_ai-0.16.0.tar.gz
  • Upload date:
  • Size: 244.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for millrace_ai-0.16.0.tar.gz
Algorithm Hash digest
SHA256 271e0730f7fa1b848004e4b9ccbaeab982843355a75581acc37f50cf4633ded4
MD5 f62b86c8cab78db06b344abfa663107c
BLAKE2b-256 b9da3ae48e0a367a005b7f72a0c94d5f9280e077c4ec6fdcec8e40a757c36e84

See more details on using hashes here.

Provenance

The following attestation bundles were made for millrace_ai-0.16.0.tar.gz:

Publisher: publish-to-pypi.yml on tim-osterhus/millrace

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file millrace_ai-0.16.0-py3-none-any.whl.

File metadata

  • Download URL: millrace_ai-0.16.0-py3-none-any.whl
  • Upload date:
  • Size: 363.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for millrace_ai-0.16.0-py3-none-any.whl
Algorithm Hash digest
SHA256 c16eff7330eb91944e61c60b7cb91570e75df30975c93c6c07772895ffd0358e
MD5 6b0a914339ad204ead2496dad469197a
BLAKE2b-256 0e5a81c890c49ddc98e1e2ebc1510470a80f26cabf9c619bbb4a1cb699a79b4a

See more details on using hashes here.

Provenance

The following attestation bundles were made for millrace_ai-0.16.0-py3-none-any.whl:

Publisher: publish-to-pypi.yml on tim-osterhus/millrace

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page