Skip to main content

Millrace runtime rewrite baseline package

Project description

Millrace

PyPI Python 3.11+ License

Millrace signal mark

Other agents win sprints. Millrace wins marathons.

Raw agent harnesses - Codex, Claude Code, Gemini - are built for sprints. Give them a tight spec in a greenfield repo, let them rip, ship the result. They are very good at this.

Millrace starts where those runs end. When the work spans sessions, accumulates state, needs to survive a crash without losing context, or has to gate on real acceptance criteria rather than "the agent said it was done", that is the problem Millrace was built for.

Millrace is a governed runtime for long-running agent work. The harness still does the local stage work. Millrace owns the queue, the compiled plan, runtime state, recovery paths, and closure behavior around that work.

If you are an agent and your harness supports repo-local skills, for example Codex or Claude Code, install docs/skills/millrace-ops-agent-manual/SKILL.md to become a Millrace Operator before deciding whether work should enter Millrace. It teaches when to use Millrace, when not to, and how to run, monitor, and intervene safely.

Agent Install Examples

  • Codex: if your environment supports repo-local skills, load docs/skills/millrace-ops-agent-manual/ as the local skill package. The entry file is docs/skills/millrace-ops-agent-manual/SKILL.md.
  • Claude Code: use the same package path or entry file as the local project skill, then follow the autonomy handshake inside the skill before deciding whether work should enter Millrace.
  • Other harnesses: if the harness accepts a SKILL.md, point it at docs/skills/millrace-ops-agent-manual/SKILL.md; if it supports directory packages, prefer docs/skills/millrace-ops-agent-manual/.

Runtime Lifecycle

Need the full implementation-accurate flow instead of the landing-page view? See the standalone lifecycle chart.

flowchart TD
    A["Initialize workspace, then compile the plan"] --> B{"Deterministic tick loop"}
    B --> C["Process control inputs:<br/>mailbox commands, watcher intake, reconciliation"]
    C --> D{"Scheduler claim decision"}
    D -- planning incident or spec --> E["Planning loop:<br/>interpret specs and incidents,<br/>govern remediation, emit executable work"]
    D -- execution task --> F["Execution loop:<br/>build, verify, repair, recover, update"]
    D -- learning request --> K["Learning loop:<br/>analyze runtime evidence,<br/>propose skill improvements,<br/>curate accepted updates"]
    D -- nothing claimable --> G{"Completion behavior eligible?"}
    G -- yes --> H["Arbiter closure pass"]
    G -- no --> I["Idle until the next tick"]
    E --> J["Runtime applies results,<br/>persists state, and routes the next action"]
    F --> J
    K --> J
    H --> J
    J --> B
    I --> B

Millrace does not try to replace raw harness reasoning with a thicker prompt. It wraps long-horizon work in a real runtime:

  • workspace bootstrap is explicit: run millrace init before operator commands
  • runtime package updates are separate from workspace baseline refreshes: use the deployment package manager to update millrace-ai, then run millrace upgrade only when managed workspace assets should be refreshed
  • managed baseline refresh is explicit: run millrace upgrade to preview or apply packaged workspace asset updates
  • removed managed assets can be explicitly localized during upgrade when an operator wants the workspace copy to become local content
  • compile happens at startup and again only on explicit config reload
  • compile tracks input fingerprints so operators can see whether the persisted compiled plan is current or stale
  • daemon mode uses a compiled plane scheduler; default modes remain serial, while learning-enabled modes may run one Learning stage concurrently with one permitted foreground Planning or Execution stage
  • runtime-owned mutation remains single-writer and serialized even when stage runner workers execute concurrently
  • stage results are routed by the runtime, not by direct stage-to-stage handoffs
  • runtime-generated planning handoff incidents preserve source work-item lineage so closure-scoped remediation stays claimable while unrelated root specs remain backpressured
  • Arbiter activates only when the scheduler finds no lineage work left and closure behavior is actually ready
  • the shipped v1 usage-governance surface can pause and auto-resume between stages when configured token or subscription quota rules are reached
  • runtime startup and config reload refuse to keep running on a stale last-known-good plan when current compile inputs no longer match
  • opt-in usage governance can pause between stages from token or subscription quota rules without clearing operator-owned pauses and applies config-reload changes at the next runtime tick with status/monitor visibility

The shipped core already includes separate planning and execution loops, typed terminal results, compiler-governed completion behavior, and persisted run artifacts for post-run inspection. Learning-enabled modes also ship the Analyst, Professor, and Curator stages for evidence-backed skill improvement flows.

Early Proof

Millrace's strongest early proof point is self-referential: Python millrace-ai built the first released Rust parity implementation of Millrace.

The campaign used Python millrace-ai v0.16.1 in learning_codex mode to drive the Rust millrace-ai v0.1.0 implementation from seeded parity ideas through planning, execution, QA, Arbiter closure, remediation, and release-ready workspace state. After the operator started the daemon, there were no pause/resume cycles, continuation prompts, or external code interventions. The run proceeded to completion with zero outside assistance. The only external post-run action was publication: Millrace's ops agent published the completed result to GitHub and as a Rust crate without touching the code Millrace had produced.

Headline evidence from the autonomous build campaign:

Metric Value
Seeded parity slices 8
Completed specs 11
Completed tasks 57
Recorded runs 99
Recorded stage results 261
Resolved incidents/remediations 5
Wall-clock campaign span 28h 9m 49.5s
Input plus output tokens 730,406,757
Cached-input share 95.47%
Release tag v0.1.0
Release commit 4c82685

The release moved the Rust crate from an initial claimed package to a parity runtime across 193 changed files and 87,992 insertions. The finished crate also passed a post-publish real daemon smoke: an installed millrace-ai v0.1.0 crate completed a real Codex-backed builder -> checker -> updater run in 6m 32.9s and produced the expected filesystem output.

The caveat is important and narrow: this proves that Python Millrace could autonomously build the Rust parity runtime. It does not claim that the Rust crate independently self-hosted the whole port campaign.

Read the full public evidence pack here:

How Millrace Fits With Raw Harnesses

Millrace is not a replacement for Codex, Claude Code, Aider, or similar raw agent harnesses. It is the runtime layer you put around them when the work is too long-running, stateful, or recovery-sensitive to trust to a single session.

Think of the split this way:

  • the raw harness reasons locally, edits code, and emits a stage result
  • Millrace decides which stage runs next and what contract that stage receives
  • Millrace persists queue state, runtime snapshots, artifacts, and recovery context after each handoff
  • the operator or ops agent decides when work enters the runtime and how the workspace is configured

If a direct Codex or Claude Code session is enough, use the direct session. Millrace matters when the work has crossed out of sprint territory.

When To Use Millrace

Use Millrace when:

  • the work will outlast a single agent session
  • you want explicit stage gates instead of "done enough" chat conclusions
  • recovery and resumability matter
  • you need durable state, queue artifacts, and run history under <workspace>/millrace-agents/
  • completion has to clear a real closure pass rather than informal optimism
  • an operator or ops agent is intentionally managing intake and runtime control

Do not use Millrace when:

  • the task is small, bounded, and cleanly handled in one direct session
  • the work is exploratory and governance would add more overhead than value
  • single-session throughput matters more than persistence and recovery
  • nobody is available to manage runtime configuration, intake, and workspace hygiene

60-Second Proof

Install:

pip install millrace-ai

Then point Millrace at a workspace:

export WORKSPACE=/absolute/path/to/your/workspace

millrace init --workspace "$WORKSPACE"
millrace compile validate --workspace "$WORKSPACE"
millrace run once --workspace "$WORKSPACE"
millrace status --workspace "$WORKSPACE"

That flow proves seven things quickly:

  • workspace bootstrap is explicit and creates the managed baseline under millrace-agents/
  • the selected mode compiles into one persisted compiled_plan.json before execution
  • compile output fingerprints the selected mode, runtime config, and packaged assets so compile show / status can report whether the plan is current or stale
  • that compiled plan carries node bindings, intake entries, recovery policies, closure-target activation, and post-stage routing
  • the shipped default_codex mode freezes closure behavior directly into that single compiled artifact
  • status and run inspection carry compiled-plan identity so operators can tie runtime activity back to the compiled plan that produced it
  • the runtime can execute a deterministic tick and report persisted status

For a visible long-running session, use millrace run daemon --monitor basic. The default daemon remains quiet unless that monitor is requested explicitly. The basic monitor is a human-facing stream: it compacts stage labels, shortens long run ids for display, omits unknown token filler, and leaves full ids and artifacts to millrace runs ... inspection commands. The basic monitor prints the first idle reason=no_work line immediately, then throttles repeated no_work idles to a 120-second heartbeat until runtime activity or a different idle reason appears. Use --monitor-log <path> when you want the same clean monitor stream written to a file without necessarily printing live monitor lines to stdout.

For an optional local dashboard, install the separate millrace-web package from PyPI and run millrace-web serve --workspace "$WORKSPACE". The web dashboard is a read-only observer with Detail and Flow views; it is not included in the millrace-ai wheel and does not acquire runtime ownership locks.

When the packaged workspace baseline changes, use millrace upgrade first to preview the managed-file classifications, then millrace upgrade --apply to apply safe baseline updates. This does not update the installed Python package; for runtime-code fixes, update millrace-ai through the environment's package manager first and verify with millrace --version or millrace version. If compile inputs drift and the persisted plan is stale, runtime startup and config reload refuse to keep running on the stale plan.

Stage config supports all execution, planning, and learning stage names. For Codex-backed stages, stages.<stage>.model_reasoning_effort sets the per-stage Codex reasoning effort that compile, runner invocation artifacts, and run inspection will surface.

Canonical shipped modes today:

  • default_codex
  • default_pi

Learning-enabled shipped modes:

  • learning_codex
  • learning_pi

The learning modes use the same execution and planning topology as the default modes, add learning.standard, and freeze learning trigger rules into the compiled plan.

Compatibility alias:

  • standard_plain -> default_codex

Read By Journey

Need the single dense system explainer first? Start with docs/millrace-technical-overview.md.

Start Here

  • docs/runtime/README.md
  • docs/skills/millrace-ops-agent-manual/SKILL.md if you are operating Millrace as an agent

Run It

  • docs/runtime/millrace-cli-reference.md
  • docs/runtime/millrace-runtime-architecture.md
  • docs/runtime/millrace-usage-governance.md

Understand It

  • docs/runtime/millrace-compiler-and-frozen-plans.md
  • docs/runtime/millrace-modes-and-loops.md
  • docs/runtime/millrace-arbiter-and-completion-behavior.md
  • docs/runtime/millrace-runner-architecture.md

Extend It

  • docs/runtime/millrace-entrypoint-mapping.md
  • docs/runtime/millrace-loop-authoring.md
  • docs/skills/millrace-loop-authoring/SKILL.md
  • docs/source-package-map.md

Status

Millrace ships as a maintained pre-1.0 runtime line. If you depend on exact behavior, pin to a patch version and verify against the current CLI and docs rather than assuming every newer build is identical.

License

See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

millrace_ai-0.17.1.tar.gz (251.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

millrace_ai-0.17.1-py3-none-any.whl (372.2 kB view details)

Uploaded Python 3

File details

Details for the file millrace_ai-0.17.1.tar.gz.

File metadata

  • Download URL: millrace_ai-0.17.1.tar.gz
  • Upload date:
  • Size: 251.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for millrace_ai-0.17.1.tar.gz
Algorithm Hash digest
SHA256 e3b09247d1848e4eb43cbb063e3a42956c8150a4483b5a963c96c4748cfc5658
MD5 af3a05d73c3f470ac04249a6c55bec9e
BLAKE2b-256 08063ae7417d796f39f5bc8f08586df06b499d9a0d1442008af0984b6539ab07

See more details on using hashes here.

Provenance

The following attestation bundles were made for millrace_ai-0.17.1.tar.gz:

Publisher: publish-to-pypi.yml on tim-osterhus/millrace

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file millrace_ai-0.17.1-py3-none-any.whl.

File metadata

  • Download URL: millrace_ai-0.17.1-py3-none-any.whl
  • Upload date:
  • Size: 372.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for millrace_ai-0.17.1-py3-none-any.whl
Algorithm Hash digest
SHA256 1b855280e8c586db3eb2e2da1e02eddc08bd97f14e24a6bf1fb17544a4e3788e
MD5 0a9a21f6d178e8a5394a75483ca2b210
BLAKE2b-256 e1c20feca054fe0826810d2a318f49a6fc47708d90aa2519f87b36973a347ddd

See more details on using hashes here.

Provenance

The following attestation bundles were made for millrace_ai-0.17.1-py3-none-any.whl:

Publisher: publish-to-pypi.yml on tim-osterhus/millrace

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page