Skip to main content

onepipeline

Execute a task DAG over oneagentgraph and onevcs, merging their event streams into one.

onepipeline is the composition layer. It executes a plan — a dependency graph mixing direct agent nodes, repository lifecycle nodes, and explicit human actions — continuously, dispatching each node the moment its dependencies settle, through a pluggable executor seam, and keeps a live channel open to the planner supervising the run. The plan itself lives in onetaskgraph: a run is launched by naming a project of whichever backend you already track work in, so a plan is something you can open, edit and share without this harness in the loop. The agents come from oneagentgraph; the clones, worktrees, publications, and change requests come from onevcs. Nothing here verifies a change: that is the repository's own merge path — the host's required checks where a change publishes remotely, and the repository's pre-push hook at the publishing push where it publishes locally. Dependency direction is one-way: neither sibling depends on this crate.

The public types, traits, config schemas, and CLI surface are the approved contract in docs/contract.md, compiled — and implemented behind it. onevcs is linked and called: sessions, publication, and a session's event stream are library calls, so what a publication did is a typed value rather than a line of prose to parse. oneagentgraph is still run as a CLI, so a build of it that refuses will make the dispatches this crate starts refuse too; the composition layer itself is complete.

Install

pip install onepipeline-cli      # prebuilt binary, no Rust toolchain
npm install -g onepipeline-cli   # the same binary, via npm
cargo install onepipeline        # from crates.io, compiled locally

To install a revision that has not been released yet — which today is every revision, since the crate depends on its siblings by git and a git dependency cannot be published — build it from the repository:

cargo install --git https://github.com/nickderobertis/onepipeline onepipeline --locked

The package name is not optional: cargo install --git searches the whole repository, and this one also carries the onepipeline-testfakes test harness, so an unqualified command fails with multiple packages with binaries found.

Prebuilt archives for Linux (x86-64, arm64), macOS (Intel, Apple silicon), and Windows (x86-64) are attached to every release, with sha256 checksums.

Where a plan lives

A plan is one onetaskgraph project, and a node is one task in it. A run is launched by naming that project's qualified id:

onepipeline start plans:tracked-release --heartbeat-interval 1800

Which backend that store is — a folder of Markdown, Linear, GitHub Projects — is onetaskgraph's own configuration, discovered from the directory you launch in:

# onetaskgraph.yaml
sources:
  plans:
    plugin: local-md
    config: { root: ./plans }

examples/plan-store/ is a complete store of that shape, holding the two example plans this repository ships. Nothing here special-cases a remote source, so a local-md project runs directly — author locally, run it, and copy it up only when it should become durable.

The mapping is docs/contract.md's, and it is one rule per field: the plan-level settings (schema_version, goal, name, concurrency) are reserved onepipeline.<field> metadata keys on the project; a node's id is onepipeline.id on its task; its prose is the task's content, its title the task's title, and its repository the first of the task's repositories; its dependencies are real onetaskgraph dependency edges; and every other node field is onepipeline.<field> carrying the same JSON value a plan document carried under that name. One task of the example store:

---
title: "feat: implement approved release"
project: "tracked-release"
repositories:
  - "github.com/nickderobertis/some-service"
depends_on:
  - "tracked-release/design-approval"
metadata:
  "onepipeline.id": "service"
  "onepipeline.persona": "engineer"
  "onepipeline.max_turns": 24
---
## What
Implement the approved API and rollout behaviour.

onepipeline drives the onetaskgraph binary rather than linking the crate, so one has to be installed: from ONETASKGRAPH_BIN when that names one, and from onetaskgraph on the PATH otherwise. Its version is checked before anything is dispatched, and an absent, unusable, or too-old install refuses the launch — naming the path, the version, the minimum, and how to install one — rather than becoming a run that fails on its first node.

The run's own record does not move: the journal, the ledger, and the graph a run is executing are still this crate's, projected from that journal under the run's ownership lock. Node status, settlement metadata, and accepted live graph edits are projected back onto the onetaskgraph project in the background. A failed write is reported and retried; it never changes execution or an edit ruling.

What it does

start drives the run itself: a node — and each step within a lifecycle node — dispatches the moment its dependencies settle, and settlement triggers integration and publication immediately. No agent is required. The only pauses are decision points: a ready kind: human node, or any surface declared blocking, holds back the subtree that depends on it while every other branch carries on, and clearing it with attest or reply resumes that subtree inside the running loop.

--dag-graph REF attaches an agent graph as an observer — the shipped one is a monitor member that watches the stream and raises what does not line up, plus a resettable-cron check-in member that surfaces a status when nobody has reported one for a while. It never drives the engine. Attached, start returns when the run settles; exit 3 means nothing is driving the run, and onepipeline adopt RUN attaches a fresh driver to the intact ledger, and takes the same --attach/--detach pair start does: detached, it prints the launch record and returns once the driver it retained has the run, so recovering one run does not hold the session supervising the others.

A lifecycle node states the title its change request opens under, and may state its body too. --pr-author-graph REF names an agent graph that drafts that body instead, from the branch's own diff, once the branch is verified and before the change request is opened; naming none is the default, and a drafting dispatch that does not get there costs the change request its body and nothing else. It costs no visibility either: a drafting dispatch that was configured, attempted, and produced no body is recorded against the node under one of three endings — dispatch-failed for one that could not be run or ran without succeeding, schema-refused for one whose every answer the schema rejected, and no-body for one that answered inside the schema and put nothing in it, which are three different fixes — and the node's own settlement says the same thing, so results shows it. Naming no graph and writing the body yourself spend no dispatch and are not reported.

A publication that fails does not always finish the node. onevcs says which failure it was, and five of them settle under a word of their own — checks-failed for a required check the host reports concluded red, checks-unsettled for a bound that elapsed with the change still outstanding, push-rejected for a push the merge path refused, sync-conflict for a base that moved under the publication, and pushed-unverified for a push that reached the remote with the merge path unreadable behind it. The first four leave the rejected tree on the branch the session handed back, so the node is dispatched again on that branch, with no step recorded as completed and with the failure's reason and the id of every artifact its publication recorded delivered as that dispatch's own context — the worker meets the diagnosis, on the tree that has to change. pushed-unverified is answered differently, because nothing about its tree was rejected: the work is already on the origin, so the merge path is read again — bounded by ONEPIPELINE_MERGE_PATH_READS, three by default — rather than the agent re-dispatched for a fresh clone and a fresh gate to re-push what the remote already carries. A verdict that arrives during those reads settles the node; reads that never get one settle it failed saying where the work is, what commit it is at, and what stopped the read. Everything else settles publication-failed as it always did and is not retried: the repository's own gate, a request refused at a trust boundary, and a seam with no implementation behind it all answer the same way however many times they are asked. The loop is bounded by ONEPIPELINE_PUBLICATION_ATTEMPTS, three by default, and a node that spends it settles failed under the last failure's word, saying how many attempts were made and what each one ended with.

A dispatch that ends for a reason that is not the agent's verdict on its task settles dispatch-died rather than task-failed: a rate limit twenty seconds after the final report, a harness that lost its credential, a run root deleted underneath a live turn. The word is chosen by classifying the failure's own detail and never by inspecting the branch, so a dispatch that died holding finished work and one that produced nothing at all reach the same word. The settlement carries cause — the producer's own classification, rate_limit, quota, auth, spawn-error — and head, the commit the node's branch was left at, and results and status say in one sentence that the branch may carry finished work and name that commit. It is not infrastructure-failure, which is the dispatch layer refusing before any work began and is retried for exactly that reason.

The planner supervises over the channel:

onepipeline next run-1                                   # read the next surface
onepipeline reply run-1 <<<'{"version":1,"commands":[    # edit the live graph
  {"op":"retry","id":"failed","node":{"id":"retry","task":"..."}}]}'
onepipeline attest run-1 design-approval                 # complete a human action

Every edit is applied or rejected with a reason: reply exits 0 when the reconciler applied it, 1 when it is queued but not yet reconciled, and 2 when it was refused.

Two of those ops reach a node that is already running, and they are deliberately not the same lever:

onepipeline reply run-1 <<<'{"version":1,"commands":[    # steer the worker
  {"op":"context","id":"build","note":"the fixture moved to tests/data"}]}'
onepipeline reply run-1 <<<'{"version":1,"commands":[    # move the bar
  {"op":"amend","id":"build","text":"The comment lines are out of scope: leave them."}]}'

A context note steers the worker only. It is rendered under ## Planner context saying of itself that it reports observed state and adds no acceptance criteria, it carries exactly one dispatch, and it does not change what the node is judged against. An amend does change that: its text becomes part of the node's effective task, rendered under ## Amendment above the task's operational notes and claiming precedence over them, so the worker and the judge reviewing it read the same ruling — on the dispatch that follows it and on every later one, until another amend replaces it. A turn already in flight is not reached: its task was composed before the ruling existed, and so was the one its judge reads. A node's current amendment is readable from status and from results before anything replaces it. Without the second lever a manager's mid-dispatch ruling reaches the worker and not its judge, and the node's own judge can tell it to undo what the manager decided.

amend is the planner's; an observing monitor may not issue one, because moving a bar is a decomposition decision rather than an observation.

A launch may also name a node validator — a command of the host's own, which every op that introduces or changes a node's task (add, retry, a requeue whose amendment touches task, and amend) is offered the resulting node to, as JSON on its stdin. Exit 0 accepts the edit; a non-zero exit refuses it with the command's own stderr as the reason. It is named by --node-validator COMMAND, by ONEPIPELINE_NODE_VALIDATOR, or by a launch config's node_validator, in that order of precedence; naming none is the default and runs no validator at all.

Read-only views — runs, status, host, monitor, results, goals, transcript, telemetry — report unread surfaces, driver liveness, and provider health without touching a run. status says what each in-flight node is doing right now, with an event count and an age; transcript RUN [NODE] renders a dispatched turn's tools and its words; telemetry reports what each party spent and where the wall clock went, in eight buckets that sum exactly. Anything nothing in the stack measures is reported absent, never as a zero.

Where a dispatch runs

The executor seam decides. v1 ships the local executor only; the trait and the rules grammar are shaped so a dispatch-server or Kubernetes executor is a config change rather than a code change.

executors:
  - {name: local, type: local, max_load1: 8.0, min_free_mem: 2GiB}
rules:
  - when: {executor_has_capacity: local}
    use: local
  - use: local

Ordered: the first rule whose when holds decides, and a rule with no when is the fallback. A when tests an executor's capacity, the node's own labels (when: {node_label: {persona: reviewer}}), or both — several conditions in one when all have to hold.

Development

just bootstrap   # from a clean clone
just check       # the deterministic gate
just gate        # check + the diff-scoped llmlint tier

just --list is the full command surface. docs/contract-divergences.md records every place the code could not compile the contract exactly as written, and what the planner who owns the contract ruled on each.

License

MIT.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onepipeline_cli-0.16.4-py3-none-win_amd64.whl (6.6 MB view details)

Uploaded Python 3Windows x86-64

onepipeline_cli-0.16.4-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (6.3 MB view details)

Uploaded Python 3manylinux: glibc 2.17+ x86-64

onepipeline_cli-0.16.4-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.9 MB view details)

Uploaded Python 3manylinux: glibc 2.17+ ARM64

onepipeline_cli-0.16.4-py3-none-macosx_11_0_arm64.whl (5.8 MB view details)

Uploaded Python 3macOS 11.0+ ARM64

onepipeline_cli-0.16.4-py3-none-macosx_10_12_x86_64.whl (6.1 MB view details)

Uploaded Python 3macOS 10.12+ x86-64

File details

Details for the file onepipeline_cli-0.16.4-py3-none-win_amd64.whl.

File metadata

File hashes

Hashes for onepipeline_cli-0.16.4-py3-none-win_amd64.whl
Algorithm Hash digest
SHA256 6e356099f6c3b759cab4128c344efbb485fd1ddcae70efd1b9ff9c80e95f5749
MD5 2ec64cebfaa317e4ad48dc9b426cdaaa
BLAKE2b-256 76ced3fec876651a75ad9a34f981cd21277985eaf86a3205a0d5d6b58e2f9ace

See more details on using hashes here.

File details

Details for the file onepipeline_cli-0.16.4-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for onepipeline_cli-0.16.4-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 cd8177a8dd0d991e882dd39432fe13c282d6111556e41e6c1343acc14c434f76
MD5 eb08dfa56c405bf7e33911fe66d890d1
BLAKE2b-256 aee2b699c15bb263aafc0a9201083888af4fc7b580802c81b8ff8abc957a744d

See more details on using hashes here.

File details

Details for the file onepipeline_cli-0.16.4-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for onepipeline_cli-0.16.4-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 09bac1fe68d7e05e544b97353686a44467fb4a250b0d8402dbb102dc87520175
MD5 66fdee1e2a4164a37550fcdcef3661f2
BLAKE2b-256 3d1f65b24e80b1b7ab388f84519a8f1703dd1a0a699a478fe279fb2338a421f9

See more details on using hashes here.

File details

Details for the file onepipeline_cli-0.16.4-py3-none-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for onepipeline_cli-0.16.4-py3-none-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 c3342bd4c1c0c1980326a9d6c5122befe6ae134f1020bdd07bf012d364f00fb4
MD5 799540b1162c19e05c19cbd5878811f1
BLAKE2b-256 bebae7c158223a1a82b881cd50b76572b0b4bb2efad13c6926ee38d7b826564f

See more details on using hashes here.

File details

Details for the file onepipeline_cli-0.16.4-py3-none-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for onepipeline_cli-0.16.4-py3-none-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 e69574f2435b34624ed5f47adcabae845a2ffd0418fc9e2629b1840a6012bcb1
MD5 8d7997637e285e5782fe8ed0e99ff674
BLAKE2b-256 2a94c6aefd67a9471b0b792a5fc265f288665f74dd0778b08faa8f73845c9637

See more details on using hashes here.

Release history Release notifications | RSS feed

0.18.3

5 files

0.18.2

5 files

0.18.1

5 files

0.18.0

5 files

0.17.5

5 files

0.17.4

5 files

0.17.3

5 files

0.17.2

5 files

0.17.1

5 files

This release

0.16.4 This release

5 files

0.16.3

5 files

0.16.2

5 files

0.16.1

5 files

0.15.2

5 files

0.15.1

5 files

0.15.0

5 files

0.14.2

5 files

0.14.1

5 files

0.14.0

5 files

0.13.0

5 files

0.12.4

5 files

0.12.3

5 files

0.12.2

5 files

0.12.1

5 files

0.12.0

5 files

0.11.0

5 files

0.10.1

5 files

0.10.0

5 files

0.9.0

5 files

0.8.6

5 files

0.8.5

5 files

0.8.4

5 files

0.8.3

5 files

0.8.2

5 files

0.8.1

5 files

0.8.0

5 files

0.7.5

5 files

0.7.4

5 files

0.7.3

5 files

0.7.2

5 files

0.7.1

5 files

0.7.0

5 files

0.6.3

5 files

0.6.2

5 files

0.6.1

5 files

0.6.0

5 files

0.5.0

5 files

0.4.0

5 files

0.3.1

5 files

0.3.0

5 files

0.2.0

5 files

0.1.15

5 files

0.1.14

5 files

0.1.13

5 files

0.1.12

5 files

0.1.11

5 files

0.1.10

5 files

0.1.9

5 files

0.1.8

5 files

0.1.7

5 files

0.1.6

5 files

0.1.5

5 files

0.1.4

5 files

0.1.3

5 files

0.1.2

5 files

0.1.1

5 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page