Skip to main content

NodeGraph Engine

PyPI version CI codecov Docs status

A platform for designing node-based workflows.

Supported engines

NodeGraph Engine ships with adaptors for a range of orchestration backends. Pick the engine that best matches your deployment target using the summary below and consult the documentation links for integration details.

Engine Description
Direct Run graphs locally inside the current Python process while capturing provenance.
Airflow Materialise graphs as Airflow DAGs that can be scheduled and monitored in Apache Airflow.
Dagster Launch graphs as Dagster jobs and surface executions in the Dagster UI via a configured instance.
Dask Execute node jobs through Dask's threaded scheduler, keeping provenance in the local AiiDA profile while resolving dependencies and nested graphs automatically.
Prefect Execute graphs as Prefect flows while streaming provenance back to the recorder.
Parsl Dispatch tasks to Parsl executors for parallel and distributed execution without losing provenance fidelity.
Redun Integrate with Redun workflows while preserving provenance throughout execution.
Jobflow Bridge to the Jobflow workflow system for materials science workloads with consistent provenance records.
Executorlib (Pyiron) Coordinate tasks with executorlib executors for provenance-rich high-throughput simulations.

Check the engine reference for a detailed overview of each adaptor and links to upstream documentation.

    pip install --upgrade --user node_graph_engine

Documentation

Check the docs and learn about the features.

Examples

A simple math calculation

from node_graph import NodeGraph, node

@node()
def add(x, y):
    return x + y

@node()
def multiply(x, y):
    return x + y

@node.graph()
def AddMultiply(x, y, z):
    the_sum = add(x=x, y=y).result
    return multiply(x=the_sum, y=z).result

Engines and provenance

Run graphs directly in Python:

from node_graph_engine.direct import DirectEngine

graph = AddMultiply.build(x=1, y=2, z=3)

engine = DirectEngine()
results = engine.run(graph)

The generated provenance graph:

Provenance Graph Example

License

MIT

Metadata

Release files for node-graph-engine 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for node-graph-engine 0.1.0
File Size Uploaded
node_graph_engine-0.1.0.tar.gz 36.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for node-graph-engine 0.1.0
File Interpreter ABI Platform
node_graph_engine-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 84.7 kB

Release files / node_graph_engine-0.1.0.tar.gz

Download URL node_graph_engine-0.1.0.tar.gz
Size 36.1 kB
Tags Source
SHA-256 checksum
How to use checksums
40969f977b4aa97b3994cbd40e9465a7255203cdd5e41ddbddf875e5e4f3d398
BLAKE2b-256 checksum
How to use checksums
8e5fe0dc5af433ce02f91a475dd50493c526c24e4b9a5352111932dd64b41f46
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.9.25

Release files / node_graph_engine-0.1.0-py3-none-any.whl

Download URL node_graph_engine-0.1.0-py3-none-any.whl
Size 48.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
fa1a4641aff60a0fb805ae4e466038eab316d9d10e9480ccf1e7ff08fa9fcb14
BLAKE2b-256 checksum
How to use checksums
2a5ef485684d47f11f544ff7e7a77c6ed66b99535b1d864762478b73d1ecb962
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.9.25

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page