SynaFlow 🌊🧠

📖 Full documentation: humansoftware.github.io/synaflow

Write plain Python functions. SynaFlow builds the pipeline for you.

PyPI License Python

SynaFlow is a lightweight, pure-Python pipeline engine that uses Type Hints to automatically wire and execute Directed Acyclic Graphs (DAGs) with lockstep streaming and optional bounded handoff.

Why the name? Synapse + Flow. Just like synapses automatically wire neurons together, SynaFlow automatically wires your functions together based on their types. "Flow" represents the lazy, streaming nature of how data moves through those connections.

Quickstart

from collections.abc import Generator, Iterator
from typing import NamedTuple
from synaflow import pipeline, step, run

class Params(NamedTuple):
    count: int

def producer(count: int) -> Generator[int, None, None]:
    yield from range(count)

def transformer(producer: Iterator[int]) -> Generator[int, None, None]:
    for val in producer:
        yield val * 10

def consumer(transformer: Iterator[int]) -> None:
    for x in transformer:
        print(f"Consumed: {x}")

p = pipeline(
    name="example",
    params=Params,
    steps=[
        step("producer", fn=producer),
        step("transformer", fn=transformer),
        step("consumer", fn=consumer),
    ],
)

run(p, Params(count=5))

Three functions, three step() calls, zero manual wiring. SynaFlow reads the type hints and wires the DAG automatically.

What makes it different

Type-hint wiring

Parameter names match producer names — SynaFlow connects them automatically. Singular/plural/suffix synonyms work too (item → items, user_list → users).

Lazy streaming with bounded handoff

SynaFlow streams lazily by default. Multiple consumers can stay lockstep, one consumer can stay lazy while another materializes, and when you need a bounded window between stages you can set max_in_flight on the producing step.

This is especially useful for I/O-bound pipelines where one step starts work and the next resolves it, such as HTTP requests, RPC calls, or object-store reads.

Static validation at build time

Type errors, missing dependencies, circular graphs, mode conflicts — all caught when pipeline(...) is called. If it compiles, it's valid. No runtime surprises.

Build your own runner

The DAG compiles to a deterministic JSON contract. Write custom runners or auto-generate native DAGs for Airflow, Prefect, or Dagster.

How it compares

SynaFlow Hamilton Airflow / Prefect / Dagster
Auto wiring ✅ type hints + smart binding ✅ type hints (exact names) ❌ explicit A >> B
Lazy streaming ✅ lockstep + bounded handoff ❌ DataFrame-centric ❌ task-based
Smart binding ✅ singular/plural/suffix ❌ ❌
Scope In-process micro Feature engineering Cluster orchestration
DAG export ✅ JSON ✅ ✅
Sync/async parity ✅ identical ❌ ✅

Detailed comparisons: Hamilton · Java Streams · LINQ

Installation

pip install synaflow

Documentation

Start here: humansoftware.github.io/synaflow

Section Description
Tutorial 5-level step-by-step guide building a pipeline from scratch
Core Concepts How the DAG is wired, lockstep flow, max in flight, build vs run, event-based processing
Examples Every corpus pipeline with auto-generated diagrams and source code
Comparisons Detailed comparisons with Hamilton, Java Streams, and LINQ
Design Philosophy Architectural decisions, contracts, and design rationale

License

MIT License

Project links

Data verified by PyPI on Jun 19, 2026
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.32.2)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for mvallebr from gravatar.com mvallebr

Credits

Author: mvallebr

GitHub Statistics

Data verified by PyPI on Jun 19, 2026
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License

MIT License (MIT)

Requires

Python >=3.10

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

synaflow-0.17.3.tar.gz (208.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

synaflow-0.17.3-py3-none-any.whl (43.2 kB view details)

Uploaded Python 3

File details

Details for the file synaflow-0.17.3.tar.gz.

File metadata

  • Download URL: synaflow-0.17.3.tar.gz
  • Upload date:
  • Size: 208.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for synaflow-0.17.3.tar.gz
Algorithm Hash digest
SHA256 fc7f028ae30f6e0afa3f5e11d40132823e89c14b5f8fb0b5fbdba67f3313f9d6
MD5 5eb3444c505f0f91948636959ad4f825
BLAKE2b-256 ac90d49de0dfbab7f5ad0d169976eb426567fb25cfb815a7d5f6c64f6f797533

See more details on using hashes here.

Provenance

The following attestation bundles were made for synaflow-0.17.3.tar.gz:

Publisher: release.yml on humansoftware/synaflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file synaflow-0.17.3-py3-none-any.whl.

File metadata

  • Download URL: synaflow-0.17.3-py3-none-any.whl
  • Upload date:
  • Size: 43.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for synaflow-0.17.3-py3-none-any.whl
Algorithm Hash digest
SHA256 4c01c9c2ce34343fe74627ad935812756cbb0fe962ae0968ddd34d14a43ba272
MD5 863b6270fb168255c79dbffd2d814bca
BLAKE2b-256 26d25664dcfdbc54749af065bd5c21128d38c7d10c4d6d1fe496934363996466

See more details on using hashes here.

Provenance

The following attestation bundles were made for synaflow-0.17.3-py3-none-any.whl:

Publisher: release.yml on humansoftware/synaflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page