Skip to main content

AnkaFlow

Run your data pipelines in Python or the browser.
AnkaFlow is a YAML + SQL-powered data pipeline engine that works in local Python, JupyterLite, or fully in-browser via Pyodide.

🚀 Features

  • Run pipelines using DuckDB with SQL and optional Python
  • Supports Parquet, REST APIs, BigQuery, ClickHouse (server only)
  • Browser-compatible: works in JupyterLite, GitHub Pages, VS Code Web and more

📦 Install

# Server
pip install ankaflow[server]

# Dev
pip install -e .[dev,server]

🛠 Usage

> ankaflow /path/to/stages.yaml
from ankaflow import (
    ConnectionConfiguration,
    Stages,
    Flow,
)

connections = ConnectionConfiguration()

stages = Stages.load("path/to/stages.yaml")
flow = Flow(stages, connections)
flow.run()

🔁 What is Stages?

Stages is the object that holds your pipeline definition parsed from a YAML file.
Each stage is one of: tap, transform, or sink.

Example

- name: Extract Data
  kind: tap
  connection:
    kind: Parquet
    locator: input.parquet

- name: Transform Data
  kind: transform
  query: SELECT * FROM "Extract Data" WHERE "amount" > 100

- name: Load Data
  kind: sink
  connection:
    kind: Parquet
    locator: output.parquet

📖 Documentation


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ankaflow-0.9.0.tar.gz (81.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ankaflow-0.9.0-py3-none-any.whl (97.7 kB view details)

Uploaded Python 3

File details

Details for the file ankaflow-0.9.0.tar.gz.

File metadata

  • Download URL: ankaflow-0.9.0.tar.gz
  • Upload date:
  • Size: 81.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for ankaflow-0.9.0.tar.gz
Algorithm Hash digest
SHA256 106ac71cdf82ac93b98899cd8c65bc9a7aa49712991550fd4e6e9fe90cc37eb0
MD5 372e65931d19554bf7ca092cbad54af7
BLAKE2b-256 9a85d9678db3af1fa396c60b9a780b64784506b9671551e32e11110ef7f7040f

See more details on using hashes here.

Provenance

The following attestation bundles were made for ankaflow-0.9.0.tar.gz:

Publisher: python-publish.yml on targetta/ankaflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ankaflow-0.9.0-py3-none-any.whl.

File metadata

  • Download URL: ankaflow-0.9.0-py3-none-any.whl
  • Upload date:
  • Size: 97.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for ankaflow-0.9.0-py3-none-any.whl
Algorithm Hash digest
SHA256 22a5b02efcad41857da107223ee18268fc595b2cd567801cda672e30b602974f
MD5 79e1cb712596945ff29cf71617b67dca
BLAKE2b-256 23b78303781c27832ca2d50884419836fc67d3bd21f33462f87d686722782ba4

See more details on using hashes here.

Provenance

The following attestation bundles were made for ankaflow-0.9.0-py3-none-any.whl:

Publisher: python-publish.yml on targetta/ankaflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.11.0

2 files

0.10.0

2 files

This release

0.9.0 This release

2 files

0.8.1

2 files

0.7.3

2 files

0.7.2

2 files

0.7.1

2 files

0.5.1

2 files

0.4.2

2 files

0.4.1

2 files

0.4.0

2 files

0.3.0

2 files

0.2.0

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page