Skip to main content

AnkaFlow

Run your data pipelines in Python or the browser.
AnkaFlow is a YAML + SQL-powered data pipeline engine that works in local Python, JupyterLite, or fully in-browser via Pyodide.

🚀 Features

  • Run pipelines using DuckDB with SQL and optional Python
  • Supports Parquet, REST APIs, BigQuery, ClickHouse (server only)
  • Browser-compatible: works in JupyterLite, GitHub Pages, VS Code Web and more

📦 Install

# Server
pip install ankaflow[server]

# Dev
pip install -e .[dev,server]

🛠 Usage

> ankaflow /path/to/stages.yaml
from ankaflow import (
    ConnectionConfiguration,
    Stages,
    Flow,
)

connections = ConnectionConfiguration()

stages = Stages.load("path/to/stages.yaml")
flow = Flow(stages, connections)
flow.run()

🔁 What is Stages?

Stages is the object that holds your pipeline definition parsed from a YAML file.
Each stage is one of: tap, transform, or sink.

Example

- name: Extract Data
  kind: tap
  connection:
    kind: Parquet
    locator: input.parquet

- name: Transform Data
  kind: transform
  query: SELECT * FROM "Extract Data" WHERE "amount" > 100

- name: Load Data
  kind: sink
  connection:
    kind: Parquet
    locator: output.parquet

📖 Documentation


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ankaflow-0.8.1.tar.gz (81.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ankaflow-0.8.1-py3-none-any.whl (97.0 kB view details)

Uploaded Python 3

File details

Details for the file ankaflow-0.8.1.tar.gz.

File metadata

  • Download URL: ankaflow-0.8.1.tar.gz
  • Upload date:
  • Size: 81.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for ankaflow-0.8.1.tar.gz
Algorithm Hash digest
SHA256 18006c9f2bac72b29c7b3e81fe7656a82b8c006157f5e37814d7e3e6ad796b9f
MD5 fa7eb5b34b76851ca854df837b3442ba
BLAKE2b-256 aabdd92cb7aa6b33f8a34ef25c0440bd83ea5ef79201a4bd3b33749f44eeec2d

See more details on using hashes here.

Provenance

The following attestation bundles were made for ankaflow-0.8.1.tar.gz:

Publisher: python-publish.yml on targetta/ankaflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ankaflow-0.8.1-py3-none-any.whl.

File metadata

  • Download URL: ankaflow-0.8.1-py3-none-any.whl
  • Upload date:
  • Size: 97.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for ankaflow-0.8.1-py3-none-any.whl
Algorithm Hash digest
SHA256 23870a12132ecd0ee97d6c129f5b6c46754a2aba7d2595e2f1cfbcdc730485f1
MD5 9f9ad3a27951ad8539dfa522c00b0cf4
BLAKE2b-256 3cc689f33633da03d46f986ae5937f15fd4e6e568f040c7e50c5e5b808aeb93b

See more details on using hashes here.

Provenance

The following attestation bundles were made for ankaflow-0.8.1-py3-none-any.whl:

Publisher: python-publish.yml on targetta/ankaflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.11.0

2 files

0.10.0

2 files

0.9.0

2 files

This release

0.8.1 This release

2 files

0.7.3

2 files

0.7.2

2 files

0.7.1

2 files

0.5.1

2 files

0.4.2

2 files

0.4.1

2 files

0.4.0

2 files

0.3.0

2 files

0.2.0

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page