Skip to main content

AnkaFlow

Run your data pipelines in Python or the browser.
AnkaFlow is a YAML + SQL-powered data pipeline engine that works in local Python, JupyterLite, or fully in-browser via Pyodide.

🚀 Features

  • Run pipelines using DuckDB with SQL and optional Python
  • Supports Parquet, REST APIs, BigQuery, ClickHouse (server only)
  • Browser-compatible: works in JupyterLite, GitHub Pages, VS Code Web and more

📦 Install

# Server
pip install ankaflow[server]

# Dev
pip install -e .[dev,server]

🛠 Usage

> ankaflow /path/to/stages.yaml
from ankaflow import (
    ConnectionConfiguration,
    Stages,
    Flow,
)

connections = ConnectionConfiguration()

stages = Stages.load("path/to/stages.yaml")
flow = Flow(stages, connections)
flow.run()

🔁 What is Stages?

Stages is the object that holds your pipeline definition parsed from a YAML file.
Each stage is one of: tap, transform, or sink.

Example

- name: Extract Data
  kind: tap
  connection:
    kind: Parquet
    locator: input.parquet

- name: Transform Data
  kind: transform
  query: SELECT * FROM "Extract Data" WHERE "amount" > 100

- name: Load Data
  kind: sink
  connection:
    kind: Parquet
    locator: output.parquet

📖 Documentation


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ankaflow-0.11.0.tar.gz (81.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ankaflow-0.11.0-py3-none-any.whl (97.3 kB view details)

Uploaded Python 3

File details

Details for the file ankaflow-0.11.0.tar.gz.

File metadata

  • Download URL: ankaflow-0.11.0.tar.gz
  • Upload date:
  • Size: 81.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for ankaflow-0.11.0.tar.gz
Algorithm Hash digest
SHA256 98a1f99b54e28c63426abbe21aea4a91decc54f83fd95088f77da18f72316d33
MD5 6df4144d66e9963aabf7ec9cf11d5b80
BLAKE2b-256 a15bcbe481b5269c214987c0365f303c9ea4b567dc63261cc115deed306b7cb5

See more details on using hashes here.

Provenance

The following attestation bundles were made for ankaflow-0.11.0.tar.gz:

Publisher: python-publish.yml on targetta/ankaflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ankaflow-0.11.0-py3-none-any.whl.

File metadata

  • Download URL: ankaflow-0.11.0-py3-none-any.whl
  • Upload date:
  • Size: 97.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for ankaflow-0.11.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b5cd8022efebbc4bfdf7dc919bbb50ec08f2b803bc340eaf60275677c54e9d36
MD5 6b294b850870206aaae3d225489183b9
BLAKE2b-256 d63138dc8978c7b97d57cd53287645fb7c53f06e063d754459af7bac0fd6a73e

See more details on using hashes here.

Provenance

The following attestation bundles were made for ankaflow-0.11.0-py3-none-any.whl:

Publisher: python-publish.yml on targetta/ankaflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.11.0 This release

2 files

0.10.0

2 files

0.9.0

2 files

0.8.1

2 files

0.7.3

2 files

0.7.2

2 files

0.7.1

2 files

0.5.1

2 files

0.4.2

2 files

0.4.1

2 files

0.4.0

2 files

0.3.0

2 files

0.2.0

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page