Skip to main content

AnkaFlow

Run your data pipelines in Python or the browser.
AnkaFlow is a YAML + SQL-powered data pipeline engine that works in local Python, JupyterLite, or fully in-browser via Pyodide.

🚀 Features

  • Run pipelines using DuckDB with SQL and optional Python
  • Supports Parquet, REST APIs, BigQuery, ClickHouse (server only)
  • Browser-compatible: works in JupyterLite, GitHub Pages, VS Code Web and more

📦 Install

# Server
pip install ankaflow[server]

# Dev
pip install -e .[dev,server]

🛠 Usage

> ankaflow /path/to/stages.yaml
from ankaflow import (
    ConnectionConfiguration,
    Stages,
    Flow,
)

connections = ConnectionConfiguration()

stages = Stages.load("path/to/stages.yaml")
flow = Flow(stages, connections)
flow.run()

🔁 What is Stages?

Stages is the object that holds your pipeline definition parsed from a YAML file.
Each stage is one of: tap, transform, or sink.

Example

- name: Extract Data
  kind: tap
  connection:
    kind: Parquet
    locator: input.parquet

- name: Transform Data
  kind: transform
  query: SELECT * FROM "Extract Data" WHERE "amount" > 100

- name: Load Data
  kind: sink
  connection:
    kind: Parquet
    locator: output.parquet

📖 Documentation


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ankaflow-0.10.0.tar.gz (81.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ankaflow-0.10.0-py3-none-any.whl (97.7 kB view details)

Uploaded Python 3

File details

Details for the file ankaflow-0.10.0.tar.gz.

File metadata

  • Download URL: ankaflow-0.10.0.tar.gz
  • Upload date:
  • Size: 81.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for ankaflow-0.10.0.tar.gz
Algorithm Hash digest
SHA256 37a1442a5fafda4a54ddee8b34da859b6f6f5c9c5f6fbc26ebcf49b7b8893f3f
MD5 fe5a548f4361a6ab589a2d04d3a23a0a
BLAKE2b-256 6a4d090f9f8ed775601e09f9991ff8930592909a7899a338c301e67d1ae1e2e9

See more details on using hashes here.

Provenance

The following attestation bundles were made for ankaflow-0.10.0.tar.gz:

Publisher: python-publish.yml on targetta/ankaflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ankaflow-0.10.0-py3-none-any.whl.

File metadata

  • Download URL: ankaflow-0.10.0-py3-none-any.whl
  • Upload date:
  • Size: 97.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for ankaflow-0.10.0-py3-none-any.whl
Algorithm Hash digest
SHA256 c254cdce421958b00bfab6b0d5a89294dafc6b05d59cbcc69e31cff0d610172f
MD5 54db5d57e7ddfe0d38355fe69eb583ee
BLAKE2b-256 bc63d09e8933440688c5c9e8dcf3116ba863b15da98d7811d80bd87f9f04b7a1

See more details on using hashes here.

Provenance

The following attestation bundles were made for ankaflow-0.10.0-py3-none-any.whl:

Publisher: python-publish.yml on targetta/ankaflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.11.0

2 files

This release

0.10.0 This release

2 files

0.9.0

2 files

0.8.1

2 files

0.7.3

2 files

0.7.2

2 files

0.7.1

2 files

0.5.1

2 files

0.4.2

2 files

0.4.1

2 files

0.4.0

2 files

0.3.0

2 files

0.2.0

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page