Skip to main content

Trickle: incremental joins and aggregates for DuckDB

Trickle keeps tables in a DuckDB database up to date from the changes to their inputs. You write a join or an aggregate once; each run recomputes only the rows affected by what changed since the last run.

import duckdb
import trickle
from trickle import agg

con = duckdb.connect("shop.duckdb")

with trickle.run(con, pipeline="nightly") as t:
    # Full snapshots in, change sets out.
    t.merge_table("orders", con.sql("FROM read_parquet('drops/orders/*.parquet')"), pk="order_id")
    t.merge_table("products", con.sql("FROM read_csv('drops/products.csv')"), pk="product_id")

    # Written once; each run only recomputes what the changed orders and products affect.
    (t.source("orders")
       .join(t.source("products"), on="product_id")
       .select("s1.category, s0.quantity * s1.unit_price AS revenue")
       .aggregate(by="category", revenue=agg.sum("revenue"), orders=agg.count())
       .merge("revenue_by_category"))

Trickle is the incremental engine of Duckstring, a data engineering platform for DuckDB, and is documented at docs.duckstring.com. It is released under the Apache License 2.0.

Metadata

Release files for duckstring-trickle 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for duckstring-trickle 0.2.1
File Size Uploaded Provenance
duckstring_trickle-0.2.1.tar.gz 119.5 kB With provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for duckstring-trickle 0.2.1
File Interpreter ABI Platform
duckstring_trickle-0.2.1-py3-none-any.whl Python 3 none any Details

Total release size: 214.5 kB

Release files / duckstring_trickle-0.2.1.tar.gz

Download URL duckstring_trickle-0.2.1.tar.gz
Size 119.5 kB
Tags Source
SHA-256 checksum
How to use checksums
12d545772ea4e6a82bf769865020d38bf6c1ce5f5d9be8ab44f73688970585d6
BLAKE2b-256 checksum
How to use checksums
208386b66ad51e4ad013beff09c452dd183b91b6b5f99d8e4c8ef4a85f8ed066
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 22, 2026.

Transparency log

Release files / duckstring_trickle-0.2.1-py3-none-any.whl

Download URL duckstring_trickle-0.2.1-py3-none-any.whl
Size 94.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
f7a55914db5bb63681050605f21beac03d309d3ddd01f46898628133307e24ab
BLAKE2b-256 checksum
How to use checksums
ad9e90e199d07c7ebd04154d37450b04188e5e4fc8f7302b50a3f220c6d02bd2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 22, 2026.

Transparency log

Security for duckstring-trickle 0.2.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 2 files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for duckstring_trickle-0.2.1.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 22, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Release history Release notifications | RSS feed

This release

0.2.1 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page