Skip to main content

polars-deltalake

Native Polars I/O plugin for Delta Lake, backed by delta-kernel-rs.

import polars as pl
from polars_deltalake import scan_delta

lf = scan_delta("s3://bucket/path/to/table")
df = lf.filter(pl.col("region") == "eu").select("id", "value").collect()

The plugin pushes projection, slice (n_rows), and predicate filters into the kernel scan. Predicates that don't map to a kernel-supported shape fall back to Polars-side filtering after the scan.

scan_cdf streams a Delta table's Change Data Feed as a LazyFrame between two commit versions:

from polars_deltalake import scan_cdf

lf = scan_cdf("s3://bucket/path/to/table", start_version=10, end_version=20)
df = lf.filter(pl.col("_change_type") == "update_postimage").collect()

Output rows carry the table's columns plus _change_type, _commit_version, and _commit_timestamp. Requires delta.enableChangeDataFeed = true on the table.

Metadata

Release files for polars-deltalake 1.3.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for polars-deltalake 1.3.0
File
polars_deltalake-1.3.0-cp310-abi3-win_amd64.whl CPython 3.10 abi3 Windows x86-64 Details
polars_deltalake-1.3.0-cp310-abi3-musllinux_1_2_x86_64.whl CPython 3.10 abi3 Linux musl 1.2+ x86-64 Details
polars_deltalake-1.3.0-cp310-abi3-musllinux_1_2_aarch64.whl CPython 3.10 abi3 Linux musl 1.2+ ARM64 Details
polars_deltalake-1.3.0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.10 abi3 Linux glibc 2.17+ x86-64 Details
polars_deltalake-1.3.0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl CPython 3.10 abi3 Linux glibc 2.17+ ARM64 Details
polars_deltalake-1.3.0-cp310-abi3-macosx_11_0_arm64.whl CPython 3.10 abi3 macOS 11.0+ ARM64 Details
polars_deltalake-1.3.0-cp310-abi3-macosx_10_13_x86_64.whl CPython 3.10 abi3 macOS 10.13+ x86-64 Details

Total release size: 152.3 MB

Release files / polars_deltalake-1.3.0-cp310-abi3-win_amd64.whl

Download URL polars_deltalake-1.3.0-cp310-abi3-win_amd64.whl
Size 23.5 MB
Tags CPython 3.10 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
d1d9f3cab82c9eaa97c12f94b08f9137ad8fbfbfe2c72a65425f95150e2e9fb5
BLAKE2b-256 checksum
How to use checksums
1046f30c14950395129993a42301148e4fd0043e61ee8a472ce8606cdbc0df43
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via maturin/1.15.0

Release files / polars_deltalake-1.3.0-cp310-abi3-musllinux_1_2_x86_64.whl

Download URL polars_deltalake-1.3.0-cp310-abi3-musllinux_1_2_x86_64.whl
Size 22.3 MB
Tags CPython 3.10 Linux musl 1.2+ x86-64 abi3
SHA-256 checksum
How to use checksums
5678061b9299dab788d840c4604cda74eb1a978dac632df881eb37b36fb6d414
BLAKE2b-256 checksum
How to use checksums
8a12210c40080e10d11568c07f614833fa1352580e2d3de5ecbfb3a366eec19d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via maturin/1.15.0

Release files / polars_deltalake-1.3.0-cp310-abi3-musllinux_1_2_aarch64.whl

Download URL polars_deltalake-1.3.0-cp310-abi3-musllinux_1_2_aarch64.whl
Size 21.0 MB
Tags CPython 3.10 Linux musl 1.2+ ARM64 abi3
SHA-256 checksum
How to use checksums
0517df9e649820df14b077bc6a442a6529c0c85986ac438ffd2c4ad25aade9ad
BLAKE2b-256 checksum
How to use checksums
bd36838b33d5b9dff0077cf482eb76d101d97a5d5e7aae6941d3e7e48a0e4156
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via maturin/1.15.0

Release files / polars_deltalake-1.3.0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL polars_deltalake-1.3.0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 22.2 MB
Tags CPython 3.10 Linux glibc 2.17+ x86-64 abi3
SHA-256 checksum
How to use checksums
0cddcf92da74b93311997fc687a907f69d52747d5804f0fb9911acf76ccd3c0b
BLAKE2b-256 checksum
How to use checksums
d7e81594c84104c52c9e8eb87817c444009986ad975467597909c5c5cdc8e95c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via maturin/1.15.0

Release files / polars_deltalake-1.3.0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL polars_deltalake-1.3.0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 20.8 MB
Tags CPython 3.10 Linux glibc 2.17+ ARM64 abi3
SHA-256 checksum
How to use checksums
1f9c3a481f62d91df7016bebaeea475dce04a60c744c08c90ab8d308b8d103ca
BLAKE2b-256 checksum
How to use checksums
1c842d5cdf08986e7972fc61d44795c400b28d7c9cd3af15f68d6d5b356db06a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via maturin/1.15.0

Release files / polars_deltalake-1.3.0-cp310-abi3-macosx_11_0_arm64.whl

Download URL polars_deltalake-1.3.0-cp310-abi3-macosx_11_0_arm64.whl
Size 20.5 MB
Tags CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
514145cd518958eb6aa51c7d9e2e515ea240bd00968a06e16dbb04dc22f32da3
BLAKE2b-256 checksum
How to use checksums
b4286f38692b17ec7792bc7759ea9d448a5bc4352de2eb29e584d6285338d842
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via maturin/1.15.0

Release files / polars_deltalake-1.3.0-cp310-abi3-macosx_10_13_x86_64.whl

Download URL polars_deltalake-1.3.0-cp310-abi3-macosx_10_13_x86_64.whl
Size 22.1 MB
Tags CPython 3.10 abi3 macOS 10.13+ x86-64
SHA-256 checksum
How to use checksums
fad25600a7ccd9b4617328e1053309c95e2d2cd601f6a1527484526026b7827e
BLAKE2b-256 checksum
How to use checksums
10a88c579ee1cb5eb111cf4e11f4fb5979ba11b55a9ea2a88c2d3cbf91043eb2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via maturin/1.15.0

Release history Release notifications | RSS feed

1.3.1

7 release files

This release

1.3.0 This release

7 release files

1.2.3

7 release files

1.2.2

7 release files

1.2.1

7 release files

1.2.0

7 release files

1.1.1

7 release files

1.1.0

7 release files

1.0.0

7 release files

0.2.0

8 release files

0.1.0

41 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page