polars-deltalake
Native Polars I/O plugin for Delta Lake, backed by delta-kernel-rs.
import polars as pl
from polars_deltalake import scan_delta
lf = scan_delta("s3://bucket/path/to/table")
df = lf.filter(pl.col("region") == "eu").select("id", "value").collect()
The plugin pushes projection, slice (n_rows), and predicate filters into the kernel scan. Predicates that don't map to a kernel-supported shape fall back to Polars-side filtering after the scan.
scan_cdf streams a Delta table's Change Data Feed as a LazyFrame between two commit versions:
from polars_deltalake import scan_cdf
lf = scan_cdf("s3://bucket/path/to/table", start_version=10, end_version=20)
df = lf.filter(pl.col("_change_type") == "update_postimage").collect()
Output rows carry the table's columns plus _change_type, _commit_version, and _commit_timestamp. Requires delta.enableChangeDataFeed = true on the table.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distributions
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file polars_deltalake-1.2.3-cp310-abi3-win_amd64.whl.
File metadata
- Download URL: polars_deltalake-1.2.3-cp310-abi3-win_amd64.whl
- Upload date:
- Size: 21.7 MB
- Tags: CPython 3.10+, Windows x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
maturin/1.14.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
044912a420565f91ab2792456e94fce54941c357b1c6034904b9c50787c7bdc3
|
|
| MD5 |
1c70b2c201af99649f23415dfeb33570
|
|
| BLAKE2b-256 |
44eebccf80fff61f414ee0acabb5ddd1aebbd71403418fdead13bcb85d1de168
|
File details
Details for the file polars_deltalake-1.2.3-cp310-abi3-musllinux_1_2_x86_64.whl.
File metadata
- Download URL: polars_deltalake-1.2.3-cp310-abi3-musllinux_1_2_x86_64.whl
- Upload date:
- Size: 19.7 MB
- Tags: CPython 3.10+, musllinux: musl 1.2+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
maturin/1.14.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4487ab6d683adc7858015684e9abcd3b6d100e9735b14dc49d75b8d9e7260f6e
|
|
| MD5 |
a0ab00d03330a680627a596a7e91f420
|
|
| BLAKE2b-256 |
ed9a6fffe9e860f143dfea10a654f4ac8e24cdceb10ef3f9fccdf7a003e23a70
|
File details
Details for the file polars_deltalake-1.2.3-cp310-abi3-musllinux_1_2_aarch64.whl.
File metadata
- Download URL: polars_deltalake-1.2.3-cp310-abi3-musllinux_1_2_aarch64.whl
- Upload date:
- Size: 18.7 MB
- Tags: CPython 3.10+, musllinux: musl 1.2+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
maturin/1.14.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a69fbf1c09e8f5fdd4b3cd9ea1b6be7a0f5fd3680aae1235b54ced293e35dc22
|
|
| MD5 |
61fbb696a1a9fb036121e6e0a6044efc
|
|
| BLAKE2b-256 |
f76a54f1624348c2703720523c7c47bc16d827ae44e3d7b05a3103a07d013c5d
|
File details
Details for the file polars_deltalake-1.2.3-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.
File metadata
- Download URL: polars_deltalake-1.2.3-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 19.7 MB
- Tags: CPython 3.10+, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
maturin/1.14.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e17a817f5fc5f1e452dc6476201fca065ffbda5f0c3efd828d6c0e66322b8def
|
|
| MD5 |
2a808716600becac07e3240ec8cd59bd
|
|
| BLAKE2b-256 |
cd2efc22b70021d5bbb58657cb3841631ffd44db0c8b1f207a1555cbcbac746d
|
File details
Details for the file polars_deltalake-1.2.3-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.
File metadata
- Download URL: polars_deltalake-1.2.3-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
- Upload date:
- Size: 18.4 MB
- Tags: CPython 3.10+, manylinux: glibc 2.17+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
maturin/1.14.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8d45c346d2b468490e1a627062e538491afec0d5df411ed17454e26ffc3eb6bf
|
|
| MD5 |
83fe406367a87e09fcdda29b1c6a8bc4
|
|
| BLAKE2b-256 |
104257d99cd1bf8cac5e9f8de428ba62c4b89b80cfbf5130f43871e47e3acd2e
|
File details
Details for the file polars_deltalake-1.2.3-cp310-abi3-macosx_11_0_arm64.whl.
File metadata
- Download URL: polars_deltalake-1.2.3-cp310-abi3-macosx_11_0_arm64.whl
- Upload date:
- Size: 18.7 MB
- Tags: CPython 3.10+, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
maturin/1.14.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4faaa3c7d308193f9584eee7e257866c4b7534910b141a1f6d47a3bdb771f130
|
|
| MD5 |
915ec49c50758e07477b3a29d1b27808
|
|
| BLAKE2b-256 |
c42410ca88eeca6b4aeb2df2158e8aa57e538d73ca93355e9e4e5101c4845701
|
File details
Details for the file polars_deltalake-1.2.3-cp310-abi3-macosx_10_13_x86_64.whl.
File metadata
- Download URL: polars_deltalake-1.2.3-cp310-abi3-macosx_10_13_x86_64.whl
- Upload date:
- Size: 20.1 MB
- Tags: CPython 3.10+, macOS 10.13+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
maturin/1.14.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
db2ee96b694386bce2b8be023334fe184412fd5c1cf0b8f98e1120ee57074a53
|
|
| MD5 |
250b9ba6f3c8bd24af2782acb96115af
|
|
| BLAKE2b-256 |
785ab12489cd562ff09a3f7daa2d692352bf191549ee5f4e1ba7d6f0eab2641f
|
