Skip to main content

Native Polars I/O plugin for Delta Lake, backed by delta-kernel-rs.

Project description

polars-deltalake

Native Polars I/O plugin for Delta Lake, backed by delta-kernel-rs.

import polars as pl
from polars_deltalake import scan_delta

lf = scan_delta("s3://bucket/path/to/table")
df = lf.filter(pl.col("region") == "eu").select("id", "value").collect()

The plugin pushes projection, slice (n_rows), and predicate filters into the kernel scan. Predicates that don't map to a kernel-supported shape fall back to Polars-side filtering after the scan.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

polars_deltalake-1.1.1-cp310-abi3-win_amd64.whl (22.2 MB view details)

Uploaded CPython 3.10+Windows x86-64

polars_deltalake-1.1.1-cp310-abi3-musllinux_1_2_x86_64.whl (20.2 MB view details)

Uploaded CPython 3.10+musllinux: musl 1.2+ x86-64

polars_deltalake-1.1.1-cp310-abi3-musllinux_1_2_aarch64.whl (18.9 MB view details)

Uploaded CPython 3.10+musllinux: musl 1.2+ ARM64

polars_deltalake-1.1.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (20.1 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ x86-64

polars_deltalake-1.1.1-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (18.7 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ ARM64

polars_deltalake-1.1.1-cp310-abi3-macosx_11_0_arm64.whl (18.5 MB view details)

Uploaded CPython 3.10+macOS 11.0+ ARM64

polars_deltalake-1.1.1-cp310-abi3-macosx_10_13_x86_64.whl (20.0 MB view details)

Uploaded CPython 3.10+macOS 10.13+ x86-64

File details

Details for the file polars_deltalake-1.1.1-cp310-abi3-win_amd64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.1.1-cp310-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 b0eb603f03e6bd39d84904328b57132a524e6309e89c9ee5c387b04ab154bc50
MD5 c77e5d0f27ecdb8c1247e7c7dffd2102
BLAKE2b-256 0a862e55c54ab44558d5bebc88c5a4ce6afe55fc4bc4ba821e534cc57e8c06b3

See more details on using hashes here.

File details

Details for the file polars_deltalake-1.1.1-cp310-abi3-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.1.1-cp310-abi3-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 49cdf4a0b93e74ac592304017319f292cca1c6954d9e0b1e395b2d2829cb250b
MD5 8d0f2a00ce77e963427ffc84308f23e9
BLAKE2b-256 c39c2bf2d95c420483f6f35b5431f8db9e871dabc9fd4761f47c00cfc302c68f

See more details on using hashes here.

File details

Details for the file polars_deltalake-1.1.1-cp310-abi3-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.1.1-cp310-abi3-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 a4ccf1c30b98cd4964d2a33f7672038f225aa76ec9fdf96e67e0376e175246f5
MD5 05efeaaeade113f1e30a40f79755d618
BLAKE2b-256 a8dede7f5230eb1dfe6e8513dd4546f79daa81b4f857f16ca9fc55a4a9344e7f

See more details on using hashes here.

File details

Details for the file polars_deltalake-1.1.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.1.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 7156f3cae3b21597b9c55da89a334e4f1bda53ff058f8fa38b85eaa04740d67a
MD5 efe2f3d95c4942af4f5ab5bfbd510b8a
BLAKE2b-256 28acaee519c3d6ecbe551ebcbf39401dccbcef5149339c7dd373223a9c68f133

See more details on using hashes here.

File details

Details for the file polars_deltalake-1.1.1-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.1.1-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 5e97b0a86ea8e7fca7a6b50308405b99cf7b8dc7c38dc32de904ec216e631d0a
MD5 b655fac43c25b17a4554af34283a3d66
BLAKE2b-256 e2bdd433043b82b163312d6d6b61e5d90717524abe801254b921f9a348c3b740

See more details on using hashes here.

File details

Details for the file polars_deltalake-1.1.1-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.1.1-cp310-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 2bb195b8e509cbe6d35db063af3af6d9538e34cf9ee0becca3cb736429b155e7
MD5 60f9bb6122536ef386434bed9b69df4a
BLAKE2b-256 b9c2f90c50ddc253242db9cc38cc8ce05f4d27fa31599faa7d9099cdd6e1ef3f

See more details on using hashes here.

File details

Details for the file polars_deltalake-1.1.1-cp310-abi3-macosx_10_13_x86_64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.1.1-cp310-abi3-macosx_10_13_x86_64.whl
Algorithm Hash digest
SHA256 1a9f98c71b8547e632d8d8ea777848fa8140ef24054921af2ba8064edf1d1f5a
MD5 396c04244b147eb3064bec0cced9ecae
BLAKE2b-256 8dcc99034e85597f1ea6c892d3fc513699d681b8d1e9525658f5fd901ef51a7f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page