Skip to main content

Native Polars I/O plugin for Delta Lake, backed by delta-kernel-rs.

Project description

polars-deltalake

Native Polars I/O plugin for Delta Lake, backed by delta-kernel-rs.

import polars as pl
from polars_deltalake import scan_delta

lf = scan_delta("s3://bucket/path/to/table")
df = lf.filter(pl.col("region") == "eu").select("id", "value").collect()

The plugin pushes projection, slice (n_rows), and predicate filters into the kernel scan. Predicates that don't map to a kernel-supported shape fall back to Polars-side filtering after the scan.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

polars_deltalake-1.0.0-cp310-abi3-win_amd64.whl (22.2 MB view details)

Uploaded CPython 3.10+Windows x86-64

polars_deltalake-1.0.0-cp310-abi3-musllinux_1_2_x86_64.whl (20.2 MB view details)

Uploaded CPython 3.10+musllinux: musl 1.2+ x86-64

polars_deltalake-1.0.0-cp310-abi3-musllinux_1_2_aarch64.whl (18.9 MB view details)

Uploaded CPython 3.10+musllinux: musl 1.2+ ARM64

polars_deltalake-1.0.0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (20.1 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ x86-64

polars_deltalake-1.0.0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (18.7 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ ARM64

polars_deltalake-1.0.0-cp310-abi3-macosx_11_0_arm64.whl (18.5 MB view details)

Uploaded CPython 3.10+macOS 11.0+ ARM64

polars_deltalake-1.0.0-cp310-abi3-macosx_10_13_x86_64.whl (20.0 MB view details)

Uploaded CPython 3.10+macOS 10.13+ x86-64

File details

Details for the file polars_deltalake-1.0.0-cp310-abi3-win_amd64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.0.0-cp310-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 d4164e16fa38a6cd2e9da8b7dba0e5f7f5ea2a53a788bcad522f8dc70b287ccb
MD5 8f2cbbbdaec7a90bf19b07c539f326d0
BLAKE2b-256 c5b3630c44b4f1376093fbf0be73a07590fac330c8a97faaa085576fce32a792

See more details on using hashes here.

File details

Details for the file polars_deltalake-1.0.0-cp310-abi3-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.0.0-cp310-abi3-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 805dd5445d903f8c322336b8fb4c3aa24479eb4e297b43eddd0fff5cdf05b1f2
MD5 f5d709b91b320d8cc3ad78a2772a7693
BLAKE2b-256 b50d664994d5eedad4b2c9a7dd9f3cf9a4d421914dca5ae22432dc6e54e0e11f

See more details on using hashes here.

File details

Details for the file polars_deltalake-1.0.0-cp310-abi3-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.0.0-cp310-abi3-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 50558d3820173f564c7ac2b7a6bb5fe02dfbdc6ef328853bdc94d144d0ae5a9c
MD5 9e6128350c8b78c3e010c5e879b86b2a
BLAKE2b-256 d5535753fc9d51c1f4704f54dabd3385a38334248903114191d19e9031a6f8c3

See more details on using hashes here.

File details

Details for the file polars_deltalake-1.0.0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.0.0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 e9f0bf5979a75221cec5844a5b9d6e6375412bddd1dfa0fd6608036312229c62
MD5 bb102b33d971391a3e18d9480ed05757
BLAKE2b-256 6e54ae0a11582fb783b770274148ede7abdeedc08afc822699f19ffd16bcbc79

See more details on using hashes here.

File details

Details for the file polars_deltalake-1.0.0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.0.0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 de5d238d3430302ecec739cd79bd4930c0b345ef0b294ffaac69378370480279
MD5 dcd7f8749674cc05ec986db3fbee94ec
BLAKE2b-256 2355b36fb2047f6df4b1d3185d392772211deff1de17b7fcd39cc4e92b182890

See more details on using hashes here.

File details

Details for the file polars_deltalake-1.0.0-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.0.0-cp310-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 1b56b1e378ce96bdfc6da87f79f688680dd2ff740a877e1b8c6bd5591e90ab32
MD5 61cf3cb20859639dc98ce76fbc765d0c
BLAKE2b-256 c380bf7ae88c8de0e83ddf9b878ac2c15b40d40f49432f63e35003de76c49b99

See more details on using hashes here.

File details

Details for the file polars_deltalake-1.0.0-cp310-abi3-macosx_10_13_x86_64.whl.

File metadata

File hashes

Hashes for polars_deltalake-1.0.0-cp310-abi3-macosx_10_13_x86_64.whl
Algorithm Hash digest
SHA256 5bf5590fd613398aba3fc8f675d20bd3363e777e2f791326d77fe6c14d75642b
MD5 a20fd69c12d197e450be40ab2d4d70e4
BLAKE2b-256 9b725617e98b11339f4998271a21d612052e087dd138dd401bbe769967286df9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page