Deltalake-python

PyPI userdoc apidoc

Native Delta Lake Python binding based on delta-rs with Pandas integration.

Example

from deltalake import DeltaTable
dt = DeltaTable("../rust/tests/data/delta-0.2.0")
dt.version()
3
dt.files()
['part-00000-cb6b150b-30b8-4662-ad28-ff32ddab96d2-c000.snappy.parquet',
 'part-00000-7c2deba3-1994-4fb8-bc07-d46c948aa415-c000.snappy.parquet',
 'part-00001-c373a5bd-85f0-4758-815e-7eb62007a15c-c000.snappy.parquet']

See the user guide for more examples.

Installation

# with pip
pip install deltalake
# with uv
uv add deltalake
# with poetry
poetry add deltalake

NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.

Build custom wheels

Sometimes you may wish to build custom wheels. Maybe you want to try out some unreleased features. Or maybe you want to tweak the optimization of the Rust code.

To compile the package, you will need the Rust compiler and maturin:

curl https://sh.rustup.rs -sSf | sh -s

Then you can build wheels for your own platform like so:

```sh
uvx maturin build --release --out wheels

Note:

  • uvx invokes a tool without installing it.
  • if you plan to often use maturin, you can install the "tool" with uv tool install maturin.

For a build that is optimized for the system you are on (but sacrificing portability):

RUSTFLAGS="-C target-cpu=native" uvx maturin build --release --out wheels

Cross compilation

The above command only works for your current platform. To create wheels for other platforms, you'll need to cross compile. Cross compilation requires installing two additional components: to cross compile Rust code, you will need to install the target with rustup; to cross compile the Python bindings, you will need to install ziglang.

The following example is for manylinux2014. Other targets will require different Rust target and Python compatibility tags.

rustup target add x86_64-unknown-linux-gnu

Then you can build wheels for the target platform like so:

uvx --from 'maturin[zig]' maturin build --release --zig \
    --target x86_64-unknown-linux-gnu \
    --compatibility manylinux2014 \
    --out wheels

If you expect to only run on more modern system, you can set a newer target-cpu flag to Rust and use a newer compatibility tag for Linux. For example, here we set compatibility with CPUs newer than Haswell (2013) and Linux OS with glibc version of at least 2.24:

RUSTFLAGS="-C target-cpu=haswell" uvx --from 'maturin[zig]' maturin build --release --zig \
    --target x86_64-unknown-linux-gnu \
    --compatibility manylinux_2_24 \
    --out wheels

See note about RUSTFLAGS from the arrow-rs readme.

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (1.6.3)

5 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for dave2008 from gravatar.com dave2008 Avatar for fvaleye from gravatar.com fvaleye Avatar for ion-elgreco from gravatar.com ion-elgreco
+2 more Avatar for rtyler from gravatar.com rtyler Avatar for wjones127 from gravatar.com wjones127

License

Apache Software License

Requires

Python >=3.9

Tags

deltalake delta datalake pandas arrow

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

deltalake-1.1.4.tar.gz (5.1 MB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

deltalake-1.1.4-cp39-abi3-win_amd64.whl (43.9 MB view details)

Uploaded CPython 3.9+Windows x86-64

deltalake-1.1.4-cp39-abi3-musllinux_1_2_x86_64.whl (45.4 MB view details)

Uploaded CPython 3.9+musllinux: musl 1.2+ x86-64

deltalake-1.1.4-cp39-abi3-manylinux_2_28_aarch64.whl (41.8 MB view details)

Uploaded CPython 3.9+manylinux: glibc 2.28+ ARM64

deltalake-1.1.4-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (53.1 MB view details)

Uploaded CPython 3.9+manylinux: glibc 2.17+ x86-64

deltalake-1.1.4-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (41.8 MB view details)

Uploaded CPython 3.9+manylinux: glibc 2.17+ ARM64

deltalake-1.1.4-cp39-abi3-macosx_11_0_arm64.whl (39.9 MB view details)

Uploaded CPython 3.9+macOS 11.0+ ARM64

deltalake-1.1.4-cp39-abi3-macosx_10_12_x86_64.whl (43.3 MB view details)

Uploaded CPython 3.9+macOS 10.12+ x86-64

File details

Details for the file deltalake-1.1.4.tar.gz.

File metadata

  • Download URL: deltalake-1.1.4.tar.gz
  • Upload date:
  • Size: 5.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: maturin/1.6.0

File hashes

Hashes for deltalake-1.1.4.tar.gz
Algorithm Hash digest
SHA256 2e978950d420e050bbdcb5f62e3be93d331cb516ab4c9b1694cf1a7887c63e25
MD5 d78a7d644a006e617ab65b26646e7442
BLAKE2b-256 3b04b905b40ac511155944c25bd0c541a9b82d456ee35e7859be25e788ae8bff

See more details on using hashes here.

File details

Details for the file deltalake-1.1.4-cp39-abi3-win_amd64.whl.

File metadata

  • Download URL: deltalake-1.1.4-cp39-abi3-win_amd64.whl
  • Upload date:
  • Size: 43.9 MB
  • Tags: CPython 3.9+, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: maturin/1.9.3

File hashes

Hashes for deltalake-1.1.4-cp39-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 62ad8443cda6ec7b826c1bfe7e935d02df86670d8c7c1d9909744f07cb20a887
MD5 326334852cf010aadb588c7a4a0a24f3
BLAKE2b-256 b89f3e8218adab1e8681c9de1835a8a08592214e5e0da4d1e220f59c20112b00

See more details on using hashes here.

File details

Details for the file deltalake-1.1.4-cp39-abi3-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.4-cp39-abi3-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 fe441bf4e81df7ff8d9069677cd9e8e9e2e7020ec80bed2f7feefba617f3c2f9
MD5 164e85f76cd1dce7e77205781c8b1318
BLAKE2b-256 65956e7a30c3d97593539411c3afb2331f0ed9e4c8115bea540ddd23a6b9155e

See more details on using hashes here.

File details

Details for the file deltalake-1.1.4-cp39-abi3-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.4-cp39-abi3-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 17986efcf450ba54245d8cb41a947434ebb1a866e8746129075d49c504300cd9
MD5 711b21c817db37c0b62e78f5e98c529a
BLAKE2b-256 92e36a2a8ea39e16441825f7348a1d130653415c85a59355ee064dc5f0932f22

See more details on using hashes here.

File details

Details for the file deltalake-1.1.4-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.4-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 7f28480d3a19f93a75687a1a2a4449b3a6b7355243b765e4379f501dcac03eea
MD5 90126fc12bddeaaf0aea591cc1b1c8bb
BLAKE2b-256 240024dbce2a5c13c69b04dba718e64e4f74d5882ac94350228a004a27e5975c

See more details on using hashes here.

File details

Details for the file deltalake-1.1.4-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.4-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 af269b95fc858134a051fd08da294e8a3d64301f61f99ed0c54269fc6c177c6e
MD5 9aab1c82cc1e47ab6c2b4f41f53aec2d
BLAKE2b-256 d69418f5cf3d50a1aca6759f1e61ad23608bbd1aa3bfe2fc247858c5a1367cc6

See more details on using hashes here.

File details

Details for the file deltalake-1.1.4-cp39-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.4-cp39-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 8ad7d2a19b5e76aad43ea359305c892b014bc07f85e71beb95b6e9c672d116ee
MD5 227b9ffd96ac55a7e91ebf65b622c8df
BLAKE2b-256 713ed1fc3685a3414e61a764a0698df5342f67f28b102387cc4482cfc5544518

See more details on using hashes here.

File details

Details for the file deltalake-1.1.4-cp39-abi3-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.4-cp39-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 2fb21d2405928db57c56f9b459b5d0cec9cdbbcb882bfea1de1e98d9dc6c9f3d
MD5 b70f76050cf4ad3d2255176468b6cc65
BLAKE2b-256 8de8aaf28573d6c29faccd69a55763aab77c33ef383122e5e57b90f4bb1b65d5

See more details on using hashes here.

Release history Release notifications | RSS feed

1.6.3

8 files

1.6.2

7 files

1.6.1

6 files

1.6.0

7 files

1.5.1

7 files

1.5.0

7 files

1.4.2

7 files

1.4.1

7 files

1.4.0

7 files

1.3.3

7 files

1.3.2

7 files

1.3.1

7 files

1.3.0

6 files

1.2.1

7 files

1.2.0

7 files

This release

1.1.4 This release

8 files

1.1.3

8 files

1.1.2

7 files

1.1.1

3 files

1.1.0

7 files

1.0.2

7 files

1.0.1

7 files

1.0.0

7 files

0.25.5

7 files

0.25.4

7 files

0.25.2

7 files

0.25.1

6 files

0.25.0

3 files

0.24.0

6 files

0.23.2

6 files

0.23.1

6 files

0.23.0

6 files

0.22.3

6 files

0.21.0

6 files

0.20.2

6 files

0.20.1

6 files

0.20.0

6 files

0.19.2

6 files

0.19.1

6 files

0.19.0

6 files

0.18.2

6 files

0.18.1

6 files

0.18.0

6 files

0.17.4

6 files

0.17.3

6 files

0.17.2

6 files

0.17.1

6 files

0.17.0

6 files

0.16.4

6 files

0.16.3

6 files

0.16.2

6 files

0.16.1

6 files

0.16.0

6 files

0.15.3

6 files

0.15.2

6 files

0.15.1

6 files

0.15.0

6 files

0.14.0

7 files

0.13.0

7 files

0.12.0

7 files

0.11.0

7 files

0.10.2

7 files

0.10.1

6 files

0.10.0

7 files

0.9.0

7 files

0.8.1

7 files

0.8.0

7 files

0.7.0

7 files

0.6.4

6 files

0.6.3

6 files

0.6.2

6 files

0.6.1

5 files

0.6.0

6 files

0.5.8

6 files

0.5.7

5 files

0.5.6

5 files

0.5.5

4 files

0.5.4

4 files

0.5.3

4 files

0.5.2

4 files

0.5.1

4 files

0.5.0

4 files

0.4.8

3 files

0.4.7

3 files

0.4.6

3 files

0.4.5

3 files

0.4.4

3 files

Yanked

0.4.3

Yanked reason: broken linux build

Yanked

0.4.2

Yanked reason: broken linux build

0.4.1

3 files

0.4.0

3 files

0.3.0

3 files

0.2.1

3 files

0.2.0

3 files

0.1.4

12 files

0.1.3

12 files

0.1.2

8 files

0.1.1

12 files

0.1.0

13 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page