Deltalake-python

PyPI userdoc apidoc

Native Delta Lake Python binding based on delta-rs with Pandas integration.

Example

from deltalake import DeltaTable
dt = DeltaTable("../rust/tests/data/delta-0.2.0")
dt.version()
3
dt.files()
['part-00000-cb6b150b-30b8-4662-ad28-ff32ddab96d2-c000.snappy.parquet',
 'part-00000-7c2deba3-1994-4fb8-bc07-d46c948aa415-c000.snappy.parquet',
 'part-00001-c373a5bd-85f0-4758-815e-7eb62007a15c-c000.snappy.parquet']

See the user guide for more examples.

Installation

# with pip
pip install deltalake
# with uv
uv add deltalake
# with poetry
poetry add deltalake

NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.

Build custom wheels

Sometimes you may wish to build custom wheels. Maybe you want to try out some unreleased features. Or maybe you want to tweak the optimization of the Rust code.

To compile the package, you will need the Rust compiler and maturin:

curl https://sh.rustup.rs -sSf | sh -s

Then you can build wheels for your own platform like so:

```sh
uvx maturin build --release --out wheels

Note:

  • uvx invokes a tool without installing it.
  • if you plan to often use maturin, you can install the "tool" with uv tool install maturin.

For a build that is optimized for the system you are on (but sacrificing portability):

RUSTFLAGS="-C target-cpu=native" uvx maturin build --release --out wheels

Cross compilation

The above command only works for your current platform. To create wheels for other platforms, you'll need to cross compile. Cross compilation requires installing two additional components: to cross compile Rust code, you will need to install the target with rustup; to cross compile the Python bindings, you will need to install ziglang.

The following example is for manylinux2014. Other targets will require different Rust target and Python compatibility tags.

rustup target add x86_64-unknown-linux-gnu

Then you can build wheels for the target platform like so:

uvx --from 'maturin[zig]' maturin build --release --zig \
    --target x86_64-unknown-linux-gnu \
    --compatibility manylinux2014 \
    --out wheels

If you expect to only run on more modern system, you can set a newer target-cpu flag to Rust and use a newer compatibility tag for Linux. For example, here we set compatibility with CPUs newer than Haswell (2013) and Linux OS with glibc version of at least 2.24:

RUSTFLAGS="-C target-cpu=haswell" uvx --from 'maturin[zig]' maturin build --release --zig \
    --target x86_64-unknown-linux-gnu \
    --compatibility manylinux_2_24 \
    --out wheels

See note about RUSTFLAGS from the arrow-rs readme.

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (1.6.3)

5 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for dave2008 from gravatar.com dave2008 Avatar for fvaleye from gravatar.com fvaleye Avatar for ion-elgreco from gravatar.com ion-elgreco
+2 more Avatar for rtyler from gravatar.com rtyler Avatar for wjones127 from gravatar.com wjones127

License

Apache Software License

Requires

Python >=3.9

Tags

deltalake delta datalake pandas arrow

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

deltalake-1.1.3.tar.gz (5.1 MB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

deltalake-1.1.3-cp39-abi3-win_amd64.whl (43.8 MB view details)

Uploaded CPython 3.9+Windows x86-64

deltalake-1.1.3-cp39-abi3-musllinux_1_2_x86_64.whl (45.4 MB view details)

Uploaded CPython 3.9+musllinux: musl 1.2+ x86-64

deltalake-1.1.3-cp39-abi3-manylinux_2_28_aarch64.whl (41.6 MB view details)

Uploaded CPython 3.9+manylinux: glibc 2.28+ ARM64

deltalake-1.1.3-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (53.1 MB view details)

Uploaded CPython 3.9+manylinux: glibc 2.17+ x86-64

deltalake-1.1.3-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (41.6 MB view details)

Uploaded CPython 3.9+manylinux: glibc 2.17+ ARM64

deltalake-1.1.3-cp39-abi3-macosx_11_0_arm64.whl (39.9 MB view details)

Uploaded CPython 3.9+macOS 11.0+ ARM64

deltalake-1.1.3-cp39-abi3-macosx_10_12_x86_64.whl (43.3 MB view details)

Uploaded CPython 3.9+macOS 10.12+ x86-64

File details

Details for the file deltalake-1.1.3.tar.gz.

File metadata

  • Download URL: deltalake-1.1.3.tar.gz
  • Upload date:
  • Size: 5.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: maturin/1.6.0

File hashes

Hashes for deltalake-1.1.3.tar.gz
Algorithm Hash digest
SHA256 7d3a78f91dbe6f6a6cacc7bb77ed6b7f9ac1e5c25c68fba5c42051bc515bf15c
MD5 b596928129f2fb5e8d3eda81f6b61c9e
BLAKE2b-256 ada53f781da851bebace77631ca0c8ce06f7e64919e16e076a98308f7875a677

See more details on using hashes here.

File details

Details for the file deltalake-1.1.3-cp39-abi3-win_amd64.whl.

File metadata

  • Download URL: deltalake-1.1.3-cp39-abi3-win_amd64.whl
  • Upload date:
  • Size: 43.8 MB
  • Tags: CPython 3.9+, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: maturin/1.9.2

File hashes

Hashes for deltalake-1.1.3-cp39-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 072c18f1e0c1afa01a5cde531e3e0d1e00266d5900b6d324895e43bbd36829b4
MD5 107cbdb2ba6d805042ba304e58e43275
BLAKE2b-256 c021e02b508efa4d3990d15b81671f33cf4134a344a0e438c5aba8ccbb1d1783

See more details on using hashes here.

File details

Details for the file deltalake-1.1.3-cp39-abi3-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.3-cp39-abi3-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 c56b1770011bce1f5750bf234448c32631ead82785a9efcccd225784056439eb
MD5 0475de511a13ac4381fe07093fed5696
BLAKE2b-256 5a851098f5e12af607b6afaba986063f3abbc8be77076ae50b2fab3ac7756b52

See more details on using hashes here.

File details

Details for the file deltalake-1.1.3-cp39-abi3-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.3-cp39-abi3-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 951cf477c1ad4af84c760799209ad83d936090ccf3b1f089f6be2df001addbf1
MD5 40ab91f5049b7fb6ac95cc269b7c902f
BLAKE2b-256 28ef401bffa4ed50d333c2d1a50fd98f7400d577ed6afb4457303fde8c5c7a6c

See more details on using hashes here.

File details

Details for the file deltalake-1.1.3-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.3-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 c7b2f6bf68c7ebeb45fad8d233a3ba5b998d036f95ed915dff4261f97b8efdb3
MD5 8dd32a46aa1d22be801b6cfdde78bd65
BLAKE2b-256 bbe84f081fa42491dbd6a6164b4762a6b38851c25860a990eeb6cb43167e89c5

See more details on using hashes here.

File details

Details for the file deltalake-1.1.3-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.3-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 e3314bffe28b3471defef06eb07aa8d1b184b136c3c4cf40102ac3979b885baf
MD5 c76ea2365f2d48f363814441898da32f
BLAKE2b-256 6f2b71cd80f197a07214f7fc8dd22be59cd0833560e443fa38ba2312966badfb

See more details on using hashes here.

File details

Details for the file deltalake-1.1.3-cp39-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.3-cp39-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 b4b9c8d5e721b6dc322f5fa1ed71261539ad23f3a29a33c83925422249e640b2
MD5 1e90ea881b728ee94c371da5daf1d6b6
BLAKE2b-256 573af49740e0e6f83864c6bcd130dd13de746b4d00ea561266357eabf13e6dd9

See more details on using hashes here.

File details

Details for the file deltalake-1.1.3-cp39-abi3-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.3-cp39-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 3bf336ab0fb3cec10c948f9ef56de67f72b71591e8ef3d514112ea7eabc19070
MD5 edf6d353c4de35f8520cf07401c213f9
BLAKE2b-256 325ad67fd77dd4d6e63dfa09bcbcd1e0d22b53ea31c4b0faec0cfaf57aa35919

See more details on using hashes here.

Release history Release notifications | RSS feed

1.6.3

8 files

1.6.2

7 files

1.6.1

6 files

1.6.0

7 files

1.5.1

7 files

1.5.0

7 files

1.4.2

7 files

1.4.1

7 files

1.4.0

7 files

1.3.3

7 files

1.3.2

7 files

1.3.1

7 files

1.3.0

6 files

1.2.1

7 files

1.2.0

7 files

1.1.4

8 files

This release

1.1.3 This release

8 files

1.1.2

7 files

1.1.1

3 files

1.1.0

7 files

1.0.2

7 files

1.0.1

7 files

1.0.0

7 files

0.25.5

7 files

0.25.4

7 files

0.25.2

7 files

0.25.1

6 files

0.25.0

3 files

0.24.0

6 files

0.23.2

6 files

0.23.1

6 files

0.23.0

6 files

0.22.3

6 files

0.21.0

6 files

0.20.2

6 files

0.20.1

6 files

0.20.0

6 files

0.19.2

6 files

0.19.1

6 files

0.19.0

6 files

0.18.2

6 files

0.18.1

6 files

0.18.0

6 files

0.17.4

6 files

0.17.3

6 files

0.17.2

6 files

0.17.1

6 files

0.17.0

6 files

0.16.4

6 files

0.16.3

6 files

0.16.2

6 files

0.16.1

6 files

0.16.0

6 files

0.15.3

6 files

0.15.2

6 files

0.15.1

6 files

0.15.0

6 files

0.14.0

7 files

0.13.0

7 files

0.12.0

7 files

0.11.0

7 files

0.10.2

7 files

0.10.1

6 files

0.10.0

7 files

0.9.0

7 files

0.8.1

7 files

0.8.0

7 files

0.7.0

7 files

0.6.4

6 files

0.6.3

6 files

0.6.2

6 files

0.6.1

5 files

0.6.0

6 files

0.5.8

6 files

0.5.7

5 files

0.5.6

5 files

0.5.5

4 files

0.5.4

4 files

0.5.3

4 files

0.5.2

4 files

0.5.1

4 files

0.5.0

4 files

0.4.8

3 files

0.4.7

3 files

0.4.6

3 files

0.4.5

3 files

0.4.4

3 files

Yanked

0.4.3

Yanked reason: broken linux build

Yanked

0.4.2

Yanked reason: broken linux build

0.4.1

3 files

0.4.0

3 files

0.3.0

3 files

0.2.1

3 files

0.2.0

3 files

0.1.4

12 files

0.1.3

12 files

0.1.2

8 files

0.1.1

12 files

0.1.0

13 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page