Skip to main content

Deltalake-python

PyPI userdoc apidoc

Native Delta Lake Python binding based on delta-rs with Pandas integration.

Example

from deltalake import DeltaTable
dt = DeltaTable("../rust/tests/data/delta-0.2.0")
dt.version()
3
dt.files()
['part-00000-cb6b150b-30b8-4662-ad28-ff32ddab96d2-c000.snappy.parquet',
 'part-00000-7c2deba3-1994-4fb8-bc07-d46c948aa415-c000.snappy.parquet',
 'part-00001-c373a5bd-85f0-4758-815e-7eb62007a15c-c000.snappy.parquet']

See the user guide for more examples.

Installation

# with pip
pip install deltalake
# with uv
uv add deltalake
# with poetry
poetry add deltalake

NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.

Build custom wheels

Sometimes you may wish to build custom wheels. Maybe you want to try out some unreleased features. Or maybe you want to tweak the optimization of the Rust code.

To compile the package, you will need the Rust compiler and maturin:

curl https://sh.rustup.rs -sSf | sh -s

Then you can build wheels for your own platform like so:

```sh
uvx maturin build --release --out wheels

Note:

  • uvx invokes a tool without installing it.
  • if you plan to often use maturin, you can install the "tool" with uv tool install maturin.

For a build that is optimized for the system you are on (but sacrificing portability):

RUSTFLAGS="-C target-cpu=native" uvx maturin build --release --out wheels

Cross compilation

The above command only works for your current platform. To create wheels for other platforms, you'll need to cross compile. Cross compilation requires installing two additional components: to cross compile Rust code, you will need to install the target with rustup; to cross compile the Python bindings, you will need to install ziglang.

The following example is for manylinux2014. Other targets will require different Rust target and Python compatibility tags.

rustup target add x86_64-unknown-linux-gnu

Then you can build wheels for the target platform like so:

uvx --from 'maturin[zig]' maturin build --release --zig \
    --target x86_64-unknown-linux-gnu \
    --compatibility manylinux2014 \
    --out wheels

If you expect to only run on more modern system, you can set a newer target-cpu flag to Rust and use a newer compatibility tag for Linux. For example, here we set compatibility with CPUs newer than Haswell (2013) and Linux OS with glibc version of at least 2.24:

RUSTFLAGS="-C target-cpu=haswell" uvx --from 'maturin[zig]' maturin build --release --zig \
    --target x86_64-unknown-linux-gnu \
    --compatibility manylinux_2_24 \
    --out wheels

See note about RUSTFLAGS from the arrow-rs readme.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

deltalake-1.1.1-cp39-abi3-win_amd64.whl (42.9 MB view details)

Uploaded CPython 3.9+Windows x86-64

deltalake-1.1.1-cp39-abi3-macosx_11_0_arm64.whl (39.1 MB view details)

Uploaded CPython 3.9+macOS 11.0+ ARM64

deltalake-1.1.1-cp39-abi3-macosx_10_12_x86_64.whl (42.0 MB view details)

Uploaded CPython 3.9+macOS 10.12+ x86-64

File details

Details for the file deltalake-1.1.1-cp39-abi3-win_amd64.whl.

File metadata

  • Download URL: deltalake-1.1.1-cp39-abi3-win_amd64.whl
  • Upload date:
  • Size: 42.9 MB
  • Tags: CPython 3.9+, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: maturin/1.9.1

File hashes

Hashes for deltalake-1.1.1-cp39-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 35a745e6f9721f1df4144fa51f78cb1f8359dcc0e700245058784d80251b7a7b
MD5 47751f4d6c2c5f78e87cca68cb605e8e
BLAKE2b-256 5d3cc694fbc7e3689e94093a1d028d6117559815d2d459a62ccc79c7ee7c0564

See more details on using hashes here.

File details

Details for the file deltalake-1.1.1-cp39-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.1-cp39-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 ee0b497e038e6c891591b4353cdd4e9720abd87bb4b05ec382e5cbc366ad6ef9
MD5 f7a90aa870c07629b9471ec8e7a185ce
BLAKE2b-256 e5582f93726969c61eef6627a171137b6661ea586f6a1a29917e327fea9c75c8

See more details on using hashes here.

File details

Details for the file deltalake-1.1.1-cp39-abi3-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for deltalake-1.1.1-cp39-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 f02d26164bf06c6f629e3599feb6b9d92816411c12655717cf6fe6a404f6b8c8
MD5 db1bf928a487dc2297abaf66964a1c23
BLAKE2b-256 627e5024e009dc84d5d53e6081ff912213016c1abc7646d6371924631d795584

See more details on using hashes here.

Release history Release notifications | RSS feed

1.6.3

8 files

1.6.2

7 files

1.6.1

6 files

1.6.0

7 files

1.5.1

7 files

1.5.0

7 files

1.4.2

7 files

1.4.1

7 files

1.4.0

7 files

1.3.3

7 files

1.3.2

7 files

1.3.1

7 files

1.3.0

6 files

1.2.1

7 files

1.2.0

7 files

1.1.4

8 files

1.1.3

8 files

1.1.2

7 files

This release

1.1.1 This release

3 files

1.1.0

7 files

1.0.2

7 files

1.0.1

7 files

1.0.0

7 files

0.25.5

7 files

0.25.4

7 files

0.25.2

7 files

0.25.1

6 files

0.25.0

3 files

0.24.0

6 files

0.23.2

6 files

0.23.1

6 files

0.23.0

6 files

0.22.3

6 files

0.21.0

6 files

0.20.2

6 files

0.20.1

6 files

0.20.0

6 files

0.19.2

6 files

0.19.1

6 files

0.19.0

6 files

0.18.2

6 files

0.18.1

6 files

0.18.0

6 files

0.17.4

6 files

0.17.3

6 files

0.17.2

6 files

0.17.1

6 files

0.17.0

6 files

0.16.4

6 files

0.16.3

6 files

0.16.2

6 files

0.16.1

6 files

0.16.0

6 files

0.15.3

6 files

0.15.2

6 files

0.15.1

6 files

0.15.0

6 files

0.14.0

7 files

0.13.0

7 files

0.12.0

7 files

0.11.0

7 files

0.10.2

7 files

0.10.1

6 files

0.10.0

7 files

0.9.0

7 files

0.8.1

7 files

0.8.0

7 files

0.7.0

7 files

0.6.4

6 files

0.6.3

6 files

0.6.2

6 files

0.6.1

5 files

0.6.0

6 files

0.5.8

6 files

0.5.7

5 files

0.5.6

5 files

0.5.5

4 files

0.5.4

4 files

0.5.3

4 files

0.5.2

4 files

0.5.1

4 files

0.5.0

4 files

0.4.8

3 files

0.4.7

3 files

0.4.6

3 files

0.4.5

3 files

0.4.4

3 files

0.4.3

0.4.2

0.4.1

3 files

0.4.0

3 files

0.3.0

3 files

0.2.1

3 files

0.2.0

3 files

0.1.4

12 files

0.1.3

12 files

0.1.2

8 files

0.1.1

12 files

0.1.0

13 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page