Skip to main content

Native Delta Lake Python binding based on delta-rs with Pandas integration

Project description

Deltalake-python

PyPI userdoc apidoc

Native Delta Lake Python binding based on delta-rs with Pandas integration.

Installation

pip install deltalake

NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.

Develop

Setup your local environment with virtualenv

$ make setup-venv

Activate it

$ source ./venv/bin/activate

Ready to develop with maturin

maturin is used to build the python package.

To install development version of the package into your current Python environment:

$ make develop

Build manylinux wheels

docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

deltalake-0.5.1.tar.gz (4.2 MB view details)

Uploaded Source

Built Distributions

deltalake-0.5.1-cp36-abi3-win_amd64.whl (5.7 MB view details)

Uploaded CPython 3.6+Windows x86-64

deltalake-0.5.1-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (7.3 MB view details)

Uploaded CPython 3.6+manylinux: glibc 2.12+ x86-64

deltalake-0.5.1-cp36-abi3-macosx_10_7_x86_64.whl (5.9 MB view details)

Uploaded CPython 3.6+macOS 10.7+ x86-64

File details

Details for the file deltalake-0.5.1.tar.gz.

File metadata

  • Download URL: deltalake-0.5.1.tar.gz
  • Upload date:
  • Size: 4.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: maturin/0.10.6

File hashes

Hashes for deltalake-0.5.1.tar.gz
Algorithm Hash digest
SHA256 3b70db629d631982f0f103d13cde4e0b563aa517c0a9e5c59f3d16f31ecb2a92
MD5 afa36476761a71dcd50775b9fce1eeac
BLAKE2b-256 5be76adee4834f8ccd8b0315f5de880f53bf1c95aea6f806516b3df8d208a0fe

See more details on using hashes here.

File details

Details for the file deltalake-0.5.1-cp36-abi3-win_amd64.whl.

File metadata

  • Download URL: deltalake-0.5.1-cp36-abi3-win_amd64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.6+, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: maturin/0.10.6

File hashes

Hashes for deltalake-0.5.1-cp36-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 053a225130221fd9c7a80af5898d1b6099ae85f0a2c5ec83dae110a696bc547e
MD5 5ce42f05e3d462d870024947326160ff
BLAKE2b-256 0480fa4dbf607cf6d40ebc27dd6c62e82461fb8b0192a2baffbbfb7802bb8693

See more details on using hashes here.

File details

Details for the file deltalake-0.5.1-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.

File metadata

File hashes

Hashes for deltalake-0.5.1-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 add70bdcc446c52d8bb8be8429be577ec606bc38616cc36db7433487fd9651b6
MD5 4ad14d9049ce47d96f679cf142eac0a9
BLAKE2b-256 94b047008c83987924ede23a13546f033cdb9291f119f1bcc5a97cc35f640e10

See more details on using hashes here.

File details

Details for the file deltalake-0.5.1-cp36-abi3-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for deltalake-0.5.1-cp36-abi3-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 f62fdebd23529cf489a5993466ee9fc318469261b09beff6c16727b85c92e48c
MD5 27835b9d3b39ff232000209c65a9e720
BLAKE2b-256 844bab3457be20c1c9f11b6b40eef373d1c8cf6fcc7a287902101181b93a89e7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page