Native Delta Lake Python binding based on delta-rs with Pandas integration
Project description
Deltalake-python
Native Delta Lake Python binding based on delta-rs with Pandas integration.
Installation
pip install deltalake
NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.
Develop
Setup your local environment with virtualenv
$ make setup-venv
Activate it
$ source ./venv/bin/activate
Ready to develop with maturin
maturin is used to build the python package.
To install development version of the package into your current Python environment:
$ make develop
Build manylinux wheels
docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist
PyPI release
Publish a new GitHub release with name and tag version set to python-vx.y.z
.
This will trigger our automated release pipeline.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltalake-0.5.2.tar.gz
(4.2 MB
view hashes)
Built Distributions
Close
Hashes for deltalake-0.5.2-cp36-abi3-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 92fc0d298dcbca3679759c46d78d474008255421f34928d7b911ba2ad79d7b01 |
|
MD5 | 824146efcdadf6291f935368e65dcd73 |
|
BLAKE2b-256 | 5ac9f197be3cc27d1cf9bd749514e81ed1510c4ba722b0b4f3b6c042158b0370 |
Close
Hashes for deltalake-0.5.2-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2e5746fc41556317b0b42bea6d4afb88532142e0134c42076f9ceb83380e8fc2 |
|
MD5 | 010727605a2c46d08598100e047cc5c3 |
|
BLAKE2b-256 | 8c82e2a1665d0e522451fa049e8dcbcf7630bdacfc3e64a6bf4819dc2e22a293 |
Close
Hashes for deltalake-0.5.2-cp36-abi3-macosx_10_7_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4e54ea8e2b92f02ef5a267e952785bd5186643b3e5f57d6d3113b1ca8ce1c5bc |
|
MD5 | e0410a893202a4e691c02e501d2d7c25 |
|
BLAKE2b-256 | 1072b4722c5436c77a3cbb1be2e2976ac1fb2c78cf75ae4bbb4cc9a8185301f2 |