Hopefully safe and deterministic serializer to binary format, including Pandas data
Project description
lazydf - Serialization of nested objects to binary format
An alternative to pickle, but may use pickle if safety is not needed.
Principle: Start from the simplest and safest possible and try to be fast.
- try orjson
dict
,str
,int
, etc
- try bson
- standard types accepted by mongodb
- serialize as numpy
- ndarray, pandas dataframe/series
Non-deterministic and unsafe modes (pickle) are planned for the near future.
Python installation
from package
# Set up a virtualenv.
python3 -m venv venv
source venv/bin/activate
# Install from PyPI
pip install lazydf
from source
git clone https://github.com/lazydf/lazydf
cd lazydf
poetry install
Examples
Some usage examples.
Grants
This work was partially supported by Fapesp under supervision of Prof. André C. P. L. F. de Carvalho at CEPID-CeMEAI (Grants 2013/07375-0 – 2019/01735-0).
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
lazydf-0.220725.4.tar.gz
(17.7 kB
view hashes)
Built Distribution
Close
Hashes for lazydf-0.220725.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 40f51c6689bd85e4d82d1c7b073e5b08fa197b5c2366f118f08d52180c74e4f2 |
|
MD5 | 75efd44d4f3b150eeae4ce03a5f34bf4 |
|
BLAKE2b-256 | 43e19f398709ec372a40f21a29c8ae25d37e8937a26c339dd8f8ad9aab02d9ba |