Hopefully safe and deterministic serializer to binary format, including Pandas data
Project description
lazydf - Serialization of nested objects to binary format
An alternative to pickle, but may use pickle if safety is not needed.
Principle: Start from the simplest and safest possible and try to be fast.
- try orjson
dict
,str
,int
, etc
- try bson
- standard types accepted by mongodb
- serialize as numpy
- ndarray, pandas dataframe/series
Non-deterministic and unsafe modes (pickle) are planned for the near future.
Python installation
from package
# Set up a virtualenv.
python3 -m venv venv
source venv/bin/activate
# Install from PyPI
pip install lazydf
from source
git clone https://github.com/lazydf/lazydf
cd lazydf
poetry install
Examples
Some usage examples.
Grants
This work was partially supported by Fapesp under supervision of Prof. André C. P. L. F. de Carvalho at CEPID-CeMEAI (Grants 2013/07375-0 – 2019/01735-0).
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
lazydf-0.220725.3.tar.gz
(17.7 kB
view hashes)
Built Distribution
Close
Hashes for lazydf-0.220725.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f6eebeb49c640f3fa9d54e7048baf82f48e01f7bbcb72dca14d21f7b95303198 |
|
MD5 | d9335f6cc86af6c2df2fabcc67ebc7ec |
|
BLAKE2b-256 | a4797efd41fb7099a390863cb1c243c205c80f424af9481502eabb6abb48342c |