Hopefully safe and deterministic serializer to binary format, including Pandas data
Project description
lazydf - Serialization of nested objects to binary format
An alternative to pickle, but may use pickle if safety is not needed.
Principle: Start from the simplest and safest possible and try to be fast.
- try orjson
dict
,str
,int
, etc
- try bson
- standard types accepted by mongodb
- serialize as numpy
- ndarray, pandas dataframe/series
Non-deterministic and unsafe modes (pickle) are planned for the near future.
Python installation
from package
# Set up a virtualenv.
python3 -m venv venv
source venv/bin/activate
# Install from PyPI
pip install lazydf
from source
git clone https://github.com/lazydf/lazydf
cd lazydf
poetry install
Examples
Some usage examples.
Grants
This work was partially supported by Fapesp under supervision of Prof. André C. P. L. F. de Carvalho at CEPID-CeMEAI (Grants 2013/07375-0 – 2019/01735-0).
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
lazydf-0.220726.3.tar.gz
(17.9 kB
view hashes)
Built Distribution
Close
Hashes for lazydf-0.220726.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6e7647c1594cbcb84416db65e9be7730d7017f8fbd76aaa428a72efa6afd57b4 |
|
MD5 | 724495b155559098f1aa10a86aa3df10 |
|
BLAKE2b-256 | 5560547b053bd26a999371e90fd08ca5444ba8fa8d7bcd632c243b87fd59e6bd |