lazydf 0.220726.1

Hopefully safe and deterministic serializer to binary format, including Pandas data

lazydf - Serialization of nested objects to binary format

An alternative to pickle, but may use pickle if safety is not needed.

Principle: Start from the simplest and safest possible and try to be fast.

• try orjson
  • dict, str, int, etc
• try bson
  • standard types accepted by mongodb
• serialize as numpy
  • ndarray, pandas dataframe/series

Non-deterministic and unsafe modes (pickle) are planned for the near future.

Python installation

from package

# Set up a virtualenv. 
python3 -m venv venv
source venv/bin/activate

# Install from PyPI
pip install lazydf

from source

git clone https://github.com/lazydf/lazydf
cd lazydf
poetry install

Examples

Some usage examples.

Grants

This work was partially supported by Fapesp under supervision of Prof. André C. P. L. F. de Carvalho at CEPID-CeMEAI (Grants 2013/07375-0 – 2019/01735-0).