Hopefully safe and deterministic serializer to binary format, including Pandas data
Project description
lazydf - Serialization of nested objects to binary format
An alternative to pickle, but may use pickle if safety is not needed.
Principle: Start from the simplest and safest possible and try to be fast.
- try orjson
dict,str,int, etc
- try bson
- standard types accepted by mongodb
- serialize as numpy
- ndarray, pandas dataframe/series
Non-deterministic and unsafe modes (pickle) are planned for the near future.
Python installation
from package
# Set up a virtualenv.
python3 -m venv venv
source venv/bin/activate
# Install from PyPI
pip install lazydf
from source
git clone https://github.com/lazydf/lazydf
cd lazydf
poetry install
Examples
Some usage examples.
Grants
This work was partially supported by Fapesp under supervision of Prof. André C. P. L. F. de Carvalho at CEPID-CeMEAI (Grants 2013/07375-0 – 2019/01735-0).
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file lazydf-0.220726.3.tar.gz.
File metadata
- Download URL: lazydf-0.220726.3.tar.gz
- Upload date:
- Size: 17.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.3.2 CPython/3.10.6 Linux/5.15.0-58-generic
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3f587451797f4fc1e964e3f79476bb59f95dfb6392c252034fd594ae2c466bdc
|
|
| MD5 |
69add6fbfd5aee510ab0e5cba90e1355
|
|
| BLAKE2b-256 |
158f020b28a4372a699aa97a759d61bac5b526deac0406acd984c81d379bd836
|
File details
Details for the file lazydf-0.220726.3-py3-none-any.whl.
File metadata
- Download URL: lazydf-0.220726.3-py3-none-any.whl
- Upload date:
- Size: 18.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.3.2 CPython/3.10.6 Linux/5.15.0-58-generic
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6e7647c1594cbcb84416db65e9be7730d7017f8fbd76aaa428a72efa6afd57b4
|
|
| MD5 |
724495b155559098f1aa10a86aa3df10
|
|
| BLAKE2b-256 |
5560547b053bd26a999371e90fd08ca5444ba8fa8d7bcd632c243b87fd59e6bd
|
