Skip to main content

Using Machine Learning to learn how to Compress

Project description

PyPI PyPI HitCount

Try it live at https://shrynk.ai

Usage

Installation:

pip install shrynk

Then in Python:

from shrynk.pandas import save, load
file_path = save(my_df, "mypath")
# e.g. mypath.csv.bz2
loaded_df = load(file_path)

Add your own data

If you want more control you can do the following:

import pandas as pd
from shrynk.pandas import PandasCompressor

df = pd.DataFrame({"a": [1, 2, 3]})

pdc = PandasCompressor("default")
pdc.run_benchmarks([df], save=False) # adds data to the default

pdc.train_model(size=3, write=1, read=1)

pdc.infer(df)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

shrynk-0.0.10.tar.gz (1.2 MB view hashes)

Uploaded Source

Built Distribution

shrynk-0.0.10-py2.py3-none-any.whl (1.7 MB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page