pd-helper 0.1.0

A helpful script to optimize a Pandas DataFrame.

pd-helper

A helpful package to streamline Pandas DataFrame optimization.

Save 50-75% on DataFrame memory usage by running the optimizer.

Auto configure dtypes for appropriate data types in each column.

Basic Usage

Given a pandas dataframe, "df":

from pd_helper.helper import optmize

if __name__ == "__main__":
   # guading function under module is necessary to run multiprocessing (save time).
   # some DataFrame, df
   df = optimize(df)

Install

pip install pd-helper

Sample Results

Starting with 175.63 MB memory.

After optmization. 

Ending with 65.33 MB memory.