data-steps 0.1.1

Simple tool for data transformation

data-steps

This projects provides a minmal framework to organize data transformations in pandas.

It is intended to be used in both notebooks and code files.

The main idea is to provide a simple decorator syntax that is easy to maintains when data transfromation steps get changed or added throughout the project. A prime example is data cleaning where only later in the project some required cleaning steps become apparent

Usage

Wrap your data in an instance

from data_steps import DataSteps

my_data = DataSteps(my_pandas_df)

#register transformation steps

@my_data.step
def data_transformation(data):
    #transfromation steps
    ...
    return transformed data

#access original data
my_data.original

#access data after all transformation steps
my_data.transformed

#get an overview of the registered steps
my_data.steps

#only execute some steps to help debugging transformations
my_data.partial_transform(0)

History

0.0.1 (2021-01-31)

• First release on PyPi.

0.1.0 (2021-02-11)

• Changed step decorator to work in bare format, i.e. <instance>.step instead of <instance>.step()