a library for automated table normalization
Project description
AutoNormalize
AutoNormalize is a Python library for automated datatable normalization, intended for use with Feature Tools. AutoNormalize allows you to build an EntitySet
from a single denormalized table and generate features for machine learning.
Before AutoNormalize:
After AutoNormalize:
Install
pip install autonormalize
Uninstall
pip uninstall autonormalize
API Reference
auto_entityset(df, accuracy=0.98, index=None, name=None, time_index=None)
Creates a normalized entityset from a dataframe.
Arguments:
df
(pd.Dataframe) : the dataframe containing data
accuracy
(0 < float <= 1.00; default = 0.98) : the accuracy threshold required in order to conclude a dependency (i.e. with accuracy = 0.98, 0.98 of the rows must hold true the dependency LHS --> RHS)
index
(str, optional) : name of column that is intended index of df
name
(str, optional) : the name of created EntitySet
time_index
(str, optional) : name of time column in the dataframe.
Returns:
entityset
(ft.EntitySet) : created entity set
find_dependencies(df, accuracy=0.98, index=None)
Finds dependencies within dataframe with the DFD search algorithm.
Returns:
dependencies
(Dependencies) : the dependencies found in the data within the contraints provided
normalize_dataframe(df, dependencies)
Normalizes dataframe based on the dependencies given. Keys for the newly created DataFrames can only be columns that are strings, ints, or categories. Keys are chosen according to the priority:
- shortest lenghts
- has "id" in some form in the name of an attribute
- has attribute furthest to left in the table
Returns:x
new_dfs
(list[pd.DataFrame]) : list of new dataframes
make_entityset(df, dependencies, name=None, time_index=None):
Creates a normalized EntitySet from dataframe based on the dependencies given. Keys are chosen in the same fashion as for normalize_dataframe
and a new index will be created if any key has more than a single attribute.
Returns:
entityset
(ft.EntitySet) : created EntitySet
Feature Labs
AutoNormalize is an open source project created by Feature Labs. To see the other open source projects we're working on visit Feature Labs Open Source. If building impactful data science pipelines is important to you or your business, please get in touch.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for autonormalize-0.1.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4fa9aa522443c8cea6a92a279b9cd9a86edf40c9ae9dfc1bb062c0df871594c2 |
|
MD5 | 499d24fd28236a3f044af3a763d438a6 |
|
BLAKE2b-256 | 04ce50344ed2083ca8e68e2ff0e16c0317e8b1e0527687919c25799fab98773d |