Skip to main content

Data prerpocess library with missing value imputation and outlier correction functions.

Project description

Team_1_library

Python library with two classes: -Automatic preprocess, with advaced functions for missing values imputations using clustering and statistical techniques, as well as outlier corrections. -Manual prerpocess, with manual column statistical imputations, numerical outlier correction, and string focused advanced functions, like normalization and correction.

Characteristics

  • Missing value imputation with clustering (K-Means).
  • Missing value imputation with statistical values (mean,median,mode).
  • Outlier detection and correction to mean with Z-score technique.
  • Empty column elimination with customizable threshold.
  • Low variance column elimination with customizable threshold.

-String normalization (lowercase and gap elimination) -String correction depending on the similarity

Usage:

The usage of this library functions are explained in the file 'USER_GUIDE.md'. An example of the use is included in the file 'example_usage.py'. We higly recommend to take a look in those files to understand the functioning of the library.

Instalation:

To install the library, navigate to the folder containing 'Team_1_library' in your preferred environment and install it using 'pip':

pip install ./path/to/the/library

Make sure you have the required dependencies installed:
```bash
pip install pandas scipy numpy scikit-learn fuzzywuzzy

 

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

team_1_library-1.0.tar.gz (5.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

Team_1_library-1.0-py3-none-any.whl (6.1 kB view details)

Uploaded Python 3

File details

Details for the file team_1_library-1.0.tar.gz.

File metadata

  • Download URL: team_1_library-1.0.tar.gz
  • Upload date:
  • Size: 5.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.5

File hashes

Hashes for team_1_library-1.0.tar.gz
Algorithm Hash digest
SHA256 09605a0198706d79079aa0dcf6f6b721aa1b81027aa1a490817bf6dc542336ed
MD5 866311de0c37a47f1aa4c4149868d161
BLAKE2b-256 7e8ea72a8b8083878ab5dc504e9cf50ab38513f7180340cb99e1af864e9ddb25

See more details on using hashes here.

File details

Details for the file Team_1_library-1.0-py3-none-any.whl.

File metadata

  • Download URL: Team_1_library-1.0-py3-none-any.whl
  • Upload date:
  • Size: 6.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.5

File hashes

Hashes for Team_1_library-1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7b4fbf0cde92a5b340016197cb886f145189c1aaee159c8ef356153a948f70b9
MD5 e43f74a9897f8fe9aac0a8a8e6df1d15
BLAKE2b-256 4c6372942d04cdfb78e2f7819684a261bf3926fff25e4fa4e437adb11dc9ed7d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page