Skip to main content

Data prerpocess library with missing value imputation and outlier correction functions.

Project description

Team_1_library

Python library with two classes: -Automatic preprocess, with advaced functions for missing values imputations using clustering and statistical techniques, as well as outlier corrections. -Manual prerpocess, with manual column statistical imputations, numerical outlier correction, and string focused advanced functions, like normalization and correction.

Characteristics

  • Missing value imputation with clustering (K-Means).
  • Missing value imputation with statistical values (mean,median,mode).
  • Outlier detection and correction to mean with Z-score technique.
  • Empty column elimination with customizable threshold.
  • Low variance column elimination with customizable threshold.

-String normalization (lowercase and gap elimination) -String correction depending on the similarity

Usage:

The usage of this library functions are explained in the file 'USER_GUIDE.md'. An example of the use is included in the file 'example_usage.py'. We higly recommend to take a look in those files to understand the functioning of the library.

Instalation:

To install the library, navigate to the folder containing 'Team_1_library' in your preferred environment and install it using 'pip':

pip install ./path/to/the/library

Make sure you have the required dependencies installed:
```bash
pip install pandas scipy numpy scikit-learn fuzzywuzzy

 

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

team_1_library-1.1.tar.gz (5.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

Team_1_library-1.1-py3-none-any.whl (6.1 kB view details)

Uploaded Python 3

File details

Details for the file team_1_library-1.1.tar.gz.

File metadata

  • Download URL: team_1_library-1.1.tar.gz
  • Upload date:
  • Size: 5.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.5

File hashes

Hashes for team_1_library-1.1.tar.gz
Algorithm Hash digest
SHA256 abede6e9d934a6a8d5ed4a716be759f5d0243143fc159bf3102bb4dcc77def2b
MD5 77955b4143bfb4db02a051b6482044c1
BLAKE2b-256 26ac09e976b9cfb929856f2fa70952e078a96099fde02b7f29fccec90a885253

See more details on using hashes here.

File details

Details for the file Team_1_library-1.1-py3-none-any.whl.

File metadata

  • Download URL: Team_1_library-1.1-py3-none-any.whl
  • Upload date:
  • Size: 6.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.5

File hashes

Hashes for Team_1_library-1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 db183af20a68315ce7cb476fc6394e0da2937d997aea3a77158d294675d449da
MD5 91e97568d8c4990a05d460e9dcf66a9f
BLAKE2b-256 bf7b5c436d1de8d6f092b964f9e907364f632cc024fd484567816448430ff0fa

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page