Skip to main content

Data prerpocess library with missing value imputation and outlier correction functions.

Project description

Team_1_library

Python library with two classes: -Automatic preprocess, with advaced functions for missing values imputations using clustering and statistical techniques, as well as outlier corrections. -Manual prerpocess, with manual column statistical imputations, numerical outlier correction, and string focused advanced functions, like normalization and correction.

Characteristics

  • Missing value imputation with clustering (K-Means).
  • Missing value imputation with statistical values (mean,median,mode).
  • Outlier detection and correction to mean with Z-score technique.
  • Empty column elimination with customizable threshold.
  • Low variance column elimination with customizable threshold.

-String normalization (lowercase and gap elimination) -String correction depending on the similarity

Usage:

The usage of this library functions are explained in the file 'USER_GUIDE.md'. An example of the use is included in the file 'example_usage.py'. We higly recommend to take a look in those files to understand the functioning of the library.

Instalation:

To install the library, navigate to the folder containing 'Team_1_library' in your preferred environment and install it using 'pip':

pip install ./path/to/the/library

Make sure you have the required dependencies installed:
```bash
pip install pandas scipy numpy scikit-learn fuzzywuzzy

 

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

team_1_library-0.1.0.tar.gz (5.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

Team_1_library-0.1.0-py3-none-any.whl (6.1 kB view details)

Uploaded Python 3

File details

Details for the file team_1_library-0.1.0.tar.gz.

File metadata

  • Download URL: team_1_library-0.1.0.tar.gz
  • Upload date:
  • Size: 5.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.5

File hashes

Hashes for team_1_library-0.1.0.tar.gz
Algorithm Hash digest
SHA256 6cd60d7d932c48bbf7cf30bbec6ccd8642741a2d309d46c16fafc386406e758f
MD5 98972cc2a108fc3ff455b8f8fd321346
BLAKE2b-256 85af0e764cb29471bd69e5fd1486de0d3a43713a9b926652fdf12bfafab7aa1f

See more details on using hashes here.

File details

Details for the file Team_1_library-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: Team_1_library-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 6.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.5

File hashes

Hashes for Team_1_library-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 c8c7bdf7eb3dee58e6e9ab485ed73dcfc2b5931c03f0b7cec1a307dea7bdb077
MD5 b17492738d074e9bf59c70925b1f259d
BLAKE2b-256 56292bc8ff9fc50435d54433049f16ed54db3b34543bb8b7fe51bf90bf062aa0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page