Skip to main content

A data preprocessing library

Project description

Data Preprocessing Library This library provides a set of functions for preprocessing data in pandas DataFrames.

Installation You can install this package using pip:

pip install data-preprocessing

Usage

To use this library, simply import the DataPreprocessor class from the data_preprocess module and instantiate it with a pandas DataFrame. You can then call various methods of the DataPreprocessor class to preprocess the data.

Here's an example of how to use this library:

import pandas as pd
from auto_preprocess.data_preprocess import DataPreprocessor

# Load data into a pandas DataFrame
df = pd.read_csv("my_data.csv")

# Preprocess the data using the DataPreprocessor class
preprocessor = DataPreprocessor(df)
preprocessor.remove_outliers()
preprocessor.scale(scaler_type='standard')
preprocessor.label_encode()
preprocessor.impute(method='mean')
preprocessor.drop()
preprocessed_df = preprocessor.df

Use the preprocessed data as needed

Functions This library provides the following functions for preprocessing data:

  • remove_outliers(): Removes outliers from all numeric columns in the DataFrame.
  • scale(scaler_type): Scales all numeric columns in the DataFrame using either a standard scaler or a min-max scaler.
  • label_encode(): Encodes all columns with binary categories using label encoding.
  • impute(method): Fills all columns with less than 10% NaN values with either the mean, median, or mode, as specified by the user.
  • drop(): Drops all columns with more than 30% NaN values from the DataFrame. License

This project is licensed under the MIT License - see the LICENSE.txt file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyProcessAutom-1.4.3.tar.gz (2.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pyProcessAutom-1.4.3-py3-none-any.whl (2.9 kB view details)

Uploaded Python 3

File details

Details for the file pyProcessAutom-1.4.3.tar.gz.

File metadata

  • Download URL: pyProcessAutom-1.4.3.tar.gz
  • Upload date:
  • Size: 2.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.4

File hashes

Hashes for pyProcessAutom-1.4.3.tar.gz
Algorithm Hash digest
SHA256 f949d9d9692176dbbdcf771c0d63f6375de73a9e36190452738f24c6d4bff04e
MD5 7f04ebdc7ea27351da98b4f19c5773e1
BLAKE2b-256 93a72bf1ad3f8a8fc843be8a9585b2a41cf0e4a02af82bcd3b8e75d1d8fdc6e8

See more details on using hashes here.

File details

Details for the file pyProcessAutom-1.4.3-py3-none-any.whl.

File metadata

  • Download URL: pyProcessAutom-1.4.3-py3-none-any.whl
  • Upload date:
  • Size: 2.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.4

File hashes

Hashes for pyProcessAutom-1.4.3-py3-none-any.whl
Algorithm Hash digest
SHA256 ecd2cd0d23bcb10153981daee61bf057a994fbae03ad2cb4e2b785902cbc80e8
MD5 84453d568e5148f2a0d4af63c3dde6a7
BLAKE2b-256 fd74d0420796a3018eb898296dd68e8dc3d69089286b121f62e776260e28ea0c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page