Skip to main content

A Python package for cleaning and preprocessing data in pandas DataFrames

Project description

DataScrub

DataScrub is a Python package that provides powerful data cleaning and preprocessing capabilities for pandas DataFrames. It offers a collection of functions and utilities to facilitate data cleaning tasks, handling missing values, standardizing data formats, and more. With DataScrub, you can streamline your data preparation process and ensure the quality and consistency of your datasets.

Features

  • Clean text data in pandas DataFrames
  • Handle missing values with customizable actions
  • Perform scaling normalization on numerical columns
  • Split and expand data in specified columns
  • Convert columns to datetime format and format them as 'YYYY-MM-DD'
  • Translate text columns to English using Google Translate

Installation

DataScrub can be easily installed using pip. Simply run the following command:

pip install datascrub

Make sure you have Python 3.7 or above installed on your system.

Usage

To use DataScrub in your Python projects, import the package and create an instance of the DataClean class:

from datascrub import DataClean
import pandas as pd

# Create a DataFrame
data = pd.read_csv("data.csv")

# Create an instance of DataClean
cleaner = DataClean(data)

# Call the available methods to clean and preprocess your data
cleaned_data = cleaner.prep(clean='all', missing_values={}, perform_scaling_normalization_bool=False,
                            explode={}, parse_date={}, translate_column_names={})

The DataClean class takes a pandas DataFrame or a file path as input. You can then use the various methods available in the class to clean and preprocess your data.

Refer to the documentation for detailed information on available methods and usage examples.

Contributing

Contributions to DataScrub are welcome! If you encounter any bugs, have suggestions for improvements, or would like to add new features, please open an issue or submit a pull request on the GitHub repository.

License

This project is licensed under the MIT License. See the LICENSE file for more information.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datascrub-1.1.4.tar.gz (5.3 kB view hashes)

Uploaded Source

Built Distribution

datascrub-1.1.4-py3-none-any.whl (8.0 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page