Skip to main content

An advanced and automated data cleaning toolkit for Python.

Project description

AutoClean: Advanced Automated Data Cleaning Toolkit

AutoClean is a Python package that automates the heavy-lifting of data cleaning and preparation. It provides a simple, high-level API to handle common data quality issues and generates a beautiful, insightful HTML report of the entire process.

Key Features

  • Comprehensive Cleaning: Handles missing values, outliers, duplicate records, and data type inconsistencies.
  • Smart Imputation: Includes standard (mean/median/mode) and ML-based (KNN) imputation methods.
  • Outlier Detection: Uses the IQR method to detect and handle outliers in numerical data.
  • Data Type Inference: Automatically detects and converts data types (e.g., object to datetime).
  • Automated HTML Report: Generates a detailed, visual report with before-and-after statistics and visualizations.

Installation

You can install AutoClean using pip:

pip install autoclean

Quick Start

Clean your data and generate a report in just a few lines of code.

import pandas as pd
from autoclean import AutoClean

# 1. Load your messy data
df = pd.read_csv('your_messy_data.csv')

# 2. Initialize the cleaner
# You can specify the imputation strategy, e.g., 'knn'
cleaner = AutoClean(df, imputation_strategy='knn')

# 3. Run the cleaning process
cleaned_df = cleaner.clean()

# 4. Generate the HTML report
cleaner.generate_report(output_path='cleaning_report.html')

# 5. View the cleaned data
print("Cleaned DataFrame:")
print(cleaned_df.head())

This will create a file named cleaning_report.html in your current directory. Open it in your browser to see a full analysis of the cleaning process.

License

This project is licensed under the MIT License. See the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

autocleanss-0.1.0.tar.gz (10.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

autocleanss-0.1.0-py3-none-any.whl (10.0 kB view details)

Uploaded Python 3

File details

Details for the file autocleanss-0.1.0.tar.gz.

File metadata

  • Download URL: autocleanss-0.1.0.tar.gz
  • Upload date:
  • Size: 10.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.2

File hashes

Hashes for autocleanss-0.1.0.tar.gz
Algorithm Hash digest
SHA256 e8c059af456c65aa23e9da2b2f6d72c52f799587c7dffec30d6d1a7ac984e16e
MD5 6dfc736ca9394ed897b337e14b4824da
BLAKE2b-256 40a887c15f7c2d001409968c17afe5102baddc30c1cc820dbc151d0681997f0d

See more details on using hashes here.

File details

Details for the file autocleanss-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: autocleanss-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 10.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.2

File hashes

Hashes for autocleanss-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ffcfc4739cbf0423d0ae5ca3d603f79a15f410575f926d0622f88bed624b387f
MD5 204298af7b08a90b65124f3ae49444f3
BLAKE2b-256 d0076dcb7a5f1fa492a289aead5b6c89c33f87a4c552da84bbdd1dbc1a475bfc

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page