An advanced and automated data cleaning toolkit for Python.
Project description
AutoClean: Advanced Automated Data Cleaning Toolkit
AutoClean is a Python package that automates the heavy-lifting of data cleaning and preparation. It provides a simple, high-level API to handle common data quality issues and generates a beautiful, insightful HTML report of the entire process.
Key Features
- Comprehensive Cleaning: Handles missing values, outliers, duplicate records, and data type inconsistencies.
- Smart Imputation: Includes standard (mean/median/mode) and ML-based (KNN) imputation methods.
- Outlier Detection: Uses the IQR method to detect and handle outliers in numerical data.
- Data Type Inference: Automatically detects and converts data types (e.g., object to datetime).
- Automated HTML Report: Generates a detailed, visual report with before-and-after statistics and visualizations.
Installation
You can install AutoClean using pip:
pip install autoclean
Quick Start
Clean your data and generate a report in just a few lines of code.
import pandas as pd
from autoclean import AutoClean
# 1. Load your messy data
df = pd.read_csv('your_messy_data.csv')
# 2. Initialize the cleaner
# You can specify the imputation strategy, e.g., 'knn'
cleaner = AutoClean(df, imputation_strategy='knn')
# 3. Run the cleaning process
cleaned_df = cleaner.clean()
# 4. Generate the HTML report
cleaner.generate_report(output_path='cleaning_report.html')
# 5. View the cleaned data
print("Cleaned DataFrame:")
print(cleaned_df.head())
This will create a file named cleaning_report.html in your current directory. Open it in your browser to see a full analysis of the cleaning process.
License
This project is licensed under the MIT License. See the LICENSE file for details.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file autocleanss-0.1.0.tar.gz.
File metadata
- Download URL: autocleanss-0.1.0.tar.gz
- Upload date:
- Size: 10.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e8c059af456c65aa23e9da2b2f6d72c52f799587c7dffec30d6d1a7ac984e16e
|
|
| MD5 |
6dfc736ca9394ed897b337e14b4824da
|
|
| BLAKE2b-256 |
40a887c15f7c2d001409968c17afe5102baddc30c1cc820dbc151d0681997f0d
|
File details
Details for the file autocleanss-0.1.0-py3-none-any.whl.
File metadata
- Download URL: autocleanss-0.1.0-py3-none-any.whl
- Upload date:
- Size: 10.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ffcfc4739cbf0423d0ae5ca3d603f79a15f410575f926d0622f88bed624b387f
|
|
| MD5 |
204298af7b08a90b65124f3ae49444f3
|
|
| BLAKE2b-256 |
d0076dcb7a5f1fa492a289aead5b6c89c33f87a4c552da84bbdd1dbc1a475bfc
|