datawash-inspector 0.2.0

An automated end-to-end data cleaning, preprocessing, and EDA pipeline.

DataWash 🔬

DataWash Inspector is an automated, end-to-end Python data pipeline that cleans, prunes, prepares, and visualizes your datasets with zero manual effort. It includes a built-in serverless HTML dashboard for zero-code data exploration in Google Colab!

Installation

You can install datawash via pip:

pip install datawash-inspector

Quick Start

It only takes a few lines of code to completely sanitize, optimize, and encode your dataset for machine learning.

from datawash import DataPipeline

# 1. Initialize Pipeline
pipe = DataPipeline()

# 2. Load and Auto-Clean
pipe.load_data('your_data.csv')
pipe.sanitize_garbage().auto_type_correct()
pipe.handle_missing_values(strategy='auto')

# 3. Export Clean Data
pipe.save_data('cleaned_data.csv')

The Interactive Dashboard

datawash comes with a fully automated EDA (Exploratory Data Analysis) dashboard.

For Google Colab / Jupyter Users: Instantly inject a serverless, interactive HTML dashboard directly inside your notebook!

# Magically embeds a stunning UI into your Colab cell
pipe.show_dashboard()

For Local IDE Users (VS Code, PyCharm, etc): Automatically generate the HTML dashboard and open it in your default web browser!

# Generates the report and pops it open in Chrome/Safari/Edge
pipe.show_dashboard()

Features

• Memory Optimization: Automatically downcasts large numbers to save memory (up to 50%+ reduction).
• Auto-Cleaning: Automatically converts pure whitespace strings or garbage text ("N/A", "?", "-") to NaN values.
• Smart Imputation: Dynamically imputes missing numeric values with the median and categorical values with the mode.
• Statistical EDA: Calculates an advanced unified correlation matrix supporting numerical, categorical, and mixed variable types (Cramér's V, Eta, Spearman).
• Feature Pruning: Automatically identifies and drops highly redundant features (e.g., > 90% correlation) and high-cardinality IDs.

License

This project is licensed under the MIT License.