Lightweight CLI tool to analyze CSV datasets and detect common ML data issues.
Project description
dataset-inspector
A lightweight CLI tool to quickly analyze CSV datasets and detect common issues before training ML models.
Features
- Basic statistics – mean, std, min, max, median, quartiles for every numeric column
- Missing values – per-column count and percentage
- Duplicate rows – exact duplicate detection
- Class imbalance – minority/majority ratio check for categorical columns
- Anomaly detection – IQR or z-score based outlier flagging
- Terminal report – clean, colour-coded output
- JSON export – optional machine-readable report
Installation
pip install -r requirements.txt
Quick start
# Analyse the included example dataset
python -m dataset_inspector --input examples/sample.csv
# Specify a target column for class-imbalance check
python -m dataset_inspector --input data.csv --target label
# Use z-score anomaly detection and export JSON
python -m dataset_inspector --input data.csv --anomaly-method zscore --json report.json
# Enable verbose / debug logging
python -m dataset_inspector --input data.csv -v
Project structure
dataset_inspector/
├── __init__.py # package metadata
├── __main__.py # python -m entry point
├── cli.py # argument parsing (argparse)
├── analyzer.py # core analysis logic
├── report.py # terminal + JSON report formatting
└── utils.py # logging helpers
examples/
└── sample.csv # small demo dataset
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file dataset_inspector-0.0.1.tar.gz.
File metadata
- Download URL: dataset_inspector-0.0.1.tar.gz
- Upload date:
- Size: 7.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b3d7b97ddea7d2f0b3680c77339f6503cae817fa5a6cbc4102070dfdb669541e
|
|
| MD5 |
d9af517e9126c3316c0ad2389a3726e3
|
|
| BLAKE2b-256 |
a3ebbd08a566c7fa6b14cc02c6cf584728a962b2b26d7215b41adfbdf3b35c2b
|
File details
Details for the file dataset_inspector-0.0.1-py3-none-any.whl.
File metadata
- Download URL: dataset_inspector-0.0.1-py3-none-any.whl
- Upload date:
- Size: 8.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3e55398e4faad8e7138996ed13bc23a78b0a038be9830c354fe9e62771f0ab60
|
|
| MD5 |
3560f785ce0b8fc7e0e01e811d9658cd
|
|
| BLAKE2b-256 |
a446f9efc289df53737ace25e6da72f5469c00b084fd47bc42da16c0f4c1ae4a
|