Skip to main content

Lightweight CLI tool to analyze CSV datasets and detect common ML data issues.

Project description

dataset-inspector

Author

Issues PRs

Forks Stars

Last commit Repo size

PyPI Python versions Wheel License

A lightweight CLI tool to quickly analyze CSV datasets and detect common issues before training ML models.

Features

  • Basic statistics – mean, std, min, max, median, quartiles for every numeric column
  • Missing values – per-column count and percentage
  • Duplicate rows – exact duplicate detection
  • Class imbalance – minority/majority ratio check for categorical columns
  • Anomaly detection – IQR or z-score based outlier flagging
  • Terminal report – clean, colour-coded output
  • JSON export – optional machine-readable report

Installation

pip install dataset-inspector

Quick start

# Analyse the included example dataset
python -m dataset_inspector --input examples/sample.csv

# Specify a target column for class-imbalance check
python -m dataset_inspector --input data.csv --target label

# Use z-score anomaly detection and export JSON
python -m dataset_inspector --input data.csv --anomaly-method zscore --json report.json

# Enable verbose / debug logging
python -m dataset_inspector --input data.csv -v

Project structure

dataset_inspector/
├── __init__.py      # package metadata
├── __main__.py      # python -m entry point
├── cli.py           # argument parsing (argparse)
├── analyzer.py      # core analysis logic
├── report.py        # terminal + JSON report formatting
└── utils.py         # logging helpers
examples/
└── sample.csv       # small demo dataset

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dataset_inspector-0.0.2.tar.gz (8.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dataset_inspector-0.0.2-py3-none-any.whl (9.5 kB view details)

Uploaded Python 3

File details

Details for the file dataset_inspector-0.0.2.tar.gz.

File metadata

  • Download URL: dataset_inspector-0.0.2.tar.gz
  • Upload date:
  • Size: 8.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.9

File hashes

Hashes for dataset_inspector-0.0.2.tar.gz
Algorithm Hash digest
SHA256 50e173f0cfb417147dea23f5bd1781c6eff2ce72a52fff6402bab717a47bdb87
MD5 bc336753f0b2acdcab7ed15487696d78
BLAKE2b-256 b67d09f8996f0fe3c6949b3409ec4849f78928fc7ca7681311c946982c9f3391

See more details on using hashes here.

File details

Details for the file dataset_inspector-0.0.2-py3-none-any.whl.

File metadata

File hashes

Hashes for dataset_inspector-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 62c53b183af918a75aa45462336bac70b58771f953c4ed6f0718c940f48e427e
MD5 685676304108b46004c99f9425847aa7
BLAKE2b-256 3ce9c4e3de039beee9be9f831f9013755291ca4e8fcea541cab965bc2c4e690c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page