Skip to main content

Lightweight CLI tool to analyze CSV datasets and detect common ML data issues.

Project description

dataset-inspector

A lightweight CLI tool to quickly analyze CSV datasets and detect common issues before training ML models.

Features

  • Basic statistics – mean, std, min, max, median, quartiles for every numeric column
  • Missing values – per-column count and percentage
  • Duplicate rows – exact duplicate detection
  • Class imbalance – minority/majority ratio check for categorical columns
  • Anomaly detection – IQR or z-score based outlier flagging
  • Terminal report – clean, colour-coded output
  • JSON export – optional machine-readable report

Installation

pip install -r requirements.txt

Quick start

# Analyse the included example dataset
python -m dataset_inspector --input examples/sample.csv

# Specify a target column for class-imbalance check
python -m dataset_inspector --input data.csv --target label

# Use z-score anomaly detection and export JSON
python -m dataset_inspector --input data.csv --anomaly-method zscore --json report.json

# Enable verbose / debug logging
python -m dataset_inspector --input data.csv -v

Project structure

dataset_inspector/
├── __init__.py      # package metadata
├── __main__.py      # python -m entry point
├── cli.py           # argument parsing (argparse)
├── analyzer.py      # core analysis logic
├── report.py        # terminal + JSON report formatting
└── utils.py         # logging helpers
examples/
└── sample.csv       # small demo dataset

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dataset_inspector-0.0.1.tar.gz (7.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dataset_inspector-0.0.1-py3-none-any.whl (8.5 kB view details)

Uploaded Python 3

File details

Details for the file dataset_inspector-0.0.1.tar.gz.

File metadata

  • Download URL: dataset_inspector-0.0.1.tar.gz
  • Upload date:
  • Size: 7.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.9

File hashes

Hashes for dataset_inspector-0.0.1.tar.gz
Algorithm Hash digest
SHA256 b3d7b97ddea7d2f0b3680c77339f6503cae817fa5a6cbc4102070dfdb669541e
MD5 d9af517e9126c3316c0ad2389a3726e3
BLAKE2b-256 a3ebbd08a566c7fa6b14cc02c6cf584728a962b2b26d7215b41adfbdf3b35c2b

See more details on using hashes here.

File details

Details for the file dataset_inspector-0.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for dataset_inspector-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 3e55398e4faad8e7138996ed13bc23a78b0a038be9830c354fe9e62771f0ab60
MD5 3560f785ce0b8fc7e0e01e811d9658cd
BLAKE2b-256 a446f9efc289df53737ace25e6da72f5469c00b084fd47bc42da16c0f4c1ae4a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page