Skip to main content

A simple and powerful data preprocessing library for cleaning datasets

Project description

datacleanbv — Advanced Data Cleaning Library

A config-driven data preprocessing library covering validation, null handling, outlier detection, scaling, and encoding.

Install

pip install -r requirements.txt
pip install -e .

Quick Start

import pandas as pd
from datacleaner import validate, replace_nulls, zscore, standard_scaler, encode, dtypeconversion

df = pd.read_csv("data.csv")

config = {
    "fixes":   {"Price": {"method": "clip", "min": 0, "max": 10000}},
    "missing": {"Price": "median", "Category": "mode"},
    "zscore":  {"Price": {"threshold": 2.5, "action": "cap"}},
    "scaling": {"Price": "standard"},
    "encoding":{"Category": "onehot"},
}

df = validate(df, config)
df = replace_nulls(df, config)
df = zscore(df, config)
df = standard_scaler(df, config)
df = encode(df, config)
df = dtypeconversion(df)

Print usage hints

from datacleaner import structure, functionName
structure()      # prints a full config template
functionName()   # prints the recommended import block

Run tests

pytest tests/ -v

Pipeline order

validate → replace_nulls → zscore / isolation_forest → standard_scaler → encode → dtypeconversion

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datapreprocessorbv-0.3.0.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

datapreprocessorbv-0.3.0-py3-none-any.whl (9.2 kB view details)

Uploaded Python 3

File details

Details for the file datapreprocessorbv-0.3.0.tar.gz.

File metadata

  • Download URL: datapreprocessorbv-0.3.0.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.3

File hashes

Hashes for datapreprocessorbv-0.3.0.tar.gz
Algorithm Hash digest
SHA256 2f41ed99ff191d8934414c3998c5252b5d4ce03a3f7b162ed73bfd6b6d351fa9
MD5 fedce46a691489c75515aa998d9ae951
BLAKE2b-256 9a38f1d28a5e07d92d8517eb9abd2dbd35ec1e98bfea2708d77d6b5e346ddb76

See more details on using hashes here.

File details

Details for the file datapreprocessorbv-0.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for datapreprocessorbv-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0d36c16a65513ea62a02a2bb54308883cb5046584869b40ab33d489267c92687
MD5 b2d30d2181e86517e8c7d796aff28d29
BLAKE2b-256 162b012b2b7174bc6ad10cae2ef2a4b56681f504ec67267825a4e5948fda4c6f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page