A simple and powerful data preprocessing library for cleaning datasets
Project description
datacleanbv — Advanced Data Cleaning Library
A config-driven data preprocessing library covering validation, null handling, outlier detection, scaling, and encoding.
Install
pip install -r requirements.txt
pip install -e .
Quick Start
import pandas as pd
from datacleaner import validate, replace_nulls, zscore, standard_scaler, encode, dtypeconversion
df = pd.read_csv("data.csv")
config = {
"fixes": {"Price": {"method": "clip", "min": 0, "max": 10000}},
"missing": {"Price": "median", "Category": "mode"},
"zscore": {"Price": {"threshold": 2.5, "action": "cap"}},
"scaling": {"Price": "standard"},
"encoding":{"Category": "onehot"},
}
df = validate(df, config)
df = replace_nulls(df, config)
df = zscore(df, config)
df = standard_scaler(df, config)
df = encode(df, config)
df = dtypeconversion(df)
Print usage hints
from datacleaner import structure, functionName
structure() # prints a full config template
functionName() # prints the recommended import block
Run tests
pytest tests/ -v
Pipeline order
validate → replace_nulls → zscore / isolation_forest → standard_scaler → encode → dtypeconversion
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
datapreprocessorbv-0.2.0.tar.gz
(10.2 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file datapreprocessorbv-0.2.0.tar.gz.
File metadata
- Download URL: datapreprocessorbv-0.2.0.tar.gz
- Upload date:
- Size: 10.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3f015520effee8b364f393524aa88bc4429f43f2dc34868d3642bb94f6df0367
|
|
| MD5 |
a16e18aac52b40e31585a2a4724a3dc1
|
|
| BLAKE2b-256 |
8b2857b746107117b59f235ec3028987da10be6b526ee4d53e669be2b26636f0
|
File details
Details for the file datapreprocessorbv-0.2.0-py3-none-any.whl.
File metadata
- Download URL: datapreprocessorbv-0.2.0-py3-none-any.whl
- Upload date:
- Size: 9.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b04065645950e9bb735b8a44ddb6bf6220fb951269c6c664c0efa330db5df8d7
|
|
| MD5 |
d1cd1c928102e0db4e221ad05fc67e48
|
|
| BLAKE2b-256 |
223ed8d83ab7cd9ed3fcdf2a7ffa00f17d94a81d0ccef8d7a43da5a7617c05e2
|