A simple and powerful data preprocessing library for cleaning datasets
Project description
datacleanbv — Advanced Data Cleaning Library
A config-driven data preprocessing library covering validation, null handling, outlier detection, scaling, and encoding.
Install
pip install -r requirements.txt
pip install -e .
Quick Start
import pandas as pd
from datacleaner import validate, replace_nulls, zscore, standard_scaler, encode, dtypeconversion
df = pd.read_csv("data.csv")
config = {
"fixes": {"Price": {"method": "clip", "min": 0, "max": 10000}},
"missing": {"Price": "median", "Category": "mode"},
"zscore": {"Price": {"threshold": 2.5, "action": "cap"}},
"scaling": {"Price": "standard"},
"encoding":{"Category": "onehot"},
}
df = validate(df, config)
df = replace_nulls(df, config)
df = zscore(df, config)
df = standard_scaler(df, config)
df = encode(df, config)
df = dtypeconversion(df)
Print usage hints
from datacleaner import structure, functionName
structure() # prints a full config template
functionName() # prints the recommended import block
Run tests
pytest tests/ -v
Pipeline order
validate → replace_nulls → zscore / isolation_forest → standard_scaler → encode → dtypeconversion
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
datapreprocessorbv-0.3.0.tar.gz
(10.4 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file datapreprocessorbv-0.3.0.tar.gz.
File metadata
- Download URL: datapreprocessorbv-0.3.0.tar.gz
- Upload date:
- Size: 10.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2f41ed99ff191d8934414c3998c5252b5d4ce03a3f7b162ed73bfd6b6d351fa9
|
|
| MD5 |
fedce46a691489c75515aa998d9ae951
|
|
| BLAKE2b-256 |
9a38f1d28a5e07d92d8517eb9abd2dbd35ec1e98bfea2708d77d6b5e346ddb76
|
File details
Details for the file datapreprocessorbv-0.3.0-py3-none-any.whl.
File metadata
- Download URL: datapreprocessorbv-0.3.0-py3-none-any.whl
- Upload date:
- Size: 9.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0d36c16a65513ea62a02a2bb54308883cb5046584869b40ab33d489267c92687
|
|
| MD5 |
b2d30d2181e86517e8c7d796aff28d29
|
|
| BLAKE2b-256 |
162b012b2b7174bc6ad10cae2ef2a4b56681f504ec67267825a4e5948fda4c6f
|