Skip to main content

License: MIT

datacleanbot

Automated Data Cleaning Tool. The main goal is to develop a Python tool datacleanbot such that: Given a random parsed raw dataset representing a supervised learning problem, the Python tool is capable of automatically identifying the potential issues and reporting the results and recommendations to the end-user in an effective way.

Install

$ pip install datacleanbot

QuickStart

Acquire data from OpenML:

>>> import openml as oml
>>> data = oml.datasets.get_dataset(id) # id: openml dataset id
>>> X, y, features = data.get_data(target=data.default_target_attribute, return_attribute_names=True)
>>> Xy = data.get_data()

Autoclean data with datacleanbot

>>> import datacleanbot.dataclean as dc
>>> Xy = dc.autoclean(Xy, data.name, features)

Description

datacleanbot is equipped with the following capabilities:

  • Present an overview report of the given dataset
    • The most important features
    • Statistical information (e.g., mean, max, min)
    • Data types of features
  • Clean common data problems in the raw dataset
    • Duplicated records
    • Inconsistent column names
    • Missing values
    • Outliers

The three aspects datacleanbot meaningfully automates are marked in bold.

User's Guide

The user's guide can be found at datacleanbot.

Metadata

Release files for datacleanbot 0.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for datacleanbot 0.4
File Size Uploaded Provenance Actions
datacleanbot-0.4.tar.gz 151.3 kB Without provenance Details for datacleanbot-0.4.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for datacleanbot 0.4
File Interpreter ABI Platform Actions
datacleanbot-0.4-py3-none-any.whl Python 3 none any Details for datacleanbot-0.4-py3-none-any.whl

Total release size: 349.1 kB

Release files / datacleanbot-0.4.tar.gz

Download URL datacleanbot-0.4.tar.gz
Size 151.3 kB
Tags Source
SHA-256 checksum
How to use checksums
c03636c24795d5b609059abb73d0be99650c93e504f569661614e41e92a1ef88
BLAKE2b-256 checksum
How to use checksums
8458fd158c4bc83ab6435c507f8935fd10f4f83e59901a5424637765b0b6fa0d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.18.4 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.26.0 CPython/3.6.3

Release files / datacleanbot-0.4-py3-none-any.whl

Download URL datacleanbot-0.4-py3-none-any.whl
Size 197.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e2007c2591fe9c6eb0b0bcf1cf9533b79480974e92a76303096c2288c17984da
BLAKE2b-256 checksum
How to use checksums
3f1e0ce3bdd6b7889cd0a7884bab83c8e13709f0794999afab08754eb69b33ff
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.18.4 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.26.0 CPython/3.6.3

Security for datacleanbot 0.4

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page