Skip to main content

Data Cleansing Tool This project provides a Python script for cleansing data in various file formats (CSV, Excel, JSON, XML). It offers a variety of operations to clean and process your data, including removing null values, handling duplicates, formatting column names, and transforming date columns. Users can choose cleansing operations interactively through a command-line interface.

Features File Format Support: CSV, Excel (.xls, .xlsx), JSON, XML, if you chose any operation,then want to getback to origianl data option also included. Operations: Remove rows/columns with null values. Replace null values with a custom value. Remove duplicate rows and columns. Convert column names to lowercase and remove whitespaces. Split date columns into day, month, and year. Convert categorical columns to One-Hot Encoding. And many more customizable data cleansing options.... Installation Clone the repository or download the files to your local machine.

Dependencies: Ensure that you have Python 3.x. You can install the necessary dependencies using pip:

bash Copy code pip install pandas Usage Prepare your data: Make sure you have a data file in one of the supported formats (CSV, Excel, JSON, or XML).

Run the script: In the terminal or command prompt, navigate to the directory where the script is located and run it:

bash Copy code python autocleaner.py or python3 autocleaner.py Enter file path: You will be prompted to enter the file path of the dataset you want to clean.

Choose cleansing operations: The script will display a menu of available operations. Enter the numbers of the operations you want to apply (separate multiple choices with commas). Some of the available operations include:

Remove rows/columns with null values. Replace null values with a custom value. Remove duplicate rows and columns. Convert column names to lowercase and remove whitespaces. Split date columns into day, month, and year. Convert categorical columns to One-Hot Encoding. Remove rows with null values. Replace null values with a specified value. Convert column names to lowercase. Convert a date column to 'day', 'month', and 'year'. Exit or revert to original: Type 'backtodata' to revert to the original data or 'exit' to stop the program.

Output: After performing the selected operations, the final cleaned DataFrame will be displayed.

Example Here’s a simple usage example:

bash Copy code Enter your file path: data.csv Choose cleansing operations (multiple choices allowed): Remove rows with null values Remove columns with null values Replace null values with a specified value Remove duplicate rows Convert column names to lowercase ... Enter the numbers of the operations you'd like to perform, separated by commas: 1,4,5 Final DataFrame: Column1 Column2 0 1 10 1 2 20 Notes Ensure the file path you provide is correct and accessible. The script will display statistics before and after cleansing to help you track the changes made to your dataset. You can perform multiple cleansing operations on the same dataset in a single run. License This project is licensed under the MIT License - see the LICENSE file for details.

Metadata

Release files for autocleanser 0.3.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for autocleanser 0.3.1
File Size Uploaded
autocleanser-0.3.1.tar.gz 3.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for autocleanser 0.3.1
File Interpreter ABI Platform
autocleanser-0.3.1-py3-none-any.whl Python 3 none any Details

Total release size: 6.3 kB

Release files / autocleanser-0.3.1.tar.gz

Download URL autocleanser-0.3.1.tar.gz
Size 3.1 kB
Tags Source
SHA-256 checksum
How to use checksums
34b1ba63255c222a5b2d54ae7b65ee13437d950516a5e2cda37fbdd795329805
BLAKE2b-256 checksum
How to use checksums
71a686a3e8a8968bacd2381bdfa90690eb30b2c33d0ffeb848995b4268ecd176
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.0.1 CPython/3.12.8

Release files / autocleanser-0.3.1-py3-none-any.whl

Download URL autocleanser-0.3.1-py3-none-any.whl
Size 3.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
3a45083aeff3194a590cc559bd11e9837923928322a9eb05be0d524690e39bb9
BLAKE2b-256 checksum
How to use checksums
45af0de691cb91bc9db3dd8d1b8cd84daf6cd3d7e55c19cd5cb8fc49e8686c9c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.0.1 CPython/3.12.8

Release history Release notifications | RSS feed

This release

0.3.1 This release

2 release files

0.2

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page