Skip to main content

Data Cleansing Tool This project provides a Python script for cleansing data in various file formats (CSV, Excel, JSON, XML). It offers a variety of operations to clean and process your data, including removing null values, handling duplicates, formatting column names, and transforming date columns. Users can choose cleansing operations interactively through a command-line interface.

Features File Format Support: CSV, Excel (.xls, .xlsx), JSON, XML, if you chose any operation,then want to getback to origianl data option also included. Operations: Remove rows/columns with null values. Replace null values with a custom value. Remove duplicate rows and columns. Convert column names to lowercase and remove whitespaces. Split date columns into day, month, and year. Convert categorical columns to One-Hot Encoding. And many more customizable data cleansing options.... Installation Clone the repository or download the files to your local machine.

Dependencies: Ensure that you have Python 3.x. You can install the necessary dependencies using pip:

bash Copy code pip install pandas Usage Prepare your data: Make sure you have a data file in one of the supported formats (CSV, Excel, JSON, or XML).

Run the script: In the terminal or command prompt, navigate to the directory where the script is located and run it:

bash Copy code python autocleaner.py or python3 autocleaner.py Enter file path: You will be prompted to enter the file path of the dataset you want to clean.

Choose cleansing operations: The script will display a menu of available operations. Enter the numbers of the operations you want to apply (separate multiple choices with commas). Some of the available operations include:

Remove rows/columns with null values. Replace null values with a custom value. Remove duplicate rows and columns. Convert column names to lowercase and remove whitespaces. Split date columns into day, month, and year. Convert categorical columns to One-Hot Encoding. Remove rows with null values. Replace null values with a specified value. Convert column names to lowercase. Convert a date column to 'day', 'month', and 'year'. Exit or revert to original: Type 'backtodata' to revert to the original data or 'exit' to stop the program.

Output: After performing the selected operations, the final cleaned DataFrame will be displayed.

Example Here’s a simple usage example:

bash Copy code Enter your file path: data.csv Choose cleansing operations (multiple choices allowed): Remove rows with null values Remove columns with null values Replace null values with a specified value Remove duplicate rows Convert column names to lowercase ... Enter the numbers of the operations you'd like to perform, separated by commas: 1,4,5 Final DataFrame: Column1 Column2 0 1 10 1 2 20 Notes Ensure the file path you provide is correct and accessible. The script will display statistics before and after cleansing to help you track the changes made to your dataset. You can perform multiple cleansing operations on the same dataset in a single run. License This project is licensed under the MIT License - see the LICENSE file for details.

Metadata

Release files for framecleaner 0.3.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for framecleaner 0.3.2
File Size Uploaded
framecleaner-0.3.2.tar.gz 3.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for framecleaner 0.3.2
File Interpreter ABI Platform
framecleaner-0.3.2-py3-none-any.whl Python 3 none any Details

Total release size: 6.3 kB

Release files / framecleaner-0.3.2.tar.gz

Download URL framecleaner-0.3.2.tar.gz
Size 3.1 kB
Tags Source
SHA-256 checksum
How to use checksums
d94ce629dc63efbcf059ee943bed3e9b52b5b88e96180cdb8b3b9da700daa1fc
BLAKE2b-256 checksum
How to use checksums
5b2bb60ec2bc743e6a712269b2c71cbca0359d6f4e74e800129259af21748d0b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.0.1 CPython/3.12.8

Release files / framecleaner-0.3.2-py3-none-any.whl

Download URL framecleaner-0.3.2-py3-none-any.whl
Size 3.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
355cbc054ad956c719cf7b5ec85160ecb464bbd8ad16bd945889c13ba903c86c
BLAKE2b-256 checksum
How to use checksums
5c57324b8a1cba694dca3cbd7e7c7e6dadfc0fe2ed121dd04b530edbfefa0378
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.0.1 CPython/3.12.8

Release history Release notifications | RSS feed

This release

0.3.2 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page