Skip to main content

auto cleaning the data with easy user interface

Project description

Data Cleansing Tool This project provides a Python script for cleansing data in various file formats (CSV, Excel, JSON, XML). It offers a variety of operations to clean and process your data, including removing null values, handling duplicates, formatting column names, and transforming date columns. Users can choose cleansing operations interactively through a command-line interface.

Features File Format Support: CSV, Excel (.xls, .xlsx), JSON, XML, if you chose any operation,then want to getback to origianl data option also included. Operations: Remove rows/columns with null values. Replace null values with a custom value. Remove duplicate rows and columns. Convert column names to lowercase and remove whitespaces. Split date columns into day, month, and year. Convert categorical columns to One-Hot Encoding. And many more customizable data cleansing options.... Installation Clone the repository or download the files to your local machine.

Dependencies: Ensure that you have Python 3.x. You can install the necessary dependencies using pip:

bash Copy code pip install pandas Usage Prepare your data: Make sure you have a data file in one of the supported formats (CSV, Excel, JSON, or XML).

Run the script: In the terminal or command prompt, navigate to the directory where the script is located and run it:

bash Copy code python autocleaner.py or python3 autocleaner.py Enter file path: You will be prompted to enter the file path of the dataset you want to clean.

Choose cleansing operations: The script will display a menu of available operations. Enter the numbers of the operations you want to apply (separate multiple choices with commas). Some of the available operations include:

Remove rows/columns with null values. Replace null values with a custom value. Remove duplicate rows and columns. Convert column names to lowercase and remove whitespaces. Split date columns into day, month, and year. Convert categorical columns to One-Hot Encoding. Remove rows with null values. Replace null values with a specified value. Convert column names to lowercase. Convert a date column to 'day', 'month', and 'year'. Exit or revert to original: Type 'backtodata' to revert to the original data or 'exit' to stop the program.

Output: After performing the selected operations, the final cleaned DataFrame will be displayed.

Example Here’s a simple usage example:

bash Copy code Enter your file path: data.csv Choose cleansing operations (multiple choices allowed): Remove rows with null values Remove columns with null values Replace null values with a specified value Remove duplicate rows Convert column names to lowercase ... Enter the numbers of the operations you'd like to perform, separated by commas: 1,4,5 Final DataFrame: Column1 Column2 0 1 10 1 2 20 Notes Ensure the file path you provide is correct and accessible. The script will display statistics before and after cleansing to help you track the changes made to your dataset. You can perform multiple cleansing operations on the same dataset in a single run. License This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

framecleaner-0.3.2.tar.gz (3.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

framecleaner-0.3.2-py3-none-any.whl (3.2 kB view details)

Uploaded Python 3

File details

Details for the file framecleaner-0.3.2.tar.gz.

File metadata

  • Download URL: framecleaner-0.3.2.tar.gz
  • Upload date:
  • Size: 3.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for framecleaner-0.3.2.tar.gz
Algorithm Hash digest
SHA256 d94ce629dc63efbcf059ee943bed3e9b52b5b88e96180cdb8b3b9da700daa1fc
MD5 ecd7e15a230d2a8b638079ab3fa9b2ed
BLAKE2b-256 5b2bb60ec2bc743e6a712269b2c71cbca0359d6f4e74e800129259af21748d0b

See more details on using hashes here.

File details

Details for the file framecleaner-0.3.2-py3-none-any.whl.

File metadata

  • Download URL: framecleaner-0.3.2-py3-none-any.whl
  • Upload date:
  • Size: 3.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for framecleaner-0.3.2-py3-none-any.whl
Algorithm Hash digest
SHA256 355cbc054ad956c719cf7b5ec85160ecb464bbd8ad16bd945889c13ba903c86c
MD5 fa0efa1b621c198d2ac654adcf58149a
BLAKE2b-256 5c57324b8a1cba694dca3cbd7e7c7e6dadfc0fe2ed121dd04b530edbfefa0378

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page