Skip to main content

Prepup is a free, open-source package that lets you open, explore, visualize, and pre-process datasets in your Computer's Terminal.

Project description

💻 Prepup

Built with ♥️ by Sudhanshu Mukherjee

image

Prepup is a free open-source package that lets you inspect, explore, visualize, and perform pre-processing tasks on datasets in your windows/macOS terminal.

Installation

  • Prepup can be installed using the Pip package manager.
  • !pip install Prepup

Motivation

  • Developing an efficient and user-friendly command line tool for data pre-processing to handle various tasks such as missing data, data formatting, and cleaning, with a simple interface and scalability for large datasets.

File Format Supported

  • CSV
  • EXCEL
  • PARQUET

Why you should use Prepup?

It's Superfast

  • Prepup is built on Polars which is an alternative to pandas and helps you load and manipulate the DataFrames faster.

Analytical

  • Prepup handles tasks ranging from the shape of data to the Standardizing of the feature before training the model. It does it right on the terminal.

Compatible

  • Prepup supports CSV, EXCEL, and PARQUET formats making it compatible to go with different file formats.

Non-Destructive

  • Prepup doesn't alter your raw data, It saves pre-processed data only when the user specifies the path.

Lives in your Terminal

  • Prepup is terminal-based and has specific entry points designed for using it instantly.

Command Line Arguments available in PREPUP

🕵️ Prepup "File name or File path" -inspect

https://github.com/sudhanshumukherjeexx/prepup/assets/64360018/93da36fc-1c7e-449c-9732-bfce81f3a915

  • inspect flag takes the dataframe and returns the Features available, Features datatype, and missing values present in the Dataset.
  • File Name: If the current working directory is same as the file location or FILE PATH

🧭 Prepup "File name or File path" -explore

https://github.com/sudhanshumukherjeexx/prepup/assets/64360018/eeccaf19-6c2a-4e8c-ab4a-8c3afb59f8c5

  • explore flag takes the dataframe and returns the Features available, Features datatype, Correlation between features, Detects Outliers, Checks Normal Distribution, Checks Skewness, Checks Kurtosis, and also allows the option to check if the dataset is Imbalanced.
  • File Name: If the current working directory is same as the file location or FILE PATH

📊 Prepup "File name or File path" -visualize

https://github.com/sudhanshumukherjeexx/prepup/assets/64360018/61fffd53-0b26-4537-ac1d-5296a2f8b52e

  • visualize flag plots of the feature distribution directly on the terminal.
  • File Name: If the current working directory is same as the file location or FILE PATH

🔥 Prepup "File name or File path" -impute

https://github.com/sudhanshumukherjeexx/prepup/assets/64360018/3d0160af-0059-4b4e-b278-abe8a587c5b5

  • There are 8 different strategies available to impute missing data using Prepup

  • File Name: If the current working directory is same as the file location or FILE PATH

    • Option 1 - Drops the Missing Data
    • Option 2 - Impute Missing values with a Specific value
    • Option 3 - Impute Missing values with Mean.
    • Option 4 - Impute Missing values with Median.
    • Option 5 - Impute Missing value based on the distribution of existing columns.
    • Option 6 - Impute Missing values based on Forward Fill Strategy where missing values are imputed based on the previous data points.
    • Option 7 - Impute Missing values based on Backward Strategy where missing values are imputed based on the next data points.
    • Option 8 - Impute missing values based on K-Nearest Neighbors.

🌐 Prepup "File name or File path" -standardize

https://github.com/sudhanshumukherjeexx/prepup/assets/64360018/c098a7aa-1cb9-464b-bd89-1ea3c38b842e

  • Standardize allows you to standardize the dataset using two different methods:

    1. Robust Scaler

    2. Standard Scaler

  • Robust Scaler is recommended if there are outliers present and you feel they can have an influence on the Machine Learning model.

  • Standard Scaler is the go-to function if you want to standardize the dataset before training the model on it.

  • File Name: If the current working directory is same as the file location or FILE PATH

License

  • Free software: MIT license

Package Link

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

prepup-linux-0.0.1.tar.gz (11.8 kB view details)

Uploaded Source

File details

Details for the file prepup-linux-0.0.1.tar.gz.

File metadata

  • Download URL: prepup-linux-0.0.1.tar.gz
  • Upload date:
  • Size: 11.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.12

File hashes

Hashes for prepup-linux-0.0.1.tar.gz
Algorithm Hash digest
SHA256 c00bfab9d69fca818ad0318ec7be00e9f17ac34ce142bee5dcb2e31568ca0730
MD5 a1af514b1e98aac16c49c2e352e6cf4e
BLAKE2b-256 22ade1483dfb1048f031ab3683ef16c016d85bfbc2d9c73c9cfc776c07c31de4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page