Skip to main content

A simple and lightweight ETL package for data pipelines using Python, Pandas, PySpark, and Hadoop

Project description

FriendlyETL

A beginner-friendly and customizable Python ETL (Extract, Transform, Load) package designed for fast and efficient data workflows. Built using Pandas and compatible with files and databases, this package helps you automate your ETL pipelines with just a few lines of code.

🔧 Features

  • ✅ Extract data from CSV, Excel, JSON, or databases (MySQL)
  • ✅ Clean and transform datasets using common operations
  • ✅ Load data to CSV or back into MySQL databases
  • ✅ Modular and easy to extend for your own workflows
  • ✅ Designed for beginners, students, and professionals alike

🗂 Project Structure

friendlyetl/ ├── friendlyetl/ │ ├── init.py │ ├── extract.py │ ├── transform.py │ ├── load.py ├── setup.py ├── README.md └── dist/

🚀 Installation

Install the package from your local build:

pip install dist/friendlyetl-1.0.3-py3-none-any.whl

import friendlyetl as fetl

# Extract data from CSV
df = fetl.extract_data('input/sales.csv')

# Transform data
clean_df = fetl.clean_data(df)

# Load to MySQL
fetl.load_to_mysql(clean_df, db_name="sales_db", table_name="clean_sales")

 ## Dependencies
Python 3.6+

pandas

sqlalchemy

mysql-connector-python (if using MySQL)

Install all dependencies:

pip install -r requirements.txt
👤 Author
Divith Raju
Built with ❤️ to simplify ETL pipelines.
🔗 GitHub

📜 License
This project is licensed under the MIT License. See LICENSE file for more information.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

friendlyetl-1.0.3.tar.gz (4.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

friendlyetl-1.0.3-py3-none-any.whl (4.3 kB view details)

Uploaded Python 3

File details

Details for the file friendlyetl-1.0.3.tar.gz.

File metadata

  • Download URL: friendlyetl-1.0.3.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.12

File hashes

Hashes for friendlyetl-1.0.3.tar.gz
Algorithm Hash digest
SHA256 0a0842a046d34be6fbf7529415f9a50259dc409f61935f6cfb033b6bfca6798a
MD5 a12757da637a87c7847b310398f213d0
BLAKE2b-256 b1910e8d0e00faeb495e9855c9b70558b33d3c18b471c7e1d249ea8f05f4dd4e

See more details on using hashes here.

File details

Details for the file friendlyetl-1.0.3-py3-none-any.whl.

File metadata

  • Download URL: friendlyetl-1.0.3-py3-none-any.whl
  • Upload date:
  • Size: 4.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.12

File hashes

Hashes for friendlyetl-1.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 328c7fa862d3f688800f13e962c6e06841bbfb81ada18a5311ee6d3109fdbf59
MD5 5908ab1243c3e46f1285ac9820793784
BLAKE2b-256 bb4f01fcd24605539ebe7a5f241c2e7574553acd87023c50a3ce7074eff02d7f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page