Skip to main content

A simple and lightweight ETL package for data pipelines using Python, Pandas, PySpark, and Hadoop

Project description

FriendlyETL

A beginner-friendly and customizable Python ETL (Extract, Transform, Load) package designed for fast and efficient data workflows. Built using Pandas and compatible with files and databases, this package helps you automate your ETL pipelines with just a few lines of code. url= https://github.com/divithraju linkedin= https://www.linkedin.com/in/divithraju/

🔧 Features

  • ✅ Extract data from CSV, Excel, JSON, or databases (MySQL)
  • ✅ Clean and transform datasets using common operations
  • ✅ Load data to CSV or back into MySQL databases
  • ✅ Modular and easy to extend for your own workflows
  • ✅ Designed for beginners, students, and professionals alike

🗂 Project Structure

friendlyetl/ ├── friendlyetl/ │ ├── init.py │ ├── extract.py │ ├── transform.py │ ├── load.py ├── setup.py ├── README.md └── dist/

🚀 Installation

Install the package from your local build:

pip install dist/friendlyetl-0.0.1-py3-none-any.whl

import friendlyetl as fetl

# Extract data from CSV
df = fetl.extract_data('input/sales.csv')

# Transform data
clean_df = fetl.clean_data(df)

# Load to MySQL
fetl.load_to_mysql(clean_df, db_name="sales_db", table_name="clean_sales")

 ## Dependencies
Python 3.6+

pandas

sqlalchemy

mysql-connector-python (if using MySQL)

Install all dependencies:

pip install -r requirements.txt
👤 Author
Divith Raju
Built with ❤️ to simplify ETL pipelines.
🔗 GitHub

📜 License
This project is licensed under the MIT License. See LICENSE file for more information.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

friendlyetl-1.0.4.tar.gz (4.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

friendlyetl-1.0.4-py3-none-any.whl (4.3 kB view details)

Uploaded Python 3

File details

Details for the file friendlyetl-1.0.4.tar.gz.

File metadata

  • Download URL: friendlyetl-1.0.4.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.12

File hashes

Hashes for friendlyetl-1.0.4.tar.gz
Algorithm Hash digest
SHA256 3e49f42998f2b103460526d09eb62c3b8e699e0b605efc8716c5751b7ee82767
MD5 7066bc4fb2a3d0df05fb0dfc292d222d
BLAKE2b-256 3651e00a4c9be0476b9fad8f22e3209cbcf97bd9318754478b44225cee7e64cc

See more details on using hashes here.

File details

Details for the file friendlyetl-1.0.4-py3-none-any.whl.

File metadata

  • Download URL: friendlyetl-1.0.4-py3-none-any.whl
  • Upload date:
  • Size: 4.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.12

File hashes

Hashes for friendlyetl-1.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 358d31ad2dc4ad8441b2b95ac437b742fce8f751b61a7466814655013f04d751
MD5 462c03e7c734dcefdc45b9d2415e33ab
BLAKE2b-256 7f33637ba549599536ad81dd67afaa987c3f154d0c79b610fe9c3086f4ae8a27

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page