easy-data-loader 0.1.0

Data transfer utilities between files and databases

Easy Data Loader 🚀

Easy Data Loader is a flexible, modular Python library designed to streamline ETL (Extract, Transform, Load) processes between various data sources (CSV, Excel, Parquet) and SQL databases (MSSQL, PostgreSQL, and others).

✨ Key Features

• Declarative Configuration: Manage connections and pipelines through simple python files and .env resources.
• Integrated CLI: Initialize a standardized project structure with a single command.
• Custom Transformation Hooks: Inject your own Pandas transformation logic directly into the pipeline execution.
• Performance Optimized: Built-in support for chunked loading and writing to handle large datasets efficiently.
• Extensible Architecture: Uses a Factory Pattern for database connectors, making it easy to support new drivers.

---

📦 Installation

Install directly via pip or uv:

pip install easy_data_loader

🚀 Getting Started

1. Initialize a new project structure to generate template configurations:

   easy-loader init
   

2. Review the generated config/ folders for sample resources and pipelines.
3. Run all discovered pipelines across the active configurations:

   easy-loader run_all