PyPETL

PyPETL (Python Pipeline Extract Transform Load) is an unofficial fork of PETL by Juarez Rudsatz and teams. This for extending the capabilities of the PETL package by optimizing IO process of the pipeline and an engine that capable on dynamically retrieve connection credential and manage several cloud services (only AWS Secret Manager for now).

Requirements

In order to use this package, the installer will install the following required package and its dependencies in your system:

• pandas >= 1.4.3
• petl >= 1.7.11
• redshift-connector >= 2.0.908
• psycopg2-binary >= 2.9.3
• paramiko >= 2.11.0
• sshtunnel >= 0.4.0
  
  

Installation

You cannot install this python package normally because this package can only be installed by build it from the source, not from PyPi Package Repositories. You can use the following command to install this package to your system:

git clone https://github.com/Renos-id/pypetl.git
cd pypetl
pip install setuptools wheel
pip uninstall pypetl
python setup.py install --prefix ~/.local/

Please remember that you need to logged in to renos github beforehand.