Skip to main content

etlhelper is Python ETL library to simplify data transfer into and out of databases.

Project description

etlhelper

etlhelper is a Python ETL library to simplify data transfer into and out of databases.

ETL Helper makes it easy to run SQL queries via Python and return the results. It takes care of cursor management, importing drivers and formatting connection strings, while providing memory-efficient functions to read, write and transform data. This reduces the amount of boilerplate code required to manipulate data within relational databases with Python.



Version 1.0 coming soon!

The code for ETL Helper version 1.0 has now been merged into main, although not yet deployed to PyPI. It contains many breaking changes. The documentation pages now correspond to the upcoming version 1.0. Specify a release candidate tag or use --pre flag with pip to install pre-release versions.

Installation

ETL Helper is available on PyPI (version 0.14.3). Documentation for v0.14.3 is here.

pip install etlhelper

Database driver packages are not included by default and should be specified in square brackets. Options are oracle (installs oracledb), mssql (installs pyodbc) and postgres (installs psycopg2). Multiple values can be separated by commas.

pip install etlhelper[oracle,postgres]

See the individual database driver configuration pages for any OS-level dependencies.

Development

ETL Helper was created by and is maintained by British Geological Survey Informatics.

See CONTRIBUTING.md for details on how to contribute.

Licence

ETL Helper is distributed under the LGPL v3.0 licence. Copyright: © BGS / UKRI 2019

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlhelper-1.0.0rc3.tar.gz (662.5 kB view hashes)

Uploaded Source

Built Distribution

etlhelper-1.0.0rc3-py3-none-any.whl (26.9 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page