etlhelper is Python ETL library to simplify data transfer into and out of databases.
Project description
etlhelper
etlhelper is a Python ETL library to simplify data transfer into and out of databases.
ETL Helper makes it easy to run SQL queries via Python and return the results. It takes care of cursor management, importing drivers and formatting connection strings, while providing memory-efficient functions to read, write and transform data. This reduces the amount of boilerplate code required to manipulate data within relational databases with Python.
- Documentation: https://britishgeologicalsurvey.github.io/etlhelper/
- Source code: https://github.com/BritishGeologicalSurvey/etlhelper
Version 1.0 coming soon!
The code for ETL Helper version 1.0 has now been merged into main
, although not yet deployed to PyPI.
It contains many breaking changes.
The documentation pages now correspond to the upcoming version 1.0.
Specify a release candidate tag or use --pre
flag with pip
to install pre-release versions.
Installation
ETL Helper is available on PyPI (version 0.14.3). Documentation for v0.14.3 is here.
pip install etlhelper
Database driver packages are not included by default and should be specified in square brackets. Options are oracle (installs oracledb), mssql (installs pyodbc) and postgres (installs psycopg2). Multiple values can be separated by commas.
pip install etlhelper[oracle,postgres]
See the individual database driver configuration pages for any OS-level dependencies.
Development
ETL Helper was created by and is maintained by British Geological Survey Informatics.
- John A Stevenson (volcan01010)
- Jo Walsh (metazool)
- Declan Valters (dvalters)
- Colin Blackburn (ximenesuk)
- Daniel Sutton (kerberpolis)
- Leo Rudczenko (leorudczenko)
See CONTRIBUTING.md for details on how to contribute.
Licence
ETL Helper is distributed under the LGPL v3.0 licence. Copyright: © BGS / UKRI 2019
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file etlhelper-1.0.0.tar.gz
.
File metadata
- Download URL: etlhelper-1.0.0.tar.gz
- Upload date:
- Size: 666.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.9.19
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7cdf5cb721f6dcd03f3db097fdd3ff509048e44b3ef530bbe94af762766a03ea |
|
MD5 | 65e2c852de6d6402589302fcf2e271ab |
|
BLAKE2b-256 | ae0ace5d4f27d7d1bbf58c61aa8e22dac6cf52b4758abf94a1fbf4ca26fb3af9 |
File details
Details for the file etlhelper-1.0.0-py3-none-any.whl
.
File metadata
- Download URL: etlhelper-1.0.0-py3-none-any.whl
- Upload date:
- Size: 26.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.9.19
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 10c734e2344ac2a58f5cf4e5de85492ca78d3b72aca779e2d3ee75e685a00fc3 |
|
MD5 | c313e3789ecbc2c84072db64ebb551c0 |
|
BLAKE2b-256 | fd9decb843a3daeee9053d9c035b201a26eeb8834608ebcd58dfe6b570554924 |