Skip to main content

etlhelper is Python ETL library to simplify data transfer into and out of databases.

Project description

etlhelper

etlhelper is a Python ETL library to simplify data transfer into and out of databases.

ETL Helper makes it easy to run SQL queries via Python and return the results. It takes care of cursor management, importing drivers and formatting connection strings, while providing memory-efficient functions to read, write and transform data. This reduces the amount of boilerplate code required to manipulate data within relational databases with Python.



Version 1.0 coming soon!

The code for ETL Helper version 1.0 has now been merged into main, although not yet deployed to PyPI. It contains many breaking changes. The documentation pages now correspond to the upcoming version 1.0. Specify a release candidate tag or use --pre flag with pip to install pre-release versions.

Installation

ETL Helper is available on PyPI (version 0.14.3). Documentation for v0.14.3 is here.

pip install etlhelper

Database driver packages are not included by default and should be specified in square brackets. Options are oracle (installs oracledb), mssql (installs pyodbc) and postgres (installs psycopg2). Multiple values can be separated by commas.

pip install etlhelper[oracle,postgres]

See the individual database driver configuration pages for any OS-level dependencies.

Development

ETL Helper was created by and is maintained by British Geological Survey Informatics.

See CONTRIBUTING.md for details on how to contribute.

Licence

ETL Helper is distributed under the LGPL v3.0 licence. Copyright: © BGS / UKRI 2019

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlhelper-1.0.0rc3.tar.gz (662.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlhelper-1.0.0rc3-py3-none-any.whl (26.9 kB view details)

Uploaded Python 3

File details

Details for the file etlhelper-1.0.0rc3.tar.gz.

File metadata

  • Download URL: etlhelper-1.0.0rc3.tar.gz
  • Upload date:
  • Size: 662.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.0 CPython/3.9.19

File hashes

Hashes for etlhelper-1.0.0rc3.tar.gz
Algorithm Hash digest
SHA256 a539e6aa9dd5e8b7d08c579f9956362031b075f71e6be8b53de3ebb33997521a
MD5 8378bdd8aa6deeb980b62a527970cf2d
BLAKE2b-256 cde069a5b70abaafb57a5d885faecf750e019ae7c410e215d33f5bf31abea09c

See more details on using hashes here.

File details

Details for the file etlhelper-1.0.0rc3-py3-none-any.whl.

File metadata

  • Download URL: etlhelper-1.0.0rc3-py3-none-any.whl
  • Upload date:
  • Size: 26.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.0 CPython/3.9.19

File hashes

Hashes for etlhelper-1.0.0rc3-py3-none-any.whl
Algorithm Hash digest
SHA256 12290be8c9c18b6e70d6f991a41681da344fdd2e06be0a0df884299553db3897
MD5 770c4b71bda099962f88eed2fe7707be
BLAKE2b-256 b606aa95c12b30b76b2754107ba05d5e99679285ead2ddaca3852dc8d0e543ff

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page