connection-helper 0.8.11

A collection of helper for sql connections

connection-helper

usage

install / update package

pip install connection-helper -U

include in python

from connection_helper import sql, pgp, sec

why use connection-helper

connection-helper bundles some packages for connecting to sql databases

• sql is added as convenience wrapper for retrieving data from sql databases

  • connect_sql() to get get data from ['mssql', 'sqlite','postgres']
  • load_sql_to_sqlite connect to a sql db and transfer a list of tables to sqlite
  • load_sqlite_to_parquet() to get all tables from a sqlite file as parquets
  • unpack_files_to_duckdb() return a tuple of all files of a dir (csv or parquet) into high performance duckdb objects ⚡
  • print_meta() print meta information of a certain database (niche case)
  • load_from_mssql() load data from an MSSQL database into a Pandas DataFrame
  • save_to_mssql() save data from a Pandas DataFrame to an MSSQL database
  • 🆕 load_file_to_duckdb() load data from various sources into a duckdb database, using pandas read functions (experimental)
  • azure storage connector 🚧

• pgp cryptographic tools adapted from python-gnupg. this is a wrapper around gnupg, but only offers some cenvenience or tailored options. feel free to use the original library or the GNU Privacy Guard.

  • encrypt() a message for one or more recipient(s) with a public key
  • decrypt() a message with a private key. Passphrase must be provided via env variable
  • find_key() in keyring
  • ...

💡 The pgp methods require a pgp public/private key in the keyring

• sec secrets module. ⚠️ this package is optional and must be extra installed with pip install 'connection-helper[sec]' (enclose in '')
  • 🆕 get_infisical_secrets() retrieve secrets from Infisical project (requires existing account and machine identities)