Skip to main content

Versatile Data Kit SDK plugin provides support for Impala database.

Project description

This plugin allows vdk-core to interface with and execute queries against an Impala database.

Usage

Run

pip install vdk-impala

After this, data jobs will have access to a Impala database connection, managed by Versatile Data Kit SDK.

If it is the only database plugin installed , vdk would automatically use it. Otherwise, users need to set VDK_DB_DEFAULT_TYPE=IMPALA as an environment variable or set 'db_default_type' option in the data job config file (config.ini).

For example

    def run(job_input: IJobInput):
        job_input.execute_query("select 'Hi Impala!'")

Configuration

Run vdk config-help - search for those prefixed with "IMPALA_" to see what configuration options are available.

Disclaimer

This plugin is tested against a specific impala version. The version comes from the docker-compose.yaml container's impala version. For more information on the imapala version tested against please google the docker image.

Testing

Testing this plugin locally requires installing the dependencies listed in vdk-plugins/vdk-impala/requirements.txt

Run

pip install -r requirements.txt

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vdk-impala-0.2.510587356.tar.gz (18.2 kB view details)

Uploaded Source

File details

Details for the file vdk-impala-0.2.510587356.tar.gz.

File metadata

  • Download URL: vdk-impala-0.2.510587356.tar.gz
  • Upload date:
  • Size: 18.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.0 CPython/3.7.13

File hashes

Hashes for vdk-impala-0.2.510587356.tar.gz
Algorithm Hash digest
SHA256 9ef691b06e10d7646daf789dc5b1b072512d161c16ecbcabb588a09a09f436cb
MD5 3e884a79350d2947366640454b02e309
BLAKE2b-256 cf38d4e653062257738139fe9b117f6de03352d1befe8b182b8940b2c6b3b310

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page