Skip to main content

Qubole Presto/Hive for SQLAlchemy

Project description

The SQLAlchemy is the Python SQL Toolkit and Object Relational Mapper. The primary purpose of this is to have a working dialect for Qubole Presto and Hive that can be used with Apache Superset. This uses Qubole JDBC driver to connect to Qubole Presto/Hive.

Prerequisites

  • JDK 8 or later
  • Python 3.x

Installation

  • Download the Qubole JDBC driver (version 2.3 or later) from here
  • Set the environment variable QUBOLE_JDBC_JAR_PATH pointing to JDBC JAR location with absolute path

Example:

export QUBOLE_JDBC_JAR_PATH=/Users/testuser/qubolejdbc/qds-jdbc-2.3.0.jar
  • Install the sqlalchemy-qubole package. The package is available on PyPI

    $ pip install sqlalchemy-qubole
    

Note: Ensure pip is pointing to Python3 OR use pip3 instead as this package supports Python 3.x version

Example of SQLAlchemy URIs to connect to Qubole

  • Presto Dialect:

    qubole+presto://presto/presto_cluster?endpoint=https://api.qubole.com;password=<API-TOKEN>;catalog_name=hive
    
  • Hive Dialect:

    qubole+hive://hive/hadoop2?endpoint=https://api.qubole.com;password=<API-TOKEN>
    
  • Default Dialect: By default, Qubole dialect points to presto.

    qubole://presto/presto_cluster?endpoint=https://api.qubole.com;password=<API-TOKEN>;catalog_name=hive
    

Reporting Bugs

  • Want to report a bug or request a feature? Please contact Qubole Support.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sqlalchemy_qubole-1.0.7.tar.gz (5.9 kB view hashes)

Uploaded source

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page