Skip to main content

Qubole Presto/Hive for SQLAlchemy

Project description

The SQLAlchemy is the Python SQL Toolkit and Object Relational Mapper. The primary purpose of this is to have a working dialect for Qubole Presto and Hive that can be used with Apache Superset. This uses Qubole JDBC driver to connect to Qubole Presto/Hive.

Prerequisites

  • JDK 8 or later
  • Python 3.x

Installation

  • Download the Qubole JDBC driver (version 2.3 or later) from here
  • Set the environment variable QUBOLE_JDBC_JAR_PATH pointing to JDBC JAR location with absolute path

Example:

export QUBOLE_JDBC_JAR_PATH=/Users/testuser/qubolejdbc/qds-jdbc-2.3.0.jar
  • Install the sqlalchemy-qubole package. The package is available on PyPI

    $ pip install sqlalchemy-qubole
    

Note: Ensure pip is pointing to Python3 OR use pip3 instead as this package supports Python 3.x version

Example of SQLAlchemy URIs to connect to Qubole

  • Presto Dialect:

    qubole+presto://presto/presto_cluster?endpoint=https://api.qubole.com;password=<API-TOKEN>;catalog_name=hive
    
  • Hive Dialect:

    qubole+hive://hive/hadoop2?endpoint=https://api.qubole.com;password=<API-TOKEN>
    
  • Default Dialect: By default, Qubole dialect points to presto.

    qubole://presto/presto_cluster?endpoint=https://api.qubole.com;password=<API-TOKEN>;catalog_name=hive
    

Reporting Bugs

  • Want to report a bug or request a feature? Please contact Qubole Support.

Project details


Release history Release notifications

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for sqlalchemy-qubole, version 1.0.0
Filename, size File type Python version Upload date Hashes
Filename, size sqlalchemy_qubole-1.0.0_hf1.tar.gz (5.9 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page