Skip to main content

Python interface to Hive

Project description

PyHive is a collection of Python DB-API and SQLAlchemy interfaces for Presto and Hive.



from pyhive import presto
cursor = presto.connect('localhost').cursor()
cursor.execute('SELECT * FROM my_awesome_data LIMIT 10')
print cursor.fetchone()
print cursor.fetchall()


First install this package to register it with SQLAlchemy (see

from sqlalchemy import *
from sqlalchemy.engine import create_engine
from sqlalchemy.schema import *
engine = create_engine('presto://localhost:8080/hive/default')
logs = Table('my_awesome_data', MetaData(bind=engine), autoload=True)
print select([func.count('*')], from_obj=logs).scalar()

Note: query generation functionality is not exhaustive or fully tested, but there should be no problem with raw SQL.

Passing Hive configuration

(Does not apply to Presto)

hive.connect('localhost', configuration={'hive.exec.reducers.max': '123'})
# SQLAlchemy
    connect_args={'configuration': {'hive.exec.reducers.max': '123'}},


Install using

  • pip install pyhive[hive] for the Hive interface and

  • pip install pyhive[presto] for the Presto interface.

PyHive works with

  • Python 2.7

  • For Presto: Presto install

  • For Hive: HiveServer2 daemon

There’s also a third party Conda package.


Run the following in an environment with Hive/Presto:

virtualenv --no-site-packages env
source env/bin/activate
pip install -e .
pip install -r dev_requirements.txt

WARNING: This drops/creates tables named one_row, one_row_complex, and many_rows, plus a database called pyhive_test_database.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

PyHive-0.1.7.tar.gz (40.3 kB view hashes)

Uploaded source

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page