PyHive
PyHive is a collection of Python DB-API and SQLAlchemy interfaces for Presto and Hive.
Usage
DB-API
from pyhive import presto
cursor = presto.connect('localhost').cursor()
cursor.execute('SELECT * FROM my_awesome_data LIMIT 10')
print cursor.fetchone()
print cursor.fetchall()SQLAlchemy
First install this package to register it with SQLAlchemy (see setup.py).
from sqlalchemy import *
from sqlalchemy.engine import create_engine
from sqlalchemy.schema import *
engine = create_engine('presto://localhost:8080/hive/default')
logs = Table('my_awesome_data', MetaData(bind=engine), autoload=True)
print select([func.count('*')], from_obj=logs).scalar()Note: query generation functionality is not exhaustive or fully tested, but there should be no problem with raw SQL.
Requirements
Install using pip install pyhive.
Python 2.7
For Presto: Just a Presto install
For Hive
HiveServer2 daemon
TCLIService (from Hive in /usr/lib/hive/lib/py)
thrift_sasl (from Cloudera)
There’s also a third party Conda package.
Testing
Run the following in an environment with Hive/Presto:
./scripts/make_test_tables.sh virtualenv --no-site-packages env source env/bin/activate pip install -e . pip install -r dev_requirements.txt py.test
WARNING: This drops/creates tables named one_row, one_row_complex, and many_rows, plus a database called pyhive_test_database.
4 maintainers
Metadata
4 maintainers
Release files for PyHive 0.1.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| PyHive-0.1.5.tar.gz | 19.8 kB | Details |
Release files / PyHive-0.1.5.tar.gz
| Download URL | PyHive-0.1.5.tar.gz |
|---|---|
| Size | 19.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
fec1d1dc78a7e0729553cfdc5a7a56f47d086b388d5779c8d3bfe957eb6144a4
|
|
BLAKE2b-256 checksum How to use checksums |
4598e36d293cc5c95ebcd98322a2ece2050952cc1e3b85634ed4655db973341d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
