pythena 0.3.1

A simple athena wrapper leveraging boto3 to execute queries and return results while only requiring a database and a query string.

pythena

This is a simple python module that will allow you to query athena the same way the AWS Athena console would. It only requires a database name and query string.

Install

pip install pythena

Setup

Be sure to set up your AWS authentication credentials. You can do so by using the aws cli and running

pip install awscli
aws configure

More help on configuring the aws cli here https://docs.aws.amazon.com/cli/latest/userguide/cli-chap-configure.html

Usage

import pythena

athena_client = pythena.Athena(database="mydatabase") 

# Returns results as a pandas dataframe
df = athena_client.execute(query="select * from mytable")

print(df.sample(n=2)) # Prints 2 rows from your dataframe

Specify an s3 url to save results to a bucket.

import pythena

athena_client = pythena.Athena(database="mydatabase")

# Returns results as a pandas dataframe
df = athena_client.execute(query="select * from mytable", 
                    s3_output_url="s3://mybucket/mydir")

print(df.sample(n=2)) # Prints 2 rows from your dataframe

Extra Usages

import pythena

pythena.print_databases() # Prints out all databases listed in the glue catalog
pythena.print_databases(region='us-east-1') # Overrides default region


athena_client = pythena.Athena(database="mydatabase", region='us-east-1') # Override default region

athena_client.print_tables('mydatabase') # Prints out all tables in a database

Note

By default, when executing athena queries, via boto3 or the AWS athena console, the results are saved in an s3 bucket. This module by default, assuming a successful execution, will delete the s3 result file to keep s3 clean. If an s3_output_url is provided, then the result file will not be deleted.