A Python client for Apache Livy
Project description
Livy is an open source REST interface for interacting with Spark. pylivy is a Python client for Livy, enabling easy remote code execution on a Spark cluster:
from livy import Livy
with Livy('http://spark.example.com:8998') as client:
# Run some code on the remote cluster
client.run("filtered = df.filter(df.name == 'Bob')")
# Retrieve the result
local_df = client.read('filtered')
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
livy-0.1.0.tar.gz
(3.7 kB
view hashes)