A Python client for Apache Livy
Project description
pylivy
======
.. image:: https://travis-ci.org/acroz/pylivy.svg?branch=master
:target: https://travis-ci.org/acroz/pylivy
.. image:: https://badge.fury.io/py/livy.svg
:target: https://pypi.org/project/livy/
`Livy <https://livy.incubator.apache.org/>`_ is an open source REST interface
for interacting with `Spark <http://spark.apache.org/>`_. ``pylivy`` is a
Python client for Livy, enabling easy remote code execution on a Spark cluster.
Usage
-----
.. code:: python
from livy import LivySession
LIVY_URL = 'http://spark.example.com:8998'
with LivySession(LIVY_URL) as session:
# Run some code on the remote cluster
session.run("filtered = df.filter(df.name == 'Bob')")
# Retrieve the result
local_df = session.read('filtered')
Fork of https://github.com/acroz/pylivy
======
.. image:: https://travis-ci.org/acroz/pylivy.svg?branch=master
:target: https://travis-ci.org/acroz/pylivy
.. image:: https://badge.fury.io/py/livy.svg
:target: https://pypi.org/project/livy/
`Livy <https://livy.incubator.apache.org/>`_ is an open source REST interface
for interacting with `Spark <http://spark.apache.org/>`_. ``pylivy`` is a
Python client for Livy, enabling easy remote code execution on a Spark cluster.
Usage
-----
.. code:: python
from livy import LivySession
LIVY_URL = 'http://spark.example.com:8998'
with LivySession(LIVY_URL) as session:
# Run some code on the remote cluster
session.run("filtered = df.filter(df.name == 'Bob')")
# Retrieve the result
local_df = session.read('filtered')
Fork of https://github.com/acroz/pylivy
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pylivy-0.0.3.tar.gz
(6.4 kB
view hashes)