A PySpark kernel for Jupyter/IPython
Project description
# pyspark_kernel
A PySpark Jupyter kernel that utilizes [metakernel](https://github.com/Calysto/metakernel) to create an easy to initialize pyspark kernel for Python. This package resembles the [spylon-kernel](https://github.com/vericast/spylon-kernel) that utilizes metakernel as well.
## Prerequisites
Apache Spark
Jupyter Notebook
Python 3.5+
## Install Package
You can install the pyspark_kernel package using pip.
`bash pip install pyspark_kernel `
## Install Kernel to use in Jupyter
To use pyspark_kernel as PySpark kernel for Jupyter Notebook run the following command:
`bash python -m pyspark_kernel install `
Once Jupyter launches and you should see PySpark as an option in the New dropdown menu.
## Packaging To package to deploy simply run the following command from the top level of the package.
`bash python setup.py sdist `
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file pyspark_kernel-0.3.0.tar.gz
.
File metadata
- Download URL: pyspark_kernel-0.3.0.tar.gz
- Upload date:
- Size: 6.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.6.0 importlib_metadata/4.8.2 pkginfo/1.8.1 requests/2.22.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 13d8fbe9f3e2a061efc79497836cc9d8215c4a572ca3cb0f147f9b079fc65fdd |
|
MD5 | b00a46360f5ee89eb2a09f579f281b18 |
|
BLAKE2b-256 | df6afb5e12dfde7499f1d3a7097e784d80af5f7310fcf48c7b32c67e10b13265 |