Project description

sparksql-magic

Spark SQL magic command for Jupyter notebooks.

Example

pip install sparksql-magic

%load_ext sparksql_magic

%config SparkSql.max_num_rows=<INT>

Option	Default	Description
`SparkSql.max_num_rows`	20	The maximum number of rows to display

%%sparksql [-c] [-v VIEW] [variable]
<QUERY>

Parameter	Description
`-c` `--cache`	Cache dataframe
`-e` `--eager`	Cache dataframe with eager load
`-v VIEW` `--view VIEW`	Create or replace temporary view
`variable`	Capture dataframe in a local variable

These details have not been verified by PyPI

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

0.0.3

Feb 13, 2020

This version

0.0.2

May 23, 2019

0.0.1

May 23, 2019

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Uploaded May 23, 2019 Source

Uploaded May 23, 2019 Python 3.6

Hashes for sparksql-magic-0.0.2.tar.gz
Algorithm	Hash digest
SHA256	`5f16bc678b17e138961883c1d639df863572caa320b135c5e68c6b71754a9cfe`
MD5	`81b8f9b6370a90eb5540c8fc4d79b28a`
BLAKE2b-256	`82abcba9bf2ccef6a9647876cb87f69060ec0a4ce4ca8444ac9ac30617a26de4`

Hashes for sparksql_magic-0.0.2-py36-none-any.whl
Algorithm	Hash digest
SHA256	`d7e3f959a12cc2fe3adc7a8dcdec50380b3b90967842e386b41beba323398f49`
MD5	`f1dc031e355737c7d1a2ddbf648e491e`
BLAKE2b-256	`c820476cc23398970731b6fd4ebe1921d56dec9580dd407025da391645310c98`