Skip to main content

A JupyterLab extension that provides SparkSQL magic commands, a SparkSQL syntax highlighter, and visualization widgets.

Project description

jupyterlab-sparksql

Github Actions Status A JupyterLab extension that provides SparkSQL magic commands, a SparkSQL syntax highlighter, and visualization widgets.

Requirements

  • JupyterLab >= 3.0

Install

To install the extension, execute:

pip install jupyterlab-sparksql

Uninstall

To remove the extension, execute:

pip uninstall jupyterlab-sparksql

Contributing

Development install

Note: You will need NodeJS to build the extension package.

The jlpm command is JupyterLab's pinned version of yarn that is installed with JupyterLab. You may use yarn or npm in lieu of jlpm below.

# Clone the repo to your local environment
# Change directory to the jupyterlab-sparksql directory
# Install package in development mode
pip install -e "."
# Link your development version of the extension with JupyterLab
jupyter labextension develop . --overwrite
# Rebuild extension Typescript source after making changes
jlpm build

You can watch the source directory and run JupyterLab at the same time in different terminals to watch for changes in the extension's source and automatically rebuild the extension.

# Watch the source directory in one terminal, automatically rebuilding when needed
jlpm watch
# Run JupyterLab in another terminal
jupyter lab

With the watch command running, every saved change will immediately be built locally and available in your running JupyterLab. Refresh JupyterLab to load the change in your browser (you may need to wait several seconds for the extension to be rebuilt).

By default, the jlpm build command generates the source maps for this extension to make it easier to debug using the browser dev tools. To also generate source maps for the JupyterLab core extensions, you can run the following command:

jupyter lab build --minimize=False

Development uninstall

pip uninstall jupyterlab-sparksql

In development mode, you will also need to remove the symlink created by jupyter labextension develop command. To find its location, you can run jupyter labextension list to figure out where the labextensions folder is located. Then you can remove the symlink named jupyterlab-sparksql within that folder.

Packaging the extension

See RELEASE

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

jupyterlab_sparksql-1.1.0.tar.gz (236.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

jupyterlab_sparksql-1.1.0-py3-none-any.whl (23.0 kB view details)

Uploaded Python 3

File details

Details for the file jupyterlab_sparksql-1.1.0.tar.gz.

File metadata

  • Download URL: jupyterlab_sparksql-1.1.0.tar.gz
  • Upload date:
  • Size: 236.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.3

File hashes

Hashes for jupyterlab_sparksql-1.1.0.tar.gz
Algorithm Hash digest
SHA256 f14ce7294d5e20d21f1b4b9104d3b669b360e4dc7a2450164a80e1cbc14eb9cb
MD5 8c04fd6558bb12b5c0f2eca0cc7d9591
BLAKE2b-256 c1eba4cd49796b7265bab58cc4f36ffe98bbcf46b560fa10270606e396a454e7

See more details on using hashes here.

File details

Details for the file jupyterlab_sparksql-1.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for jupyterlab_sparksql-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 77faedd58a61d0af1ac9c2d6d75369cc6fec57b8076bbcd3981beb2051a586af
MD5 c91ba710c51d64592b878038b6e73c7f
BLAKE2b-256 10c4306ce2a071344b154f0e978c452447dbf7f47dcfb01b12ef6a750331b729

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page