Skip to main content

Implementation helper for running rerun-sdk in notebooks

Project description

rerun-notebook

Part of the Rerun project.

What?

rerun-notebook is a support package for rerun-sdk's notebook integration. This is an implementation package that shouldn't be directly interacted with. It is typically installed using the notebook extra of rerun-sdk:

pip install "rerun-sdk[notebook]"

Why a separate package?

There are several reasons for this package to be separate from the main rerun-sdk package:

  • rerun-notebook includes the JS+Wasm distribution of the Rerun viewer (~31MiB). Adding it to the main rerun-sdk package would double its file size.
  • rerun-notebook uses hatch as package backend, and benefits from the hatch-jupyter-builder plug-in. Since rerun-sdk must use Maturin, it would make the package management more complex.
  • Developer experience: building rerun-notebook implies building rerun_js, which is best avoided when iterating on rerun-sdk outside of notebook environments.

Ways to access the widget assets

Even though rerun_notebook ships with the assets bundled in, by default it will try to load them from https://app.rerun.io. This is because the way anywiget transmits the asset at the moment results in a memory leak of the entire module for each cell execution.

If your network does not allow you to access app.rerun.io, the behavior can be changed by setting the the RERUN_NOTEBOOK_ASSET environment variable before you import rerun_notebook. This variable must be set prior to your import because AnyWidget stores the resource on the widget class instance once at import time.

The assets are:

  • re_viewer_bg.wasm, which is our Viewer compiled to Wasm, and
  • widget.js, which is the glue code used to bind it to a Jupyter widget.

Both can be built in the rerun repository by running pixi run py-build-notebook.

Inlined assets

Setting:

RERUN_NOTEBOOK_ASSET=inline

Will cause rerun_notebook to directly transmit the inlined assets to the widget over Jupyter comms. This will be the most portable way to use the widget, but is currently known to leak memory and has some performance issues in environments such as Google colab. The browser cannot cache the resulting JS/Wasm, so it ends up spending a lot more time loading it in every output cell.

Locally served assets

Setting:

RERUN_NOTEBOOK_ASSET=serve-local

Will cause rerun_notebook to launch a thread serving the assets from the local machine during the lifetime of the kernel. This will be the best way to use the widget in a notebook environment when your notebook server is running locally.

The JS and Wasm are served separately, so the Wasm can be stream-compiled, resulting in much faster startup times. Both can also be cached by the browser.

Manually hosted assets

Setting:

RERUN_NOTEBOOK_ASSET=https://your-hosted-asset-url.com/widget.js

Will cause rerun_notebook to load the assets from the provided URL. This is the most flexible way to use the widget, but requires you to host the asset yourself.

Note that we require the URL to point to a widget.js file, but the Wasm file must be accessible from a URL directly adjacent to it. Your server should provide both files:

  • https://your-hosted-asset-url.com/widget.js
  • https://your-hosted-asset-url.com/re_viewer_bg.wasm

The rerun_notebook package has a minimal server that can be used to serve the assets manually by running:

python -m rerun_notebook serve

However, any hosting platform can be used to serve the assets, as long as it is accessible to the notebook and has appropriate CORS headers set. See: asset_server.py for a simple example.

Run from source

Use Pixi:

# build rerun-sdk and rerun-notebook from source
pixi run py-build && pixi run py-build-notebook

# run jupyter
pixi run uv run jupyter notebook

Development

Run the pixi run py-build-notebook build command any time you make changes to the Viewer or TypeScript code. Changing python code only requires restarting the Jupyter kernel.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

rerun_notebook-0.29.1-py2.py3-none-any.whl (13.1 MB view details)

Uploaded Python 2Python 3

File details

Details for the file rerun_notebook-0.29.1-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for rerun_notebook-0.29.1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 375e93cc71a79ba1f8e31090860bdd5b26ca3479ceea57606d7ee533dea43cb0
MD5 0744c28b418514dd5f291beec57939c1
BLAKE2b-256 d7bc78cfa75081a67619953853dbbe38fad441c43c38c6fdc5fc886c9a5667e1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page