Emery Berger, Cormac Flanagan, Stephen Freund, Eunice Jun
Output consistency for Jupyter notebooks.
FlowBook is a JupyterLab extension that enforces rerun consistency: re-executing any cell from the current state would produce a result consistent with a top-to-bottom execution of the notebook, regardless of which cells have been run, modified, and rerun. Cells whose inputs may have changed are marked stale, and operations that would break rerun consistency (e.g., a later cell overwriting a value read by an earlier one) disallowed.
When every cell is clean — executed and rerun consistent — the notebook is guaranteed output consistent: running it top-to-bottom from an empty store yields exactly the outputs currently recorded.
For technical details and a complete evaluation, see our arXiv paper: FlowBook: Enforcing Reproducibility in Computational Notebooks.
(Note: we sometimes use reproducibility as a synonym for output consistency in the documentation and code.)
Quick Start
-
Install from Pypi:
python3 -m pip install flowbook-python
or from this repository:
python3 -m pip install -e .
-
You will need Python and node. More details on installation from source below.
Then launch jupyter lab
jupyter lab examples/
Once JupyterLab opens, create or open a notebook and select the FlowBook kernel from the kernel picker.
To walk through FlowBook's features interactively, download the Getting Started demo notebook, open it in JupyterLab. Be sure to use the FlowBook Kernel.
For a longer, self-contained tutorial, download our FlowBook tutorial
AI Fix Suggestions
FlowBook can ask an LLM to diagnose any violation it raises and propose one-click fixes. The suggestion appears directly inside the violation notice underneath the cell, with buttons that apply the fix automatically.
To use this feature, set the ANTHROPIC_API_KEY environment variable to a
valid Anthropic API key before launching JupyterLab. If no provider key is
set, the suggestion UI is silently disabled — violations still appear, just
without diagnoses and fix buttons.
For other providers, model selection, costs, safety constraints, and the full feature description, see AI.md.
Troubleshoot
If FlowBook does not appear to be working, work through these steps:
1. Confirm the server extension is enabled.
jupyter server extension list
Look for flowbook marked as enabled. If it is missing or disabled,
enable it:
jupyter server extension enable flowbook
2. Confirm the frontend extension is installed.
jupyter labextension list
Look for flowbook in the list of enabled extensions. If it is not
there, reinstall the package:
python3 -m pip install --force-reinstall flowbook-python
3. Confirm the FlowBook kernel is registered.
jupyter kernelspec list
You should see flowbook_kernel in the output. If it is missing,
reinstall the package (step 2) — the kernelspec is registered at
install time.
4. Pick the FlowBook kernel in your notebook.
FlowBook only tracks notebooks running under the FlowBook Kernel. Use JupyterLab's kernel picker (top-right of the notebook) to switch away from the default Python kernel if you are not seeing staleness/violation markers.
5. Hard-refresh the browser.
After installing or upgrading, JupyterLab may cache older frontend
assets. Do a hard refresh (Cmd+Shift+R on macOS, Ctrl+Shift+F5 on
Linux/Windows) and reopen the notebook.
6. Check the browser console and the JupyterLab server log.
Open the browser's developer tools (Cmd+Option+I / Ctrl+Shift+I)
and look for errors in the Console tab. Also look at the terminal
where you launched jupyter lab for server-side errors. These often
point directly at the underlying problem (missing dependency, version
mismatch, etc.).
7. AI fix suggestions not appearing.
If violations show up correctly but you don't see a diagnosis or fix buttons underneath them:
- Confirm
litellmis installed (pip show litellm). - Confirm the provider API key for your configured
fix_modelis set in the same shell where you launchedjupyter lab(runecho $ANTHROPIC_API_KEYetc.). - Check the Jupyter server log for
503responses from/flowbook/suggest-fix— those mean the feature self-disabled because no provider key was found. - Hard-refresh the browser; previously cached HTML for older violation notices won't have the new diagnosis/buttons placeholders.
8. Still stuck?
Please file an issue at github.com/stephenfreund/FlowBook/issues with the outputs of the commands above, your OS and Python version, and a minimal notebook that reproduces the problem.
Uninstall
To remove the extension, execute:
pip uninstall flowbook-python
Source Installation
Clone this repository and then install it as an editable package
python3 -m pip install -e .
jupyter lab examples/
Once JupyterLab opens, create or open a notebook and select the
FlowBook kernel from the kernel picker. Start with
GettingStarted.ipynb, then explore the demos/ and litmus/
directories.
Note: You will need NodeJS to build the extension package.
The jlpm command is JupyterLab's pinned version of
yarn that is installed with JupyterLab. You may use
yarn or npm in lieu of jlpm below.
# Clone the repo to your local environment
# Change directory to the flowbook directory
# Install package in development mode
pip install -e "."
# Link your development version of the extension with JupyterLab
jupyter labextension develop . --overwrite
# Server extension must be manually installed in develop mode
jupyter server extension enable flowbook
# Rebuild extension Typescript source after making changes
jlpm build
You can watch the source directory and run JupyterLab at the same time in different terminals to watch for changes in the extension's source and automatically rebuild the extension.
# Watch the source directory in one terminal, automatically rebuilding when needed
jlpm watch
# Run JupyterLab in another terminal
jupyter lab
With the watch command running, every saved change will immediately be built locally and available in your running JupyterLab. Refresh JupyterLab to load the change in your browser (you may need to wait several seconds for the extension to be rebuilt).
By default, the jlpm build command generates the source maps for this extension to make it easier to debug using the browser dev tools. To also generate source maps for the JupyterLab core extensions, you can run the following command:
jupyter lab build --minimize=False
Running tests
Run the full Python test suite with pytest:
pytest flowbook/
To run the tests for a specific subpackage, point pytest at its tests/ directory, e.g.:
pytest flowbook/kernel/tests/
pytest flowbook/mcp/tests/
Development uninstall
# Server extension must be manually disabled in develop mode
jupyter server extension disable flowbook
pip uninstall flowbook-python
In development mode, you will also need to remove the symlink created by jupyter labextension develop
command. To find its location, you can run jupyter labextension list to figure out where the labextensions
folder is located. Then you can remove the symlink named flowbook within that folder.
Metadata
Release files for flowbook-python 0.1.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| flowbook_python-0.1.4.tar.gz | 1.9 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| flowbook_python-0.1.4-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 3.3 MB
Release files / flowbook_python-0.1.4.tar.gz
| Download URL | flowbook_python-0.1.4.tar.gz |
|---|---|
| Size | 1.9 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
d3bf88bca1bc5c42cb13c47a747f74b2574036dcdb2dbe976488c4cd7aa7406c
|
|
BLAKE2b-256 checksum How to use checksums |
1108eceaa7f146b99a52cd9b9ab76445af970a688e763bbb566e3ecb95e1a928
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.14
|
Release files / flowbook_python-0.1.4-py3-none-any.whl
| Download URL | flowbook_python-0.1.4-py3-none-any.whl |
|---|---|
| Size | 1.4 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
c84c480dce538eecc3cb6c1a9e854a7ec47123b4a2290428d72e15b711b1df4d
|
|
BLAKE2b-256 checksum How to use checksums |
de6b1674d2c6ef63b956bdf668ee3f65cd1f5ffc1217cd2cd73d82dbf4473745
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.14
|