Skip to main content

Python Jupyter kernel using project/environment manangers like Rye, Uv, PDM, Poetry, Hatch etc.

Project description

Pyproject Local Jupyter Kernel

Website - PyPI PyPI - Python Version

Separate dependencies for Jupyter notebooks in separate projects.

Use python project managers to define dependencies: use one of Uv, Rye, PDM, Poetry, Hatch (and so on).

Instead of installing a myriad of jupyter kernelspecs, one per project, with this solution there is only one kernel provisioner that enables the environment for the project the notebook file resides in. This approach should be more portable, usable to anyone who checks out your project structure from git, and easier to use.

Pyproject Local supports the following systems, and reads pyproject.toml to figure out which kind of project it is:

Uv
Rye
Poetry
Hatch
PDM

A custom command or direct use of virtual environment can also be configured.

screenshot of notebook launcher

Quick Start (JupyterLab)

  1. Install pyproject-local-kernel in your jupyterlab environment and restart jupyterlab
  2. Create a new directory for the notebook project
  3. Create a new notebook and select the Pyproject Local kernel
  4. In the “fallback” environment that appears - because it is an empty project - create a new project.

(Example for Uv:)

!uv init && uv add ipykernel

  1. Use the restart button in JupyterLab to restart the kernel after these changes.
  2. Dependencies will quickly sync and you are good to go!
  3. Use more add commands to add further dependencies.

See the examples directory for how to setup jupyterlab and notebook projects separately. JupyterLab and the notebook are installed in separate environments.

Do you want to use pyproject-local-kernel in other environments, like with papermill, VSCodium or VS Code, or or other ways? See our FAQ for more information.

User Experience

If started in an empty directory or where a project is not correctly set up, the Pyproject Local will fail to start normally, but it will start a fallback kernel so that you can fix the project.

It will show a message like this - with some details about the error.

! Error: Could not find `ipykernel` in environment.
! Add `ipykernel` as a dependency in your project and update the virtual environment.
! The detected project type is: Unknown
!
! This is a fallback - pyproject-local-kernel failed to start.
! The purpose of the fallback is to let you run shell commands to fix the
! environment - when you are done, restart the kernel and try again!

Remember that you can also use jupyterlab's embedded terminal to help setting up a project.

No pyproject.toml

If the Pyproject Local kernel is selected in a project where there is no pyproject.toml, then starting the kernel fails. On first run it should show an error message in JupyterLab.

If this happens, create a new pyproject.toml with the editor or use one of the project init commands to create a new project.

No ipykernel in the project

The notebook project needs to install ipykernel as a dependency.

Edit the pyproject.toml to include ipykernel in dependencies:

dependencies = [
    "ipykernel>=6.29",
    # .. more dependencies
]

sync the changes to the project using sync command for the project manager you use, then restart the Pyproject Local kernel in jupyterlab.

Configuration

Configuration is optional and is read from pyproject.toml. Only the pyproject.toml closest to the notebook is read. Defaults are based on “sniffing” the pyproject.toml to detect which project manager is in use.

python-cmd

The key tool.pyproject-local-kernel.python-cmd should be a command that runs python from the environment you want to use for the project.

If this is set then it overrides the default command.

Default: Depends on project manager
Type: list[str] | str
Example:

[tool.pyproject-local-kernel]
python-cmd = ["uv", "run", "--with", "ipykernel", "python"]

use-venv

Path to virtual environment that should be used, relative to the pyproject.toml file. Can also be an absolute path.

If this is set then it overrides the default command - the virtualenv is used directly without invoking any project manager. Remember to explicitly install or sync required dependencies.

Default: Not set
Type: str
Example:

[tool.pyproject-local-kernel]
use-venv = ".venv"

About Particular Project Managers

The project manager command, be it rye, uv, pdm, etc needs to be available on the path where jupyterlab runs. Either install the project manager in the jupyterlab environment, or install the project manager user-wide (using something like pipx, rye tools, uv tool, brew, or other method to install it.)

Uv

  • Uv is detected if the pyproject.toml contains tool.uv. It is also the default fallback if no project manager is detected from a pyproject file.

  • The command used is uv run --with ipykernel python which means that it ensures ipykernel is used even if it's not already in the project(!). However, note that it uses an ephemeral virtual environment for ipykernel in that case. Add ipykernel to the project to avoid this.

Rye

  • Rye is detected if the pyproject.toml contains tool.rye.managed = true which Rye sets by default for its new projects.

PDM

  • PDM is detected if pyproject.toml contains tool.pdm

Hatch

  • Hatch is detected if pyproject.toml contains tool.hatch.envs

  • By default it calls out to hatch env find, to find the default virtualenv, and runs from there. hatch run should not be used directly because it's not compatible with how kernel interrupts work (as of this writing).

  • It's best to create the hatch project, add ipykernel as dependency and sync dependencies in a terminal before starting (it does not work so well with shell commands in a notebook).

Poetry

  • Poetry is detected if pyproject.toml contains tool.poetry.name

  • Some commands are interactive by default and don't work in a notebook, but they have an -n switch to make them non-interactive.

Project Status

Additional interest and maintainer help is welcomed.

Links

License

pyproject-local-kernel is open source. See the LICENSE.md file in the source distribution for more information.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyproject_local_kernel-0.11.1.tar.gz (309.0 kB view details)

Uploaded Source

Built Distribution

pyproject_local_kernel-0.11.1-py3-none-any.whl (17.8 kB view details)

Uploaded Python 3

File details

Details for the file pyproject_local_kernel-0.11.1.tar.gz.

File metadata

File hashes

Hashes for pyproject_local_kernel-0.11.1.tar.gz
Algorithm Hash digest
SHA256 ff0e2bcd2463c40d0447930adc52c81911d6a90d5821076394cba14956820a0e
MD5 9894f8a8c1bca7ea79a16a9c3d322b9c
BLAKE2b-256 5cbb41bac0d36ec4a64934a5b357420f68615641b2f5003043dcb009a7fa0286

See more details on using hashes here.

File details

Details for the file pyproject_local_kernel-0.11.1-py3-none-any.whl.

File metadata

File hashes

Hashes for pyproject_local_kernel-0.11.1-py3-none-any.whl
Algorithm Hash digest
SHA256 82a191aaeb1d8d1929c1a10629c83823da51b614fc90d98dfdbf151442395eb5
MD5 094901cb3a563581ed243ede004d60ef
BLAKE2b-256 dfab8d563322f858fb9d7c7e23f8af1b3f69f189dce80bc8a3cd9fd27b02af52

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page