jupyter_ai_litellm

A JupyterLab extension that provides LiteLLM model abstraction for Jupyter AI

This extension is composed of a Python package named jupyter_ai_litellm that exposes LiteLLM's extensive catalog of language models through a standardized API.

Features

• Comprehensive Model Support: Access to hundreds of chat and embedding models from various providers (OpenAI, Anthropic, Google, Cohere, Azure, AWS, and more) through LiteLLM's unified interface
• Standardized API: Consistent REST API endpoints for model discovery and interaction
• Easy Integration: Seamlessly integrates with Jupyter AI to expand available model options

API Endpoints

Chat Models

• GET /api/ai/models/chat - Returns a list of all available chat models

The response includes model IDs in LiteLLM format (e.g., openai/gpt-4, anthropic/claude-3-sonnet, etc.)

Model Lists

The extension automatically discovers and categorizes models from LiteLLM's supported providers:

• Chat models for conversational AI
• Embedding models for vector representations

Requirements

• JupyterLab >= 4.0.0

Install

To install the extension, execute:

pip install jupyter_ai_litellm

Uninstall

To remove the extension, execute:

pip uninstall jupyter_ai_litellm

Troubleshoot

If you are seeing the frontend extension, but it is not working, check that the server extension is enabled:

jupyter server extension list

Contributing

Development install

# Clone the repo to your local environment
# Change directory to the jupyter_ai_litellm directory
# Install package in development mode
pip install -e ".[test]"

# Server extension must be manually installed in develop mode
jupyter server extension enable jupyter_ai_litellm

Development uninstall

# Server extension must be manually disabled in develop mode
jupyter server extension disable jupyter_ai_litellm
pip uninstall jupyter_ai_litellm

Testing the extension

Server tests

This extension is using Pytest for Python code testing.

Install test dependencies (needed only once):

pip install -e ".[test]"

To execute them, run:

pytest -vv -r ap --cov jupyter_ai_litellm

Packaging the extension

See RELEASE