Skip to main content

Zero-config LLM API inspector — intercepts calls, shows token breakdown and cost estimates in a local dashboard

Project description

llm-inspect

Zero-config LLM API inspector. One import, one line — intercepts all Anthropic and OpenAI calls and shows a real-time dashboard with token breakdown and cost estimates.

Install

pip install llm-inspect

Usage

import llm_inspect
llm_inspect.init()  # add at your app entry point, before other imports

# All LLM calls now route through the inspector
import anthropic
client = anthropic.Anthropic()

Dashboard opens automatically at http://localhost:8788

How it works

init() starts a lightweight local proxy on :8787 (if not already running) and sets ANTHROPIC_BASE_URL / OPENAI_BASE_URL so all SDK calls route through it. No config files, no CA certificates, no accounts.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_inspect-0.1.0.tar.gz (1.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_inspect-0.1.0-py3-none-any.whl (2.1 kB view details)

Uploaded Python 3

File details

Details for the file llm_inspect-0.1.0.tar.gz.

File metadata

  • Download URL: llm_inspect-0.1.0.tar.gz
  • Upload date:
  • Size: 1.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for llm_inspect-0.1.0.tar.gz
Algorithm Hash digest
SHA256 6780b620f1e3d08980006a57aaa4717e1001a1ad8cfda5a77044158da8304e0c
MD5 5c4b9f44834ecb82953cecf063a38687
BLAKE2b-256 6b816d6f710edd40fa62fd6ce85968de096f0cb9fc53c9bf9754a3b4442c2ea6

See more details on using hashes here.

File details

Details for the file llm_inspect-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: llm_inspect-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 2.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for llm_inspect-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8901e1b34c6c86a5ea44ca849261acc5a1df9014832052aa82a1e10d72edd32c
MD5 e9181de91e7da8099ad2302e3b9583e9
BLAKE2b-256 0eac4ac9a7940dc32520fcdd762bda719a789bde3e8450adc64333e00ef1d316

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page