Skip to main content

Zero-config LLM API inspector — intercepts calls, shows token breakdown and cost estimates in a local dashboard

Project description

llm-inspect

Zero-config LLM API inspector. One import, one line — intercepts all Anthropic and OpenAI calls and shows a real-time dashboard with token breakdown and cost estimates.

Install

pip install llm-inspect

Usage

import llm_inspect
llm_inspect.init()  # add at your app entry point, before other imports

# All LLM calls now route through the inspector
import anthropic
client = anthropic.Anthropic()

Dashboard opens automatically at http://localhost:8788

How it works

init() starts a lightweight local proxy on :8787 (if not already running) and sets ANTHROPIC_BASE_URL / OPENAI_BASE_URL so all SDK calls route through it. No config files, no CA certificates, no accounts.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_inspect-0.1.8.tar.gz (1.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_inspect-0.1.8-py3-none-any.whl (2.1 kB view details)

Uploaded Python 3

File details

Details for the file llm_inspect-0.1.8.tar.gz.

File metadata

  • Download URL: llm_inspect-0.1.8.tar.gz
  • Upload date:
  • Size: 1.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for llm_inspect-0.1.8.tar.gz
Algorithm Hash digest
SHA256 abe786836b2336e0fd16e4f3aab3252372f983705329a7c0b9488d5abd23b874
MD5 13b36c44d81df7f02f3162a02e7e80f5
BLAKE2b-256 c1055ab153c33d515158c103dfc866ef18cb2961328556d204456ebab01dca8f

See more details on using hashes here.

Provenance

The following attestation bundles were made for llm_inspect-0.1.8.tar.gz:

Publisher: publish.yml on kasidkhansbp/llm-inspect

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file llm_inspect-0.1.8-py3-none-any.whl.

File metadata

  • Download URL: llm_inspect-0.1.8-py3-none-any.whl
  • Upload date:
  • Size: 2.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for llm_inspect-0.1.8-py3-none-any.whl
Algorithm Hash digest
SHA256 80b86e2259b214195cb602d2818ba26c1819eedc6c5b84561a3c804789993192
MD5 83d118382b250ff83c9b523d277d3f2c
BLAKE2b-256 c3d2119c857e9b7174a399d305c8a9849bcc469f7a684e848e7defa5b8f14129

See more details on using hashes here.

Provenance

The following attestation bundles were made for llm_inspect-0.1.8-py3-none-any.whl:

Publisher: publish.yml on kasidkhansbp/llm-inspect

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page