Skip to main content

Lightweight LLM observability SDK

Project description

LLM Watch SDK

Lightweight SDK to send LLM usage telemetry to the LLM Watch backend.

Install

pip install llm-watch-sdk

Quickstart

from llm_watch import LLMWatch

watch = LLMWatch(
    backend_url="http://YOUR_BACKEND",
    project_api_key="YOUR_PROJECT_KEY",
)

Providers

Wrap your provider client with the matching adapter, then call invoke(...).

# OpenAI example
from openai import OpenAI

client = OpenAI(api_key="...")
oa = watch.openai(client, model="gpt-4o-mini")
resp = oa.invoke({"messages": [{"role": "user", "content": "hello"}]})
# Gemini example (google.genai)
from google import genai

client = genai.Client(api_key="...")
gm = watch.gemini(client, model="gemini-1.5-pro")
resp = gm.invoke({"contents": "hello"})
# Bedrock example
br = watch.bedrock(region="eu-north-1", model_id="arn:aws:bedrock:...")
resp = br.invoke({...})

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_watch_sdk-0.1.2.tar.gz (16.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_watch_sdk-0.1.2-py3-none-any.whl (27.3 kB view details)

Uploaded Python 3

File details

Details for the file llm_watch_sdk-0.1.2.tar.gz.

File metadata

  • Download URL: llm_watch_sdk-0.1.2.tar.gz
  • Upload date:
  • Size: 16.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.6

File hashes

Hashes for llm_watch_sdk-0.1.2.tar.gz
Algorithm Hash digest
SHA256 bc9fda9089672b49b2307f8d85dbb75dd524efceabd5f13da3a1fe16556b5a90
MD5 05f8581f8e7d4cb2f699d822d3f4f163
BLAKE2b-256 29cd90975a002ab329e48651a85444617ecfe6848f39c6f25ad713f28240dd6a

See more details on using hashes here.

File details

Details for the file llm_watch_sdk-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: llm_watch_sdk-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 27.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.6

File hashes

Hashes for llm_watch_sdk-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 1a334777cd4932a47a9a5631fcdab2749d390eb1f633cdf19bcfe447a98f876e
MD5 f3e14b0e80685c96411b753ed1c0b47a
BLAKE2b-256 f187e181f0aa816b9c38aeb65bdfdea00beacc7c50eacc2be047c36a8127db37

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page