Lightweight LLM observability SDK
Project description
LLM Watch SDK
Lightweight SDK to send LLM usage telemetry to the LLM Watch backend.
Install
pip install llm-watch-sdk
Quickstart
from llm_watch import LLMWatch
watch = LLMWatch(
backend_url="http://YOUR_BACKEND",
project_api_key="YOUR_PROJECT_KEY",
)
Providers
Wrap your provider client with the matching adapter, then call invoke(...).
# OpenAI example
from openai import OpenAI
client = OpenAI(api_key="...")
oa = watch.openai(client, model="gpt-4o-mini")
resp = oa.invoke({"messages": [{"role": "user", "content": "hello"}]})
# Gemini example (google.genai)
from google import genai
client = genai.Client(api_key="...")
gm = watch.gemini(client, model="gemini-1.5-pro")
resp = gm.invoke({"contents": "hello"})
# Bedrock example
br = watch.bedrock(region="eu-north-1", model_id="arn:aws:bedrock:...")
resp = br.invoke({...})
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llm_watch_sdk-0.1.1.tar.gz
(16.7 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file llm_watch_sdk-0.1.1.tar.gz.
File metadata
- Download URL: llm_watch_sdk-0.1.1.tar.gz
- Upload date:
- Size: 16.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7939b7a192f39548e370b63742391c4af8ba62f49628707c0fc4b7902875ccdb
|
|
| MD5 |
3f116dab53cbbed73984a3b4e494ad1b
|
|
| BLAKE2b-256 |
396603c44f2e4dd8c4ea1cdfdd7dc5803dc5e29236d7e0c92dd6578f8d254cee
|
File details
Details for the file llm_watch_sdk-0.1.1-py3-none-any.whl.
File metadata
- Download URL: llm_watch_sdk-0.1.1-py3-none-any.whl
- Upload date:
- Size: 27.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0dd2cb314435300bcd486771269b5d00e41d534d93b9b73756cf614a9b0370dd
|
|
| MD5 |
4248309e9f6576a98b7769abf7a16f95
|
|
| BLAKE2b-256 |
f8c9ff0a53d1a89dd4890c4b3fbecbba4c53cf00db13d9228fda1d7dd346bb9f
|