Lightweight LLM observability SDK
Project description
LLM Watch SDK
Lightweight SDK to send LLM usage telemetry to the LLM Watch backend.
Install
pip install llm-watch-sdk
Quickstart
from llm_watch import LLMWatch
watch = LLMWatch(
backend_url="http://YOUR_BACKEND",
project_api_key="YOUR_PROJECT_KEY",
)
Providers
Wrap your provider client with the matching adapter, then call invoke(...).
# OpenAI example
from openai import OpenAI
client = OpenAI(api_key="...")
oa = watch.openai(client, model="gpt-4o-mini")
resp = oa.invoke({"messages": [{"role": "user", "content": "hello"}]})
# Gemini example (google.genai)
from google import genai
client = genai.Client(api_key="...")
gm = watch.gemini(client, model="gemini-1.5-pro")
resp = gm.invoke({"contents": "hello"})
# Bedrock example
br = watch.bedrock(region="eu-north-1", model_id="arn:aws:bedrock:...")
resp = br.invoke({...})
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llm_watch_sdk-0.1.4.tar.gz
(18.2 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file llm_watch_sdk-0.1.4.tar.gz.
File metadata
- Download URL: llm_watch_sdk-0.1.4.tar.gz
- Upload date:
- Size: 18.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
da609ad2a590bb196c6795d1a96e3aa7aac2bc42e10637261d39e7a73bf28c5e
|
|
| MD5 |
665213c3ffef8bd1b4ea68e75691adb7
|
|
| BLAKE2b-256 |
1e6d3ee7188b346aa51624d5bff116b2acaa8fd35cfc852d74c6cf1aa1310f00
|
File details
Details for the file llm_watch_sdk-0.1.4-py3-none-any.whl.
File metadata
- Download URL: llm_watch_sdk-0.1.4-py3-none-any.whl
- Upload date:
- Size: 28.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8d79545b2c71062f6280e5d0f36a3ed079ae87af12dd3a7da0906ffb30cc4c1b
|
|
| MD5 |
20ec1b7b393f79eaaf7e220af894c571
|
|
| BLAKE2b-256 |
f8661ec1fa9f6ed3a7f3c691fe46b905a8d659e11cd686253ee5261a308d305b
|