Lightweight LLM observability SDK
Project description
LLM Watch SDK
Lightweight SDK to send LLM usage telemetry to the LLM Watch backend.
Install
pip install llm-watch-sdk
Quickstart
from llm_watch import LLMWatch
watch = LLMWatch(
backend_url="http://YOUR_BACKEND",
project_api_key="YOUR_PROJECT_KEY",
)
Providers
Wrap your provider client with the matching adapter, then call invoke(...).
# OpenAI example
from openai import OpenAI
client = OpenAI(api_key="...")
oa = watch.openai(client, model="gpt-4o-mini")
resp = oa.invoke({"messages": [{"role": "user", "content": "hello"}]})
# Gemini example (google.genai)
from google import genai
client = genai.Client(api_key="...")
gm = watch.gemini(client, model="gemini-1.5-pro")
resp = gm.invoke({"contents": "hello"})
# Bedrock example
br = watch.bedrock(region="eu-north-1", model_id="arn:aws:bedrock:...")
resp = br.invoke({...})
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llm_watch_sdk-0.1.3.tar.gz
(17.4 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file llm_watch_sdk-0.1.3.tar.gz.
File metadata
- Download URL: llm_watch_sdk-0.1.3.tar.gz
- Upload date:
- Size: 17.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e69b892ccfb1dcef15a9bf93a11f04d51df988b65e378dbfd88bc78cc28646a6
|
|
| MD5 |
e78337e10fba430654f675dc4e170a69
|
|
| BLAKE2b-256 |
9d1a25145de12871bce7459877802a71b6962bad6f6a8ed36dffc9b1b8995018
|
File details
Details for the file llm_watch_sdk-0.1.3-py3-none-any.whl.
File metadata
- Download URL: llm_watch_sdk-0.1.3-py3-none-any.whl
- Upload date:
- Size: 27.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b74e9baef539e64bc93a44060bf762d1562cf590c1399e029a47057211f7dfee
|
|
| MD5 |
5a459b91f211367bb71590f06c902cce
|
|
| BLAKE2b-256 |
999af929ad24368e03ee2298bd140a0d3f4fb7c19833ce96abc8c00a1f5c5826
|