Skip to main content

Python SDK for AgentLens — observability and audit trail for AI agents

Project description

AgentLens Python SDK

PyPI Python License: MIT

Python SDK for AgentLens — observability and audit trail for AI agents.

Installation

pip install agentlensai

Quick Start

Sync Client

from agentlensai import AgentLensClient, LogLlmCallParams, LlmMessage, TokenUsage

client = AgentLensClient("http://localhost:3400", api_key="als_your_key")

# Query events
result = client.query_events()
print(f"Total events: {result.total}")

# Get sessions
sessions = client.get_sessions()
for session in sessions.sessions:
    print(f"Session {session.id}: {session.status}")

# Log an LLM call
result = client.log_llm_call(
    session_id="ses_abc",
    agent_id="my-agent",
    params=LogLlmCallParams(
        provider="anthropic",
        model="claude-sonnet-4-20250514",
        messages=[LlmMessage(role="user", content="Hello!")],
        completion="Hi there! How can I help?",
        finish_reason="stop",
        usage=TokenUsage(input_tokens=10, output_tokens=8, total_tokens=18),
        cost_usd=0.001,
        latency_ms=850,
    ),
)
print(f"Logged LLM call: {result.call_id}")

# Get LLM analytics
analytics = client.get_llm_analytics()
print(f"Total LLM calls: {analytics.summary.total_calls}")
print(f"Total cost: ${analytics.summary.total_cost_usd:.2f}")

client.close()

Async Client

import asyncio
from agentlensai import AsyncAgentLensClient

async def main():
    async with AsyncAgentLensClient("http://localhost:3400", api_key="als_your_key") as client:
        # All the same methods, but async
        result = await client.query_events()
        health = await client.health()
        print(f"Server: {health.version}, Events: {result.total}")

asyncio.run(main())

Privacy-Aware Logging

# Redact sensitive prompts/completions while keeping metadata
result = client.log_llm_call(
    session_id="ses_abc",
    agent_id="my-agent",
    params=LogLlmCallParams(
        provider="openai",
        model="gpt-4o",
        messages=[LlmMessage(role="user", content="My SSN is 123-45-6789")],
        completion="I'll process that...",
        finish_reason="stop",
        usage=TokenUsage(input_tokens=15, output_tokens=10, total_tokens=25),
        cost_usd=0.002,
        latency_ms=1200,
        redact=True,  # Content replaced with [REDACTED], metadata preserved
    ),
)

Auto-Instrumentation (v0.4.0+)

One line of setup — every LLM call captured automatically. No code changes needed.

pip install agentlensai[openai]      # or agentlensai[anthropic] or agentlensai[all]
import agentlensai

# Automatically instruments OpenAI + Anthropic SDKs
agentlensai.init(
    url="http://localhost:3400",
    api_key="als_your_key",
    agent_id="my-agent",
)

# Every call is now captured — deterministic, not MCP-dependent
import openai
client = openai.OpenAI()
response = client.chat.completions.create(
    model="gpt-4o",
    messages=[{"role": "user", "content": "Hello"}],
)
# ^ Automatically logged: model, tokens, cost, latency, prompts

# Works with Anthropic too
import anthropic
client = anthropic.Anthropic()
message = client.messages.create(
    model="claude-sonnet-4-20250514",
    max_tokens=1024,
    messages=[{"role": "user", "content": "Hello"}],
)
# ^ Also captured automatically

# Clean up when done
agentlensai.shutdown()

LangChain Integration

from agentlensai.integrations.langchain import AgentLensCallbackHandler

handler = AgentLensCallbackHandler()
chain.invoke(input, config={"callbacks": [handler]})
# ^ Every LLM call, tool call, and chain event captured

Supported Providers (v0.10.0+)

AgentLens supports 9 LLM providers with automatic instrumentation:

Provider Install Status
OpenAI pip install agentlensai[openai] ✅ Sync + Async + Streaming
Anthropic pip install agentlensai[anthropic] ✅ Sync + Async + Streaming
LiteLLM pip install agentlensai[litellm] ✅ 100+ providers via proxy
AWS Bedrock pip install agentlensai[bedrock] ✅ All Bedrock models
Google Vertex AI pip install agentlensai[vertex] ✅ Vertex model garden
Google Gemini pip install agentlensai[gemini] ✅ Gemini API
Mistral AI pip install agentlensai[mistral] ✅ All Mistral models
Cohere pip install agentlensai[cohere] ✅ v1 + v2 API
Ollama pip install agentlensai[ollama] ✅ Local models (free)

Install all providers at once:

pip install agentlensai[all-providers]

Auto-Discovery

import agentlensai

# Automatically discovers and instruments ALL installed provider SDKs
agentlensai.init(
    url="http://localhost:3400",
    api_key="als_your_key",
    agent_id="my-agent",
    integrations="auto",  # default — instruments everything available
)

Or pick specific providers:

agentlensai.init(
    url="http://localhost:3400",
    integrations=["openai", "bedrock", "ollama"],
)

Provider Examples

Ollama (local, free):

import ollama
response = ollama.chat(model="llama3", messages=[{"role": "user", "content": "Hello"}])
# ^ Captured: model, tokens, latency (cost = $0)

AWS Bedrock:

import boto3
client = boto3.client("bedrock-runtime")
response = client.invoke_model(modelId="anthropic.claude-3-haiku-20240307-v1:0", body=...)
# ^ Captured with Bedrock-specific pricing

LiteLLM (100+ providers):

import litellm
response = litellm.completion(model="gpt-4", messages=[...])
# ^ Captured with built-in cost calculation

Migration from v0.4.0

The old instrument_openai() / instrument_anthropic() functions still work:

# Old way (still supported)
from agentlensai.integrations.openai import instrument_openai
instrument_openai()

# New way (recommended)
agentlensai.init(url="...", integrations="auto")

Key Guarantees

  • Deterministic — Every call captured, not dependent on LLM behavior
  • Fail-safe — If AgentLens server is down, your code still works normally
  • Zero overhead — Events sent via background thread, doesn't block your calls
  • Privacyinit(redact=True) strips content, keeps metadata

Features

  • Auto-Instrumentation — One-liner setup for OpenAI, Anthropic, LangChain
  • Sync & Async — Both AgentLensClient and AsyncAgentLensClient
  • Typed — Full Pydantic v2 models, PEP 561 py.typed marker
  • LLM Call Tracking — Log prompts, completions, tokens, costs, latency
  • Privacy Redaction — Strip sensitive content while keeping analytics metadata
  • Error HierarchyAgentLensError, AuthenticationError, NotFoundError, ValidationError, AgentLensConnectionError
  • Context Managerswith / async with for automatic cleanup

API Reference

Method Description
query_events(query?) Query events with filters and pagination
get_event(id) Get a single event by ID
get_sessions(query?) Query sessions
get_session(id) Get a single session
get_session_timeline(session_id) Get session timeline with hash chain verification
log_llm_call(session_id, agent_id, params) Log an LLM call with paired events
get_llm_analytics(params?) Get LLM cost/usage analytics
health() Check server health

Documentation

Full docs: amitpaz1.github.io/agentlens

Development

pip install -e ".[dev]"
pytest                    # 107 tests
mypy src/ --strict        # Type checking
ruff check src/ tests/    # Linting

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentlensai-0.11.0.tar.gz (96.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentlensai-0.11.0-py3-none-any.whl (68.5 kB view details)

Uploaded Python 3

File details

Details for the file agentlensai-0.11.0.tar.gz.

File metadata

  • Download URL: agentlensai-0.11.0.tar.gz
  • Upload date:
  • Size: 96.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for agentlensai-0.11.0.tar.gz
Algorithm Hash digest
SHA256 3c4424342743be58b3e76c0f5ebb6a17383873b7055fc456947e59e98f754f3b
MD5 867f8237af21c760e834cc6af4279323
BLAKE2b-256 9ce4516155d355644311c9cc5fee5e9e23ec023046807e2baa6c16ce76875801

See more details on using hashes here.

File details

Details for the file agentlensai-0.11.0-py3-none-any.whl.

File metadata

  • Download URL: agentlensai-0.11.0-py3-none-any.whl
  • Upload date:
  • Size: 68.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for agentlensai-0.11.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0ff15abc8261f00904663e57bce0ba0a9f7b392c14e4d8246385718f19276b3d
MD5 6a6f764c92f81466647fb4d1aaad2ee1
BLAKE2b-256 4b2e56b2867474da19ba4e637a042be5eecfecff03dd411a3e1664838cf7158a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page