Python SDK for Tenet AI - Audit trail, replay, and drift detection for AI agents
Project description
Tenet AI SDK
Git for AI Agent Decisions - Complete audit trail, replay, and divergence detection for enterprise AI agents.
Why Tenet AI?
When your AI agent approves a $10,000 refund or denies a loan application, can you answer:
- Why did the agent make that decision?
- What context did it have at the time?
- Would it decide the same way if we ran it again?
- Who overrode the agent's recommendation?
Tenet AI captures every decision your agent makes with full context, enabling audit trails, replay verification, and divergence detection.
Installation
pip install tenet-ai
With framework integrations:
pip install tenet-ai[langchain] # LangChain
pip install tenet-ai[google-adk] # Google ADK
pip install tenet-ai[crewai] # CrewAI
pip install tenet-ai[openai] # OpenAI Assistants
pip install tenet-ai[all] # All integrations
30-Second Quickstart
from tenet import TenetClient, ActionOption, ResultType
tenet = TenetClient(api_key="tnt_your_key")
with tenet.intent("Process refund request", agent_id="support-agent") as intent:
# 1. Capture what the agent saw
intent.snapshot_context({
"customer_tier": "gold",
"order_amount": 149.99,
"days_since_delivery": 5,
})
# 2. Record the decision with options considered
intent.decide(
options=[
ActionOption(action="approve_refund", score=0.95, reason="Gold customer, within policy"),
ActionOption(action="deny_refund", score=0.05, reason="N/A"),
],
chosen_action="approve_refund",
confidence=0.95,
reasoning="Customer eligible per 30-day return policy"
)
# 3. Record execution
intent.execute(action="approve_refund", target={"order_id": "ORD-123"}, result=ResultType.SUCCESS)
Now query any decision: "Why did we approve this refund?" - Full context, reasoning, and alternatives considered.
Key Features
1. Decision Replay with Divergence Detection
Store the prompt and re-run decisions to verify consistency:
from tenet import TenetClient, ActionOption, ReplayConfig
tenet = TenetClient(api_key="tnt_your_key")
# Record decision WITH replay data
with tenet.intent("Handle support ticket") as intent:
intent.snapshot_context({"ticket_id": "T-123", "priority": "high"})
intent.decide(
options=[ActionOption(action="escalate", score=0.9)],
chosen_action="escalate",
confidence=0.9,
reasoning="High priority ticket requires escalation",
# Enable replay
replay_prompt="You are a support agent. Ticket: high priority. Action?",
replay_config=ReplayConfig(model="gpt-4o-mini", temperature=0.0),
)
exec_id = intent.execute(action="escalate", target={"ticket_id": "T-123"}, result=ResultType.SUCCESS)
# Later: Verify the decision is still consistent
replay_result = tenet.replay(exec_id, force_llm_call=True)
if replay_result["diverged"]:
print(f"WARNING: Model behavior changed!")
print(f"Original: {replay_result['original_decision']['chosen_action']}")
print(f"Replayed: {replay_result['replayed_decision']['chosen_action']}")
print(f"Reason: {replay_result['divergence_reason']}")
else:
print("Decision verified - model behavior consistent")
2. Multi-Agent Tracking (Parent-Child Intents)
Track complex workflows with multiple agents or MCP tool calls:
with tenet.intent("Process customer request", agent_id="orchestrator") as parent:
parent.snapshot_context({"request": "refund for order 123"})
# Spawn child intent for sub-agent
with parent.child_intent("Search order history", mcp_server="database") as child:
child.snapshot_context({"query": "order 123"})
child.decide(
options=[ActionOption(action="query_db", score=1.0)],
chosen_action="query_db",
confidence=1.0
)
child.execute(action="query_db", target={"order_id": "123"}, result=ResultType.SUCCESS)
# Parent continues with child's result
parent.decide(...)
parent.execute(...)
3. Human Override Tracking
When humans override agent decisions:
intent.execute(
action="deny_refund", # Human chose differently
target={"order_id": "123"},
result=ResultType.SUCCESS,
actor=ActorType.HUMAN,
override_reason="Customer has history of fraud"
)
Getting Started
1. Create an Account
Go to tenetai.dev and sign in with Google.
2. Create a Workspace
After signing in, create a workspace (e.g., "Production Agents").
3. Generate an API Key
Navigate to API Keys > Create API Key > Copy your key (tnt_xxxx...).
4. Use the SDK
from tenet import TenetClient
tenet = TenetClient(api_key="tnt_your_key")
Framework Integrations
LangChain
from langchain_openai import ChatOpenAI
from tenet import TenetClient, ActionOption, ResultType
tenet = TenetClient(api_key="tnt_xxx")
llm = ChatOpenAI(model="gpt-4o-mini")
def run_agent(query: str):
with tenet.intent(query, agent_id="langchain-agent") as intent:
intent.snapshot_context({"query": query})
response = llm.invoke(query)
intent.decide(
options=[ActionOption(action="respond", score=0.9)],
chosen_action="respond",
confidence=0.9,
reasoning=response.content[:100]
)
intent.execute(action="respond", result=ResultType.SUCCESS)
return response.content
Google ADK
from google.adk.agents import Agent
from tenet import TenetClient
from tenet.integrations.google_adk import TenetTracker
tenet = TenetClient(api_key="tnt_xxx")
tracker = TenetTracker(tenet, agent_id="support-agent")
agent = Agent(name="support", model="gemini-2.0-flash")
with tracker.track("Handle customer request") as t:
t.context({"customer_id": "123"})
# ... run agent ...
t.decision(chosen="resolve", confidence=0.92, options=[...])
t.execute(action="resolve", result="success")
CrewAI
from crewai import Agent, Task, Crew
from tenet import TenetClient
from tenet.integrations.crewai import TenetCrewTracker
tenet = TenetClient(api_key="tnt_xxx")
tracker = TenetCrewTracker(tenet)
crew = Crew(agents=[...], tasks=[...])
with tracker.track_crew("Content pipeline") as t:
result = crew.kickoff()
t.record_result(result, agents=[...], tasks=[...])
API Reference
TenetClient
tenet = TenetClient(
api_key="tnt_xxx", # Required
endpoint="https://tenet-backend.onrender.com", # Optional (default: production)
timeout=30.0 # Optional
)
Core Methods
| Method | Description |
|---|---|
tenet.intent(goal, agent_id) |
Context manager for tracking an intent |
intent.snapshot_context(inputs) |
Capture what the agent sees |
intent.decide(options, chosen_action, confidence) |
Record a decision |
intent.execute(action, target, result) |
Record execution |
tenet.replay(execution_id, force_llm_call) |
Replay and verify a decision |
tenet.get_execution(id) |
Get execution details |
tenet.get_session_timeline(session_id) |
Get full session timeline |
Replay Methods
| Method | Description |
|---|---|
tenet.replay(exec_id) |
Compare against original (no LLM call) |
tenet.replay(exec_id, force_llm_call=True) |
Re-run LLM and check for divergence |
Multi-Agent Methods
| Method | Description |
|---|---|
intent.child_intent(goal, mcp_server) |
Create child intent |
tenet.get_intent_hierarchy(id) |
Get parent chain (breadcrumbs) |
tenet.get_intent_tree(id) |
Get full descendant tree |
Dashboard
View your agent's decisions at tenetai.dev:
- Execution Timeline: See all decisions chronologically
- Session View: Group related decisions by session
- Decision Details: Full context, options considered, and reasoning
- Hierarchy View: Navigate parent-child intent relationships
Use Cases
| Industry | Use Case |
|---|---|
| FinTech | Audit loan decisions, fraud detection reasoning |
| Healthcare | Track triage recommendations, document clinical AI decisions |
| E-commerce | Refund approvals, pricing decisions, inventory management |
| Legal | Contract analysis decisions, compliance checking |
| HR | Resume screening, candidate ranking explanations |
License
MIT License - see LICENSE for details.
Links
- Dashboard: tenetai.dev
- PyPI: pypi.org/project/tenet-ai
- Node.js SDK: npmjs.com/package/@tenet-ai/sdk
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file tenet_ai-0.4.2.tar.gz.
File metadata
- Download URL: tenet_ai-0.4.2.tar.gz
- Upload date:
- Size: 24.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6af02c9c87180769d1745cb37e798ec45a5a0ca2f32a5a906322e3474e40c2fa
|
|
| MD5 |
3ac762a0df5ee20cad9632f3c60a6f39
|
|
| BLAKE2b-256 |
b9f95c8a4a65c193392783c8fcc95cc4ee0abeb15d490c8ff5983e1ba803ebf4
|
File details
Details for the file tenet_ai-0.4.2-py3-none-any.whl.
File metadata
- Download URL: tenet_ai-0.4.2-py3-none-any.whl
- Upload date:
- Size: 27.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ea15fd6f0484b0aef1d27f43f1845ffa30458c994f4c7a811991c508858a259c
|
|
| MD5 |
d7181969591ce5bd3e43f5c1f3b5f9c7
|
|
| BLAKE2b-256 |
d64c859df84059a4ccdd4303bd97cfdfe90953ee64e71cde743473ff237bdabe
|