Skip to main content

Python SDK for Tenet AI - Audit trail, replay, and drift detection for AI agents

Project description

Tenet AI SDK

Git for AI Agent Decisions - Complete audit trail, replay, and divergence detection for enterprise AI agents.

PyPI version Python 3.9+ License: MIT

Why Tenet AI?

When your AI agent approves a $10,000 refund or denies a loan application, can you answer:

  • Why did the agent make that decision?
  • What context did it have at the time?
  • Would it decide the same way if we ran it again?
  • Who overrode the agent's recommendation?

Tenet AI captures every decision your agent makes with full context, enabling audit trails, replay verification, and divergence detection.


Installation

pip install tenet-ai

With framework integrations:

pip install tenet-ai[langchain]     # LangChain
pip install tenet-ai[google-adk]    # Google ADK
pip install tenet-ai[crewai]        # CrewAI
pip install tenet-ai[openai]        # OpenAI Assistants
pip install tenet-ai[all]           # All integrations

30-Second Quickstart

from tenet import TenetClient, ActionOption, ResultType

tenet = TenetClient(api_key="tnt_your_key")

with tenet.intent("Process refund request", agent_id="support-agent") as intent:
    # 1. Capture what the agent saw
    intent.snapshot_context({
        "customer_tier": "gold",
        "order_amount": 149.99,
        "days_since_delivery": 5,
    })

    # 2. Record the decision with options considered
    intent.decide(
        options=[
            ActionOption(action="approve_refund", score=0.95, reason="Gold customer, within policy"),
            ActionOption(action="deny_refund", score=0.05, reason="N/A"),
        ],
        chosen_action="approve_refund",
        confidence=0.95,
        reasoning="Customer eligible per 30-day return policy"
    )

    # 3. Record execution
    intent.execute(action="approve_refund", target={"order_id": "ORD-123"}, result=ResultType.SUCCESS)

Now query any decision: "Why did we approve this refund?" - Full context, reasoning, and alternatives considered.


Key Features

1. Decision Replay with Divergence Detection

Store the prompt and re-run decisions to verify consistency:

from tenet import TenetClient, ActionOption, ReplayConfig

tenet = TenetClient(api_key="tnt_your_key")

# Record decision WITH replay data
with tenet.intent("Handle support ticket") as intent:
    intent.snapshot_context({"ticket_id": "T-123", "priority": "high"})

    intent.decide(
        options=[ActionOption(action="escalate", score=0.9)],
        chosen_action="escalate",
        confidence=0.9,
        reasoning="High priority ticket requires escalation",
        # Enable replay
        replay_prompt="You are a support agent. Ticket: high priority. Action?",
        replay_config=ReplayConfig(model="gpt-4o-mini", temperature=0.0),
    )

    exec_id = intent.execute(action="escalate", target={"ticket_id": "T-123"}, result=ResultType.SUCCESS)

# Later: Verify the decision is still consistent
replay_result = tenet.replay(exec_id, force_llm_call=True)

if replay_result["diverged"]:
    print(f"WARNING: Model behavior changed!")
    print(f"Original: {replay_result['original_decision']['chosen_action']}")
    print(f"Replayed: {replay_result['replayed_decision']['chosen_action']}")
    print(f"Reason: {replay_result['divergence_reason']}")
else:
    print("Decision verified - model behavior consistent")

2. Multi-Agent Tracking (Parent-Child Intents)

Track complex workflows with multiple agents or MCP tool calls:

with tenet.intent("Process customer request", agent_id="orchestrator") as parent:
    parent.snapshot_context({"request": "refund for order 123"})

    # Spawn child intent for sub-agent
    with parent.child_intent("Search order history", mcp_server="database") as child:
        child.snapshot_context({"query": "order 123"})
        child.decide(
            options=[ActionOption(action="query_db", score=1.0)],
            chosen_action="query_db",
            confidence=1.0
        )
        child.execute(action="query_db", target={"order_id": "123"}, result=ResultType.SUCCESS)

    # Parent continues with child's result
    parent.decide(...)
    parent.execute(...)

3. Human Override Tracking

When humans override agent decisions:

intent.execute(
    action="deny_refund",  # Human chose differently
    target={"order_id": "123"},
    result=ResultType.SUCCESS,
    actor=ActorType.HUMAN,
    override_reason="Customer has history of fraud"
)

Getting Started

1. Create an Account

Go to tenetai.dev and sign in with Google.

2. Create a Workspace

After signing in, create a workspace (e.g., "Production Agents").

3. Generate an API Key

Navigate to API Keys > Create API Key > Copy your key (tnt_xxxx...).

4. Use the SDK

from tenet import TenetClient

tenet = TenetClient(api_key="tnt_your_key")

Framework Integrations

LangChain

from langchain_openai import ChatOpenAI
from tenet import TenetClient, ActionOption, ResultType

tenet = TenetClient(api_key="tnt_xxx")
llm = ChatOpenAI(model="gpt-4o-mini")

def run_agent(query: str):
    with tenet.intent(query, agent_id="langchain-agent") as intent:
        intent.snapshot_context({"query": query})

        response = llm.invoke(query)

        intent.decide(
            options=[ActionOption(action="respond", score=0.9)],
            chosen_action="respond",
            confidence=0.9,
            reasoning=response.content[:100]
        )
        intent.execute(action="respond", result=ResultType.SUCCESS)
        return response.content

Google ADK

from google.adk.agents import Agent
from tenet import TenetClient
from tenet.integrations.google_adk import TenetTracker

tenet = TenetClient(api_key="tnt_xxx")
tracker = TenetTracker(tenet, agent_id="support-agent")

agent = Agent(name="support", model="gemini-2.0-flash")

with tracker.track("Handle customer request") as t:
    t.context({"customer_id": "123"})
    # ... run agent ...
    t.decision(chosen="resolve", confidence=0.92, options=[...])
    t.execute(action="resolve", result="success")

CrewAI

from crewai import Agent, Task, Crew
from tenet import TenetClient
from tenet.integrations.crewai import TenetCrewTracker

tenet = TenetClient(api_key="tnt_xxx")
tracker = TenetCrewTracker(tenet)

crew = Crew(agents=[...], tasks=[...])

with tracker.track_crew("Content pipeline") as t:
    result = crew.kickoff()
    t.record_result(result, agents=[...], tasks=[...])

API Reference

TenetClient

tenet = TenetClient(
    api_key="tnt_xxx",                                # Required
    endpoint="https://tenet-backend.onrender.com",    # Optional (default: production)
    timeout=30.0                                       # Optional
)

Core Methods

Method Description
tenet.intent(goal, agent_id) Context manager for tracking an intent
intent.snapshot_context(inputs) Capture what the agent sees
intent.decide(options, chosen_action, confidence) Record a decision
intent.execute(action, target, result) Record execution
tenet.replay(execution_id, force_llm_call) Replay and verify a decision
tenet.get_execution(id) Get execution details
tenet.get_session_timeline(session_id) Get full session timeline

Replay Methods

Method Description
tenet.replay(exec_id) Compare against original (no LLM call)
tenet.replay(exec_id, force_llm_call=True) Re-run LLM and check for divergence

Multi-Agent Methods

Method Description
intent.child_intent(goal, mcp_server) Create child intent
tenet.get_intent_hierarchy(id) Get parent chain (breadcrumbs)
tenet.get_intent_tree(id) Get full descendant tree

Dashboard

View your agent's decisions at tenetai.dev:

  • Execution Timeline: See all decisions chronologically
  • Session View: Group related decisions by session
  • Decision Details: Full context, options considered, and reasoning
  • Hierarchy View: Navigate parent-child intent relationships

Use Cases

Industry Use Case
FinTech Audit loan decisions, fraud detection reasoning
Healthcare Track triage recommendations, document clinical AI decisions
E-commerce Refund approvals, pricing decisions, inventory management
Legal Contract analysis decisions, compliance checking
HR Resume screening, candidate ranking explanations

License

MIT License - see LICENSE for details.


Links

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tenet_ai-0.4.2.tar.gz (24.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tenet_ai-0.4.2-py3-none-any.whl (27.3 kB view details)

Uploaded Python 3

File details

Details for the file tenet_ai-0.4.2.tar.gz.

File metadata

  • Download URL: tenet_ai-0.4.2.tar.gz
  • Upload date:
  • Size: 24.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.8

File hashes

Hashes for tenet_ai-0.4.2.tar.gz
Algorithm Hash digest
SHA256 6af02c9c87180769d1745cb37e798ec45a5a0ca2f32a5a906322e3474e40c2fa
MD5 3ac762a0df5ee20cad9632f3c60a6f39
BLAKE2b-256 b9f95c8a4a65c193392783c8fcc95cc4ee0abeb15d490c8ff5983e1ba803ebf4

See more details on using hashes here.

File details

Details for the file tenet_ai-0.4.2-py3-none-any.whl.

File metadata

  • Download URL: tenet_ai-0.4.2-py3-none-any.whl
  • Upload date:
  • Size: 27.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.8

File hashes

Hashes for tenet_ai-0.4.2-py3-none-any.whl
Algorithm Hash digest
SHA256 ea15fd6f0484b0aef1d27f43f1845ffa30458c994f4c7a811991c508858a259c
MD5 d7181969591ce5bd3e43f5c1f3b5f9c7
BLAKE2b-256 d64c859df84059a4ccdd4303bd97cfdfe90953ee64e71cde743473ff237bdabe

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page