Skip to main content

Python SDK for Tenet AI - Audit trail, replay, and drift detection for AI agents

Project description

Tenet AI SDK

Git for AI Agent Decisions - Complete audit trail, replay, and divergence detection for enterprise AI agents.

PyPI version Python 3.9+ License: MIT

Why Tenet AI?

When your AI agent approves a $10,000 refund or denies a loan application, can you answer:

  • Why did the agent make that decision?
  • What context did it have at the time?
  • Would it decide the same way if we ran it again?
  • Who overrode the agent's recommendation?

Tenet AI captures every decision your agent makes with full context, enabling audit trails, replay verification, and divergence detection.


Installation

pip install tenet-ai

With framework integrations:

pip install tenet-ai[langchain]     # LangChain
pip install tenet-ai[google-adk]    # Google ADK
pip install tenet-ai[crewai]        # CrewAI
pip install tenet-ai[openai]        # OpenAI Assistants
pip install tenet-ai[all]           # All integrations

30-Second Quickstart

from tenet import TenetClient, ActionOption, ResultType

tenet = TenetClient(api_key="tnt_your_key")

with tenet.intent("Process refund request", agent_id="support-agent") as intent:
    # 1. Capture what the agent saw
    intent.snapshot_context({
        "customer_tier": "gold",
        "order_amount": 149.99,
        "days_since_delivery": 5,
    })

    # 2. Record the decision with options considered
    intent.decide(
        options=[
            ActionOption(action="approve_refund", score=0.95, reason="Gold customer, within policy"),
            ActionOption(action="deny_refund", score=0.05, reason="N/A"),
        ],
        chosen_action="approve_refund",
        confidence=0.95,
        reasoning="Customer eligible per 30-day return policy"
    )

    # 3. Record execution
    intent.execute(action="approve_refund", target={"order_id": "ORD-123"}, result=ResultType.SUCCESS)

Now query any decision: "Why did we approve this refund?" - Full context, reasoning, and alternatives considered.


Key Features

1. Decision Replay with Divergence Detection

Store the prompt and re-run decisions to verify consistency:

from tenet import TenetClient, ActionOption, ReplayConfig

tenet = TenetClient(api_key="tnt_your_key")

# Record decision WITH replay data
with tenet.intent("Handle support ticket") as intent:
    intent.snapshot_context({"ticket_id": "T-123", "priority": "high"})

    intent.decide(
        options=[ActionOption(action="escalate", score=0.9)],
        chosen_action="escalate",
        confidence=0.9,
        reasoning="High priority ticket requires escalation",
        # Enable replay
        replay_prompt="You are a support agent. Ticket: high priority. Action?",
        replay_config=ReplayConfig(model="gpt-4o-mini", temperature=0.0),
    )

    exec_id = intent.execute(action="escalate", target={"ticket_id": "T-123"}, result=ResultType.SUCCESS)

# Later: Verify the decision is still consistent
replay_result = tenet.replay(exec_id, force_llm_call=True)

if replay_result["diverged"]:
    print(f"WARNING: Model behavior changed!")
    print(f"Original: {replay_result['original_decision']['chosen_action']}")
    print(f"Replayed: {replay_result['replayed_decision']['chosen_action']}")
    print(f"Reason: {replay_result['divergence_reason']}")
else:
    print("Decision verified - model behavior consistent")

2. Multi-Agent Tracking (Parent-Child Intents)

Track complex workflows with multiple agents or MCP tool calls:

with tenet.intent("Process customer request", agent_id="orchestrator") as parent:
    parent.snapshot_context({"request": "refund for order 123"})

    # Spawn child intent for sub-agent
    with parent.child_intent("Search order history", mcp_server="database") as child:
        child.snapshot_context({"query": "order 123"})
        child.decide(
            options=[ActionOption(action="query_db", score=1.0)],
            chosen_action="query_db",
            confidence=1.0
        )
        child.execute(action="query_db", target={"order_id": "123"}, result=ResultType.SUCCESS)

    # Parent continues with child's result
    parent.decide(...)
    parent.execute(...)

3. Human Override Tracking

When humans override agent decisions:

intent.execute(
    action="deny_refund",  # Human chose differently
    target={"order_id": "123"},
    result=ResultType.SUCCESS,
    actor=ActorType.HUMAN,
    override_reason="Customer has history of fraud"
)

Getting Started

1. Create an Account

Go to tenetai.dev and sign in with Google.

2. Create a Workspace

After signing in, create a workspace (e.g., "Production Agents").

3. Generate an API Key

Navigate to API Keys > Create API Key > Copy your key (tnt_xxxx...).

4. Use the SDK

from tenet import TenetClient

tenet = TenetClient(api_key="tnt_your_key")

Framework Integrations

LangChain

from langchain_openai import ChatOpenAI
from tenet import TenetClient, ActionOption, ResultType

tenet = TenetClient(api_key="tnt_xxx")
llm = ChatOpenAI(model="gpt-4o-mini")

def run_agent(query: str):
    with tenet.intent(query, agent_id="langchain-agent") as intent:
        intent.snapshot_context({"query": query})

        response = llm.invoke(query)

        intent.decide(
            options=[ActionOption(action="respond", score=0.9)],
            chosen_action="respond",
            confidence=0.9,
            reasoning=response.content[:100]
        )
        intent.execute(action="respond", result=ResultType.SUCCESS)
        return response.content

Google ADK

from google.adk.agents import Agent
from tenet import TenetClient
from tenet.integrations.google_adk import TenetTracker

tenet = TenetClient(api_key="tnt_xxx")
tracker = TenetTracker(tenet, agent_id="support-agent")

agent = Agent(name="support", model="gemini-2.0-flash")

with tracker.track("Handle customer request") as t:
    t.context({"customer_id": "123"})
    # ... run agent ...
    t.decision(chosen="resolve", confidence=0.92, options=[...])
    t.execute(action="resolve", result="success")

CrewAI

from crewai import Agent, Task, Crew
from tenet import TenetClient
from tenet.integrations.crewai import TenetCrewTracker

tenet = TenetClient(api_key="tnt_xxx")
tracker = TenetCrewTracker(tenet)

crew = Crew(agents=[...], tasks=[...])

with tracker.track_crew("Content pipeline") as t:
    result = crew.kickoff()
    t.record_result(result, agents=[...], tasks=[...])

API Reference

TenetClient

tenet = TenetClient(
    api_key="tnt_xxx",                                # Required
    endpoint="https://tenet-backend.onrender.com",    # Optional (default: production)
    timeout=30.0                                       # Optional
)

Core Methods

Method Description
tenet.intent(goal, agent_id) Context manager for tracking an intent
intent.snapshot_context(inputs) Capture what the agent sees
intent.decide(options, chosen_action, confidence) Record a decision
intent.execute(action, target, result) Record execution
tenet.replay(execution_id, force_llm_call) Replay and verify a decision
tenet.get_execution(id) Get execution details
tenet.get_session_timeline(session_id) Get full session timeline

Replay Methods

Method Description
tenet.replay(exec_id) Compare against original (no LLM call)
tenet.replay(exec_id, force_llm_call=True) Re-run LLM and check for divergence

Multi-Agent Methods

Method Description
intent.child_intent(goal, mcp_server) Create child intent
tenet.get_intent_hierarchy(id) Get parent chain (breadcrumbs)
tenet.get_intent_tree(id) Get full descendant tree

Dashboard

View your agent's decisions at tenetai.dev:

  • Execution Timeline: See all decisions chronologically
  • Session View: Group related decisions by session
  • Decision Details: Full context, options considered, and reasoning
  • Hierarchy View: Navigate parent-child intent relationships

Use Cases

Industry Use Case
FinTech Audit loan decisions, fraud detection reasoning
Healthcare Track triage recommendations, document clinical AI decisions
E-commerce Refund approvals, pricing decisions, inventory management
Legal Contract analysis decisions, compliance checking
HR Resume screening, candidate ranking explanations

License

MIT License - see LICENSE for details.


Links

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tenet_ai-0.4.1.tar.gz (23.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tenet_ai-0.4.1-py3-none-any.whl (25.6 kB view details)

Uploaded Python 3

File details

Details for the file tenet_ai-0.4.1.tar.gz.

File metadata

  • Download URL: tenet_ai-0.4.1.tar.gz
  • Upload date:
  • Size: 23.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.8

File hashes

Hashes for tenet_ai-0.4.1.tar.gz
Algorithm Hash digest
SHA256 094f86500e5d06c806cb86d808595c33da0551ca58566ef10fed3642e93c21c0
MD5 19054663194a94a66764e2be58b5d30b
BLAKE2b-256 0975f99d7add19a11692f490d2747dda72b454f8dc7d2cc204a1292bbffe30b4

See more details on using hashes here.

File details

Details for the file tenet_ai-0.4.1-py3-none-any.whl.

File metadata

  • Download URL: tenet_ai-0.4.1-py3-none-any.whl
  • Upload date:
  • Size: 25.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.8

File hashes

Hashes for tenet_ai-0.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 88b56be3c323f5ef5e1f9ffc776309a89857b519fec42b75a09b05e896511fab
MD5 701dea96f0f160c0cd28c14571f0e40d
BLAKE2b-256 cf5455a800325f83dcb2c689b3d7b74a93437e35f945d340d8de372204e2466d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page