Skip to main content

Runtime

Author: Techrevati doo

Runtime primitives for multi-step LLM agent loops: sync and async sessions, retry classification, circuit-breaker protection, usage tracking, optional budget enforcement, role-based tool gating, guardrails, handoffs, policy evaluation, checkpointing, rate limiting, streaming, hooks, and telemetry integration.

The package is currently 0.5.0. The 0.x API surface is still unstable, so pin exact versions when you depend on a specific behavior.

pip install techrevati-runtime
pip install 'techrevati-runtime[otel]'

Quick Start

from techrevati.runtime import (
    AgentSession,
    ModelPricing,
    UsageSnapshot,
    register_pricing,
)

register_pricing(
    "model-a",
    ModelPricing(input_per_million=3.0, output_per_million=15.0),
)

agent = AgentSession(
    role="writer",
    phase="draft",
    project_id=1,
    budget_usd=10.0,
    enforce_budget=True,
    max_iterations=25,
)

with agent.session() as session:
    result, usage = session.run_turn(
        lambda: call_model(prompt),
        model="model-a",
        usage=UsageSnapshot(input_tokens=5000, output_tokens=1200),
        timeout=30.0,
    )

print(session.summary())

The session moves through INITIALIZING -> RUNNING -> COMPLETED, classifies exceptions into typed failure scenarios, attempts recovery once, enforces the configured budget, gates tool calls behind permissions and guardrails, and emits structured events to the configured sinks.

For async code, use async with, asession(), and arun_turn() with the same parameters. Cancellation transitions the worker to CANCELLED.

Design Goals

  • Zero runtime dependencies; optional extras are opt-in.
  • Type-safe public API with py.typed.
  • Composable primitives that work standalone or through AgentSession.
  • Thread-safe sync paths and async-safe async paths.
  • Caller-owned configuration for pricing, thresholds, roles, sinks, and policy.

Main Primitives

Module Provides
orchestrator AgentSession, sync and async sessions
circuit_breaker Sync and async circuit breakers
retry_policy Failure classification and recovery recipes
usage_tracking Usage snapshots, pricing registration, limits, budgets
agent_lifecycle Worker registry and validated lifecycle transitions
agent_events Typed lifecycle events
permissions Deny-first role and tool authorization
guardrails Pre-call and post-call content checks
handoffs Agent-to-agent delegation records
policy_engine Declarative policy conditions and actions
checkpoint In-memory and SQLite checkpoint savers
rate_limit Token buckets and rate limiters
streaming Structured async stream events
hooks Mutating lifecycle hook chain
sinks Event and usage sink protocols
persistence SQLite-backed durable sinks
otel Optional telemetry sinks
compliance EU AI Act primitives (audit log, oversight, risk registry, incidents, transparency)

EU AI Act compliance

The techrevati.runtime.compliance subpackage provides technical primitives that map to EU AI Act (Regulation (EU) 2024/1689) Articles 9, 12, 13, 14, 15, 26, and 73 — a tamper-evident hash-chained audit log, human-oversight pause/override, a risk registry, incident detection with 15-day deadline tracking, and a transparency report — bundled behind the EUAIActComplianceKit facade:

from techrevati.runtime import AgentSession
from techrevati.runtime.compliance import EUAIActComplianceKit, AuditLogSink, SqliteAuditBackend

kit = EUAIActComplianceKit.standard(audit_log=AuditLogSink(SqliteAuditBackend("audit.db")))
session = AgentSession(role="loan_assessor", phase="decide", compliance=kit)
with session.session() as s:
    s.run_tool("score", lambda: assess(application))
assert kit.audit_log.verify_chain().valid

⚠️ Not legal advice. The runtime is not itself an AI system; it provides building blocks. The deployer remains responsible for classification, conformity assessment, and operation. See the EU AI Act docs for the article-by-article guidance and the audit-log threat model.

Example: Async Handoff

import asyncio

from techrevati.runtime import (
    AgentSession,
    AllowAllGuardrail,
    AsyncCircuitBreaker,
    UsageSnapshot,
)

cb = AsyncCircuitBreaker(
    "model-api",
    failure_threshold=3,
    recovery_timeout_seconds=30.0,
)

async def main():
    agent = AgentSession(
        role="writer",
        phase="draft",
        async_circuit_breaker=cb,
        guardrails=[AllowAllGuardrail()],
        max_iterations=10,
    )

    async with agent.asession() as session:
        text, _ = await session.arun_turn(
            lambda: acall_model(prompt),
            model="model-a",
            usage=UsageSnapshot(input_tokens=5000, output_tokens=1200),
            timeout=30.0,
        )
        handoff = session.handoff_to(
            "editor",
            reason="review",
            context={"draft": text},
        )
        print(f"handed off to {handoff.target_role}")

asyncio.run(main())

Limits

  • Pricing is caller-provided. Unknown models are tracked with zero cost and a warning.
  • Budget enforcement is opt-in with enforce_budget=True.
  • Permissions and guardrails are runtime gates, not process sandboxes.
  • Durable execution is opt-in through a CheckpointSaver and stable thread_id.
  • Default sinks are in-memory ring buffers; long-running sessions should plug in durable sinks.
  • Circuit breaker state is per process.

License

MIT. Copyright 2026 Techrevati doo. See LICENSE.

Metadata

Release files for techrevati-runtime 0.5.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for techrevati-runtime 0.5.0
File Size Uploaded Provenance Actions
techrevati_runtime-0.5.0.tar.gz 486.2 kB With provenance Details for techrevati_runtime-0.5.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for techrevati-runtime 0.5.0
File Interpreter ABI Platform Actions
techrevati_runtime-0.5.0-py3-none-any.whl Python 3 none any Details for techrevati_runtime-0.5.0-py3-none-any.whl

Total release size: 654.0 kB

Release files / techrevati_runtime-0.5.0.tar.gz

Download URL techrevati_runtime-0.5.0.tar.gz
Size 486.2 kB
Tags Source
SHA-256 checksum
How to use checksums
54059c609bf0bbb32ab9dfda18eb3a5dbe3993b786081d532e98d2aead45b586
BLAKE2b-256 checksum
How to use checksums
8ea24b471fe3c63101265cf8a04df4222ec7f1576d695742fb2e4c6e8d211bc8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.13

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

Release files / techrevati_runtime-0.5.0-py3-none-any.whl

Download URL techrevati_runtime-0.5.0-py3-none-any.whl
Size 167.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
3e537bca26693ea57a970de69e01cf75b75c9ce0f6ac4d8ebaab20b6ce1c972b
BLAKE2b-256 checksum
How to use checksums
1fbb2b7c2b37bf11e14b71c130b62517eac2d4dd328d5da83228c9688392115b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.13

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

Security for techrevati-runtime 0.5.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for techrevati_runtime-0.5.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page