Skip to main content

Chaos testing for agentic AI — fault injection hooks for openai-agents-python

Project description

agentchaos-tools

PyPI version

Chaos testing for agentic AI — fault injection hooks for openai-agents-python.

Simulate tool failures, latency, and corrupted outputs to verify your agent handles real-world conditions gracefully.

Install

pip install agentchaos-tools

Usage

from agents import Agent, Runner, function_tool
from agentchaos import FaultInjectionHooks, ToolFault, FaultType

@function_tool
def web_search(query: str) -> str:
    return f"Results for {query}"

agent = Agent(name="assistant", tools=[web_search])

hooks = FaultInjectionHooks(
    faults=[
        ToolFault(tool_name="web_search", fault_type=FaultType.EXCEPTION, rate=0.5),
        ToolFault(tool_name="calculator", fault_type=FaultType.LATENCY, latency_seconds=2.0),
    ],
    seed=42,  # optional: reproducible fault patterns
)

result = await Runner.run(agent, "Search for something", hooks=hooks)
hooks.report()
# agentchaos-tools report — 1 fault(s) triggered:
#   1. [EXCEPTION] tool='web_search'

Fault types

Type What it does
EXCEPTION Raises RuntimeError before the tool runs
LATENCY Injects asyncio.sleep delay before the tool runs
CORRUPTION Records that output was corrupted (visible in report)

Parameters

Parameter Type Default Description
tool_name str required Name of the tool to target
fault_type FaultType required Type of fault to inject
rate float 1.0 Probability (0.0–1.0) that the fault fires
latency_seconds float 1.0 Delay in seconds (LATENCY only)
seed int None Random seed for reproducible tests

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentchaos_tools-0.1.1.tar.gz (3.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentchaos_tools-0.1.1-py3-none-any.whl (3.8 kB view details)

Uploaded Python 3

File details

Details for the file agentchaos_tools-0.1.1.tar.gz.

File metadata

  • Download URL: agentchaos_tools-0.1.1.tar.gz
  • Upload date:
  • Size: 3.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for agentchaos_tools-0.1.1.tar.gz
Algorithm Hash digest
SHA256 50168c99e1fc90990387952888a76f44e7fdc352eee62399e0dac44bfafe69b4
MD5 09f992d8f51aa683dba028fe9d6a2009
BLAKE2b-256 7b8de56186a6133c597d641315e106949c7606e5e17f138c05d3344e28fcf2ea

See more details on using hashes here.

File details

Details for the file agentchaos_tools-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for agentchaos_tools-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 6175c5e9fe81c71ff03ca83b501657d298e99c03c1abe3c17bbe6d69a16cf9b1
MD5 3b95c2e3c2bba25e546a74dd874554bc
BLAKE2b-256 0e6acbbf73fab9a169ae20979cfb27b4341014b94c8f94f2e6b050e615e3258f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page