Skip to main content

Detect silent failures in LLM agents

Project description

AgentGuard

Detect silent failures in LLM agents.

Your agent can fail silently.
It returns something that looks correct… but is wrong.
No error. No warning. Just bad output.

AgentGuard detects it automatically.

Install

pip install agentguard

Use

from agentguard import watch
from pydantic import BaseModel

class AgentOutput(BaseModel):
    answer: str
    confidence: float

@watch(schema=AgentOutput)
def my_agent(input):
    return llm_call(input)

If the output is empty, crashes, or doesn't match the schema → you get an alert.

Alerts

Set in your .env:

AGENTGUARD_TELEGRAM_TOKEN=your_bot_token
AGENTGUARD_TELEGRAM_CHAT_ID=your_chat_id

What it detects

  • Empty or null output
  • Schema violation (wrong structure, missing fields)
  • Agent crash (exception swallowed)

No dashboard. No setup. One line.


Built while running LLM agents in production.
The agent was failing silently for 10 days. We didn't know.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_agentguard-0.1.0.tar.gz (4.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_agentguard-0.1.0-py3-none-any.whl (5.1 kB view details)

Uploaded Python 3

File details

Details for the file llm_agentguard-0.1.0.tar.gz.

File metadata

  • Download URL: llm_agentguard-0.1.0.tar.gz
  • Upload date:
  • Size: 4.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.2

File hashes

Hashes for llm_agentguard-0.1.0.tar.gz
Algorithm Hash digest
SHA256 1974a364797a0e1d8e640572b87d94419feed258faebbf44e1d268dfc9b8e30e
MD5 8f49fa783963799e744bff7cf0254d2b
BLAKE2b-256 76fb9cc420e232180cd99824ab36f42aadabadf5c1ff045f017ab642233ac5bb

See more details on using hashes here.

File details

Details for the file llm_agentguard-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: llm_agentguard-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 5.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.2

File hashes

Hashes for llm_agentguard-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b6c8e5ed2d792ed15b5daf1f578a412b04c5a8752cc9f70bc262c234c29ff65d
MD5 4cf804f645aec03afdcae3bd091972db
BLAKE2b-256 05f1e436226ba81f81fa5b09ebbc5b4b095fee0fc7fe81c687a0b246374e3d13

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page