LLM Sentinel SDK

Runtime monitoring for AI applications — detect prompt injections, privilege escalations, and adversarial attacks in production, not just pre-launch.

LLM Sentinel — Burp Suite for LLMs.

Install

pip install llm-sentinel-sdk

Requires Python 3.9+ and httpx. Works alongside any OpenAI-compatible client.

Quick Start

import openai
from llm_sentinel import SentinelClient

client = SentinelClient(
    api_key="sk-sentinel-...",          # from LLM Sentinel dashboard
    base_client=openai.OpenAI(api_key="sk-openai-..."),
)

# Use exactly like openai.OpenAI — monitoring is automatic
response = client.chat.completions.create(
    model="gpt-4o",
    messages=[{"role": "user", "content": user_input}],
)

Flagged calls are sent to your LLM Sentinel dashboard in real time. Your app always continues — the SDK fails open.

Async

import openai
from llm_sentinel import AsyncSentinelClient

client = AsyncSentinelClient(
    api_key="sk-sentinel-...",
    base_client=openai.AsyncOpenAI(api_key="sk-openai-..."),
)

response = await client.chat.completions.create(
    model="gpt-4o",
    messages=[{"role": "user", "content": user_input}],
)

What Gets Detected

The SDK includes a compiled rule engine covering 8 attack categories:

Rules are compiled at import time — detection adds <5ms per call.

Configuration

client = SentinelClient(
    api_key="sk-sentinel-...",
    base_client=openai.OpenAI(api_key="..."),
    base_url="https://api.llmsentinel.com",  # default; override for self-hosted
    dry_run=False,                            # True = log events, suppress alert emails
)

Limitations

• Streaming: stream=True calls pass through without monitoring (streaming responses can't be inspected before delivery).
• Sync latency: SentinelClient (sync) makes a blocking HTTP call on flagged messages — up to 3s on connect timeout. Use AsyncSentinelClient in async frameworks to avoid this.
• Rule engine scope: Only user-role messages are checked. System and assistant messages are developer-controlled and trusted.
• Client compatibility: Works with any object implementing .chat.completions.create(). Tested with openai>=1.0.

Get Your API Key

Sign up at github.com/HexMystic/llm-sentinel → Dashboard → SDK Keys → Create Key.

Links

• Main Repository
• Report an Issue
• License: MIT