promptolian 2.3.3

Drop-in SDK for Anthropic & OpenAI — compresses prompts transparently. CLI + REST API + Claude Code MCP.

Promptolian — Context Reliability Proxy for AI Agents

Proxy layer for AI agents — keeps context intact across long conversations and eliminates redundant token costs. One line to add, zero changes to your agent logic.

promptolian.com · Pricing · Dashboard · Docs

---

Install

pip install promptolian            # core (rule-based, no deps)
pip install "promptolian[proxy]"   # + transparent API proxy
pip install "promptolian[nlp]"     # + NLP compression (spacy)
pip install "promptolian[mcp]"     # + Claude Code MCP tool
pip install "promptolian[full]"    # everything

---

Quick Start

# Transparent proxy at http://localhost:3002
python -m promptolian.proxy

# With context compression
python -m promptolian.proxy --compress

# With automatic session reset at 70% of context window
python -m promptolian.proxy --reset-at 0.70

Point your Anthropic or OpenAI client at http://localhost:3002 — no other changes needed.

---

Context Engine

KV-sandwich architecture — preserves what matters, compresses what doesn't:

• HEAD (first 2 turns): verbatim — session framing preserved
• MIDDLE: entity-encoded + compressed — redundant tokens removed
• TAIL (last 4 turns): verbatim — recent facts + task state intact

Benchmark results (25 sessions, Factory.ai 6-dimension scoring):

	Promptolian	Anthropic built-in	OpenAI built-in
Quality score	4.26 / 5	3.44 / 5	3.35 / 5
Compression	21.8%	98.7%	99.3%

---

Session Reset

The proxy tracks cumulative token usage per session. When it approaches the model's context window limit, it automatically compresses the conversation history via the context engine and starts a fresh session — injecting the compressed context as a system prompt. The provider never sees a context long enough to trigger their own native compression.

Works for both Anthropic and OpenAI/Codex. A X-Promptolian-Reset: true header is returned when a reset occurs.

---

Tool Schema Caching

The proxy adds cache_control to tool schemas and re-injects them on subsequent calls. Anthropic bills cached tokens at 10%.

Without proxy: 500 calls/day × 5 tools × 120 tok × 30 days = 9M tok/mo → $27.00
With proxy:    9M tok × 10% cache rate                       = 900K tok/mo → $2.70

---

Plans

Plan	Price	Sessions	Keys
Free	$0	SQLite · self-hosted	—
Solo	$9/mo	PostgreSQL · always-on	1
Team	$49/mo	PostgreSQL · always-on	Up to 10

→ promptolian.com/pricing.html