⚡ TokenSafe (tokensafe)
Autonomous Zero-Loss Token Economy & Context Optimizer for AI Coding Agents.
Slashes LLM token costs by 60%–90% with zero quality loss. Built for Google Antigravity, OpenAI Codex, Cursor, Claude Desktop, Z.ai Code, Windsurf & Cline.
🌐 Official Website: https://tokensafe.dev
⚡ 1-Click Universal Install
Connect TokenSafe to all detected AI coding agents on your machine in seconds:
# Option 1: Zero-Install via npx (Recommended for Cursor & Claude Desktop)
npx tokensafe
# Option 2: Python / PyPI
pip install tokensafe && tokensafe
# Option 3: Direct Shell Script (macOS / Linux)
curl -fsSL https://tokensafe.dev/install.sh | bash
🔌 Universal MCP Server Configuration
Connect TokenSafe directly to Claude Desktop (claude_desktop_config.json) or Cursor MCP Settings:
{
"mcpServers": {
"tokensafe": {
"command": "npx",
"args": ["-y", "tokensafe", "mcp"]
}
}
}
🚀 The Breakthrough: How It Saves 60%–90% Tokens
Traditional AI code interactions suffer from massive context bloat:
- The BPE Token Penalty: Verbose natural language prompts and filler waste 40%–70% of ingress context.
- Bulk Tool Dumps: Reading whole 800+ line files burns 5,000+ tokens per turn when only 20 lines are needed.
- Stuck Loops & Bloated Diffs: Terminal
git diffand repetitive failed commands spiral context into overflow.
TokenSafe Solves All Three Autonomously:
- Graph-Guided AST Skeletonization: Folds inactive function bodies into signatures, keeping target functions and 1-hop dependencies full while collapsing unrelated code (
-85% to -92%). - God Nodes & Architectural Hub Detection: Calculates Degree Centrality to identify structural project hubs and injects topology awareness into agent sessions without expensive file crawling.
- TOCP Prompt Distillation: Intercepts prompts and distills intent into lean S-Expressions via Google Gemini (2.0 Flash-Lite), OpenAI ChatGPT (gpt-4o-mini), or DeepSeek-Flash (
-40% to -70%). Automatically detectsGEMINI_API_KEY,OPENAI_API_KEY, orDEEPSEEK_API_KEY. - API Surface Map Generator: Generates high-density
tokensafe-out/API_SURFACE.md(~1.5k tokens) for instant agent codebase onboarding. - Predictive Dependency Prefetcher: Attaches imported symbol signatures to eliminate downstream exploratory
read_fileroundtrips. - Local Secret Redactor: Sanitizes Stripe, AWS, JWT, and database credentials before network transmission.
- Output Guard & Loop Guard: Blocks destructive full-file rewrites on files $\ge 40$ lines and halts command loops.
⚡ TokenSafe vs. Graphify: Dynamic In-Flight Defense vs. Static Reports
How TokenSafe complements or supersedes static graph tools like Graphify (graphify-labs/graphify):
| Capability | Graphify | TokenSafe |
|---|---|---|
| Primary Focus | Static knowledge graph reports & MCP queries | In-flight real-time token compression & defense |
| Indexing Cost | Expensive LLM tokens / heavy graph extraction | 0 tokens, 100% deterministic local AST (< 30ms) |
| Execution Latency | Offline / CLI-initiated build | Sub-millisecond inline proxy & lifecycle hooks |
| Active Slicing | Static file output (GRAPH_REPORT.md) |
Dynamic call-graph skeletonization (85–92% saved) |
| Multi-Project Workspace | Requires manual directory targeting | Auto-detects project roots per file on the fly |
| Agent Prompt Optimization | None | TOCP S-Expression prompt distillation (-40% to -70%) |
| Safety & Runaway Prevention | None | Output rewrite guard, loop detector, secret scrubbing |
Complements & Replaces: If you already use Graphify for repository mapping, TokenSafe works alongside it by compressing real-time agent tool reads on the wire. Or use TokenSafe standalone for a zero-configuration, zero-cost, sub-30ms architecture engine out of the box.
🤖 Universal LLM Distillation Providers
TokenSafe supports any key you already have:
| Provider | Supported Model | Environment Variable | Config Key |
|---|---|---|---|
| Google Gemini | gemini-2.0-flash-lite, gemini-2.0-flash |
GEMINI_API_KEY |
gemini_api_key |
| OpenAI ChatGPT | gpt-4o-mini, gpt-4o |
OPENAI_API_KEY |
openai_api_key |
| DeepSeek | deepseek-flash, deepseek-chat |
DEEPSEEK_API_KEY |
deepseek_api_key |
Check active providers anytime with:
tokensafe providers
📊 Zero-Loss SWE-bench Benchmark Results
Verified across 5 real-world production scenarios:
| Benchmark Scenario | Task Complexity | Baseline Tokens | TokenSafe Tokens | Reduction | Turn Speedup | Accuracy |
|---|---|---|---|---|---|---|
| Django ORM N+1 Fix | Multi-file query refactoring | 14,280 | 1,120 | -92.1% | +12% faster | 100% Pass |
| FastAPI Async Race | Concurrency bug investigation | 8,640 | 2,940 | -65.9% | +10% faster | 100% Pass |
| TypeScript Redux Vault | Full AST symbol refactoring | 18,400 | 2,130 | -88.4% | +9% faster | 100% Pass |
| Stuck Command Loop | Subprocess infinite loop | 22,100 | 2,400 | -89.1% | Stopped loop | 100% Pass |
| Heavy Rewrite Guard | Whole-file write attempt | 11,300 | 4,310 | -61.8% | Forced edit_file | 100% Pass |
💎 Pricing & 7-Day Free Trial
| Tier | Price | Highlights |
|---|---|---|
| Hacker (Open-Core) | $0 (Free Forever) | 100k tokens/mo, Local Regex compactor, use own DeepSeek / Gemini key |
| Solo Developer | $9 / month | 7-Day Free Trial, Unlimited Managed DeepSeek-Flash / Gemini Flash-Lite, AST Prefetcher, Output Guards |
| Engineering Team | $29 / dev / mo | 7-Day Free Trial, Team Budget Caps, Centralized Ledger, B2B Docker Proxy |
| Enterprise | Custom | On-Premise Nuitka C-compiled Docker Proxy, Custom Compliance, SAML SSO |
👉 Start your 7-Day Free Trial on our website
🛠️ CLI Quickstart
# Analyze repository God Nodes and dependency topology
tokensafe graph
# Generate compact tokensafe-out/API_SURFACE.md interface snapshot
tokensafe map
# View live savings dashboard in your terminal
tokensafe stats
# Open interactive Apple dark-mode HTML dashboard
tokensafe html
# Run the 5-scenario benchmark suite
tokensafe benchmark
# Run the local transparent AI proxy (127.0.0.1:8765/v1)
tokensafe proxy
# Activate your Pro License key
tokensafe activate TS1.eyJlbWFpbCI6...
🧪 Unit Testing
python3 -m unittest discover tests
Zero external runtime dependencies — runs on standard Python 3.10+.
📄 License
MIT License. Commercial enterprise licenses available for on-premise B2B deployments.
Export Markdown Report
./bin/agy-tokens markdown
📂 Project Structure
agy-token-optimizer/
├── plugin.json # Antigravity plugin manifest
├── hooks.json # Lifecycle hook declarations (PreInvocation, PreToolUse, PostToolUse)
├── rules/
│ └── AGENTS.md # TOCP Protocol directives for LLM (prompt-cached)
├── skills/
│ └── token-optimizer/
│ └── SKILL.md # On-demand Antigravity skill
├── proto/
│ └── tocp.proto # Protocol Buffers contract
├── src/
│ ├── tokenizer.py # Zero-dependency calibrated BPE token counter
│ ├── compactor.py # Semantic compactor (Natural Language -> TOCP S-Expr)
│ ├── slicer.py # AST & Line windowing tool optimizer
│ ├── metrics.py # Persistent SQLite metrics engine
│ └── dashboard.py # Visual ANSI terminal & Markdown generator
├── hooks/
│ ├── pre_invocation.py # PreInvocation hook entry point
│ ├── pre_tool_use.py # PreToolUse hook entry point
│ └── post_tool_use.py # PostToolUse hook entry point
├── bin/
│ └── agy-tokens # Executable CLI
├── tests/ # Unit test suite (100% passing)
├── install.sh # One-click installer for Antigravity
└── README.md
🛠️ Installation & Antigravity Setup
Run the installer:
./install.sh
This symlinks the plugin directly into ~/.gemini/config/plugins/agy-token-optimizer.
Antigravity automatically loads it on startup.
🧪 Running Unit Tests
python3 -m unittest discover tests
No external packages required — runs on standard Python 3.10+.
Metadata
Release files for tokensafe 1.2.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| tokensafe-1.2.0.tar.gz | 69.8 kB | Without provenance | Details for tokensafe-1.2.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| tokensafe-1.2.0-py3-none-any.whl | Python 3 | none | any | Details for tokensafe-1.2.0-py3-none-any.whl |
Total release size: 134.0 kB
Release files / tokensafe-1.2.0.tar.gz
| Download URL | tokensafe-1.2.0.tar.gz |
|---|---|
| Size | 69.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c970e08652d6e8d971f196be970d0eb2c4fe4ddc993f6aae1456f711c3c2a17a
|
|
BLAKE2b-256 checksum How to use checksums |
2b441495d634dc51e6028c4c85c031d7235848872c014d438d0a8167bbe323a5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.5
|
Release files / tokensafe-1.2.0-py3-none-any.whl
| Download URL | tokensafe-1.2.0-py3-none-any.whl |
|---|---|
| Size | 64.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
918383825aff3b08ba84258515875ab16181808d9da365b08c2395ff3342b201
|
|
BLAKE2b-256 checksum How to use checksums |
b8499263ae2440f39bcfacbfb3ee0850a275667f0f4cc7b1a1128d86ff158528
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.5
|
Security for tokensafe 1.2.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.