Skip to main content

CDX A2A Slimmer (cdx-a2a-slimmer)

Prompt Cache (KV-Cache) Preserving Zero-Loss Token Slimmer for Multi-Agent LLM Pipelines
100% Prompt Cache Hit Retention + 30% AST Lossless Slimming
Built by Cantor Labs (Cantor Diagonal eXpress)

PyPI version Latency Token Savings KV Cache Hit


⚡ Why CDX A2A Slimmer? (Solving the Cache Invalidation Trap)

Across all major LLM providers (Anthropic Claude, OpenAI, DeepSeek, vLLM RadixAttention), prompt caching is now the core foundation of multi-agent communication. Cache hits provide 50%~90% cost discounts and reduce Time-to-First-Token (TTFT) by 80%.

However, conventional token compressors lacking cache awareness randomly modify prompt prefixes across turns, triggering Cache Misses that can inflate total bills by up to 2.5x!

CDX A2A Slimmer solves this via a 2-Tier Prefix-Tail Split architecture:

  1. Tier 1 (Static Prefix): Tool schemas and system instructions are canonically sorted (lexicographical normalization), locking byte-level invariance to guarantee 100% KV-Cache Hit Rates.
  2. Tier 2 (Dynamic Tail): Intermediate conversational turns and verbose tool outputs are trimmed with 30% lossless AST slimming.

📊 3-Way Architectural Cost & Latency Comparison (10,000 Token Baseline)

Parameter Standard Call (No Slimmer) Conventional Compressor (Cache Invalidation) CDX A2A Slimmer (Cache-Preserving)
Static Prefix (Tools/System 8K) 100% Cost 70% Cost (Cache Missed) 10% Cost (100% Cache Hit Retained)
Dynamic Tail (Messages/Output 2K) 100% Cost 70% Cost 70% Cost (30% Lossless Slimming)
Effective Net Cost (Tokens) 10,000 Tokens (100%) 7,000 Tokens (2.5x More Expensive!) 2,200 Tokens (78% ~ 93% Effective Net Savings)
P99 TTFT Latency 1,200 ms 1,150 ms 180 ms (Sub-second Responsiveness)

🎯 The 2 Mandatory Conditions for BigTech Cache Discounts

Frontier LLM 50~90% prompt cache discounts activate ONLY when two conditions are simultaneously satisfied:

  1. Condition 1: Byte-Level Invariance: The static prefix must not alter a single whitespace, key order, or character (KVCachePreservingNormalizer guarantees 100% canonical invariance).
  2. Condition 2: Minimum 1,024-Token Threshold: The prefix length must be >= 1,024 tokens (OpenAI automatic caching & Anthropic cache_control standard).
    • Cache Threshold Safeguard (Over-Slimming Prevention): If a compressor prunes an 1,100-token static schema down to 950 tokens without cache awareness, it drops below the 1,024-token boundary, causing immediate forfeiture of the provider cache discount!
    • The CDX Solution: CDX A2A Slimmer safely maintains static schemas above the 1,024-token cache threshold (sorting keys without over-compressing), concentrating all 30% AST slimming strictly on the dynamic conversational tail, completely eliminating cache disqualification risks.

📊 Transparent Benchmark Results (v1.0 Live Telemetry)

We believe in radical engineering honesty. Here are the exact measured numbers across real-world multi-agent scenarios:

Multi-Agent Scenario Raw Payload Slimmed Token Reduction (%) Overhead Latency Monthly Savings (1M Calls @ GPT-4o)
① Complex Multi-Agent (Tool + CoT) 2,469 Bytes 1,690 Bytes 31.55% 0.056 ms +$486.80
② Code Review Crew (CrewAI) 2,286 Bytes 1,710 Bytes 25.20% 0.233 ms +$377.50
③ Market Research Analyst (AutoGen) 1,967 Bytes 1,544 Bytes 21.50% 0.168 ms +$277.50
④ SQL Analytics & Migration (LangGraph) 1,233 Bytes 986 Bytes 20.03% 0.141 ms +$162.50

Why the variance?
Workloads with rich Tool/MCP schemas and conversational histories see 30%~35% savings. Workloads dominated by raw SQL query strings or pure tabular numbers see 20%~25% savings because we strictly refuse to touch raw code, numbers, or identifiers.


📦 Quick Installation

pip install cdx-a2a-slimmer

🚀 Usage

1. 1-Line Drop-In Function

from cdx_a2a_slimmer import slim

# Raw multi-agent request payload (OpenAI / Anthropic schema)
raw_payload = {
    "model": "gpt-4o",
    "tools": [
        {
            "type": "function",
            "function": {
                "name": "query_database",
                "description": "Executes SQL query on primary database cluster. Highly reliable execution engine.",
                "parameters": {
                    "$schema": "http://json-schema.org/draft-07/schema#",
                    "title": "QueryParams",
                    "type": "object",
                    "properties": {
                        "sql_query": {"title": "SQL Query", "type": "string", "description": "Raw SQL query string."}
                    },
                    "required": ["sql_query"]
                }
            }
        }
    ],
    "messages": [
        {"role": "user", "content": "Hello! As an AI assistant, I have verified the query: SELECT * FROM users. Please proceed."}
    ]
}

# 1-Line Slimming (< 0.08 ms overhead, 30% smaller)
slimmed_payload = slim(raw_payload)

2. OpenAI SDK Client Hook

from openai import OpenAI
from cdx_a2a_slimmer import slim

client = OpenAI()

# Wrap your parameters with slim() before sending
response = client.chat.completions.create(
    **slim({
        "model": "gpt-4o",
        "messages": messages,
        "tools": tools
    })
)

3. Telemetry & Metrics

from cdx_a2a_slimmer import CDXA2ATokenSlimmer

slimmer = CDXA2ATokenSlimmer()
slimmed_payload, telemetry = slimmer.slim_payload(raw_payload)

print(f"Raw: {telemetry['raw_bytes']}B ➔ Slim: {telemetry['slimmed_bytes']}B")
print(f"Savings: {telemetry['reduction_percent']}% | Latency: {telemetry['latency_ms']:.4f} ms")

🐳 50MB Docker Sidecar (macOS, Linux & Multi-Language Support)

For macOS (Apple Silicon M1/M2/M3/M4 & Intel), Linux (Ubuntu/Debian/RHEL), and non-Python environments (Node.js, TypeScript, Go, Java, Rust), run the 100% binary-sealed zero-data-retention (ZDR) reverse proxy sidecar locally or in your Kubernetes cluster with zero code changes:

docker run -d -p 8080:8080 \
  -e TARGET_UPSTREAM="https://api.openai.com" \
  cantorlabs/cdx-a2a-sidecar:latest

Point any AI agent framework (OpenAI, Anthropic, LangChain, CrewAI, AutoGen) to http://localhost:8080/v1:

from openai import OpenAI

# Zero-configuration proxying: Automatic 30% AST slimming + 100% KV-cache retention
client = OpenAI(base_url="http://localhost:8080/v1")
  • Zero Local Source Footprint: 100% compiled native ELF machine binary inside Alpine container.
  • Health check: GET http://localhost:8080/health
  • Live savings metrics: GET http://localhost:8080/metrics

🛡️ Zero-Loss Guarantees

  1. Strict Numerical & Code Lock: Numbers (1042), financial amounts ($30.04), SQL/Python code blocks, and variable identifiers are preserved 100% byte-for-byte.
  2. JSON Schema Integrity: required, properties, and field types are strictly preserved.
  3. KV Cache Dual Discount: Canonical prefix sorting guarantees OpenAI/Anthropic prompt cache hit rates remain at 100%.
  4. Sub-Millisecond Speed: Pure zero-dependency C-optimized algorithms run in ~50 microseconds.

⚖️ Intellectual Property & Patent Protection

This software, including its AST schema pruning engines, deterministic lexicographical canonicalizers, and prompt-cache-preserving payload partitioning mechanisms, is protected under:

  • Republic of Korea Patent Application No. 10-2026-0172394 (Lossless In-Memory Proxy Slimming System and Method for Multi-Agent Communication Data)
  • Republic of Korea Patent Application No. 10-2026-0175561 (Payload Partitioning and Canonical Normalization System and Method to Preserve LLM Prompt Cache Hit Rates)
  • WIPO Digital Access Service (DAS) Priority: A867 & E380

All worldwide patents, copyrights, trade secrets, and machine binaries remain the exclusive property of Cantor Labs Inc. Reverse engineering, decompilation, and unauthorized commercial redistribution are strictly prohibited under the Cantor Labs Master Enterprise Agreement and EULA.


💎 Official Pricing Tiers

  • Developer Free ($0 / mo): 1 Local Machine, up to 5 concurrent sessions, 100,000 monthly slimming calls, basic AST schema pruning (~20% savings).
  • Team ($499 / mo, $399/mo billed annually): Up to 5 Node (Pod) Clusters, 1,000,000 monthly slimming calls, tool & conversation token pruning (~20%~30% savings), RFC 8259 deterministic canonicalizer, Prometheus telemetry, 24h technical support.
  • Business ($1,499 / mo, $1,199/mo billed annually): Up to 20 Node (Pod) Clusters, 5,000,000 monthly slimming calls, high-concurrency threading engine, Kubernetes autoscaling & multi-VPC support, 99.9% availability guarantee (4h SLA).
  • Enterprise Sovereign (Custom ARR / Dedicated SLA): Dedicated VPC & 100% Air-Gapped offline deployment, custom large-scale nodes (50~100+ Pods or unlimited), 15M+ unlimited monthly volume, PII zero-trust vault, 99.99% availability guarantee & 15-min priority engineer hotline.

🗺️ Roadmap

  • v1.0 (Current Release): Tool JSON Schema slimming, greeting stripping, RFC 8259 deterministic canonicalizer (supporting ~20%~30% savings).
  • v1.1 (Upcoming): Multi-turn context folding and structured JSON compression for large-scale enterprise workflows.
  • v1.2 (Upcoming): Native C++/Rust/WASM extensions for sub-10µs latency.

📄 License

Commercial Enterprise / Apache 2.0 Community. Designed & Engineered by Oh-dong-kyu (Cantor Labs).

Metadata

Release files for cdx-a2a-slimmer 1.0.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for cdx-a2a-slimmer 1.0.0
File Interpreter ABI Platform Actions
cdx_a2a_slimmer-1.0.0-py3-none-any.whl Python 3 none any Details for cdx_a2a_slimmer-1.0.0-py3-none-any.whl

Release files / cdx_a2a_slimmer-1.0.0-py3-none-any.whl

Download URL cdx_a2a_slimmer-1.0.0-py3-none-any.whl
Size 281.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
09af6d167515c714a6ad8f226e9c21c7da9deac90dab836fd2e3c1451fa869d4
BLAKE2b-256 checksum
How to use checksums
e09a91c1e7630362113eb7772478f5c5170548002af7db560245c9f007407a36
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.2

Security for cdx-a2a-slimmer 1.0.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

1.0.0 This release

1 release file No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page