Skip to main content

Slash LLM costs with intelligent context compression, smart routing, and cost tracking

Project description

TokenPak — Cut your LLM token spend by 30–50%, zero config

PyPI version Python 3.10+ License: MIT

TokenPak is a local proxy that compresses your LLM context before it hits the API — fewer tokens, lower cost, same results. No code changes, no cloud, no credentials stored.


30-second demo

pip install tokenpak
tokenpak serve                          # start proxy at localhost:8766
tokenpak integrate claude-code --apply  # wire Claude Code to the proxy
✅ Applied: Updated ~/.claude/settings.json (2 changes).

Then verify it's working:

tokenpak demo
┌──────────────────────────────────────────────────────┐
│  TokenPak — Live Compression Demo                    │
├──────────────────────────────────────────────────────┤
│  Scenario              DevOps agent (config + logs)  │
│  Savings drivers                      dedup + alias  │
├──────────────────────────────────────────────────────┤
│  Original                                747 tokens  │
│  Compressed                              502 tokens  │
│  Saved                          245 tokens  (32.8%)  │
│  Cost saved (est.)                $0.00073 per call  │
├──────────────────────────────────────────────────────┤
│  Stages: dedup, alias, segmentize, directives        │
└──────────────────────────────────────────────────────┘

Works with

Claude Code · Cursor · Cline · Continue.dev · Aider · OpenAI SDK · Anthropic SDK · LiteLLM · Codex

Run tokenpak integrate to see the full client list with setup guides for each.


Install

pip install tokenpak

See docs/quickstart.md for virtual-env setup and per-client configuration.

Requirements: Python 3.10+. No external dependencies for core functionality.

Exposing the proxy beyond 127.0.0.1? Set TOKENPAK_PROXY_AUTH_TOKEN to a shared secret to require Authorization: Bearer <token> on remote requests (see docs/configuration/proxy-auth.md).


What's included (Free)

  • Context compression — 30–50% token reduction on real agent workloads, <50ms latency Reproduce: make benchmark-headline
  • Client integration — one command wires Claude Code, Cursor, Aider, and 6 other clients
  • Model routing — send requests to the right model automatically, with fallback rules
  • Cost tracking — per model, per session, per agent; local SQLite, zero cloud
  • TIP Spend Guard — pre-send circuit breaker; blocks runaway requests before provider call. Yes/No release or [TIP: allow=once max=$X] directive. Catches both single-request spikes and the death-by-1000-cuts pattern via session-cumulative tracking. See docs/spend-guard.md.
  • Vault indexing + semantic search — index your codebase; search without an LLM call
  • CLI + proxy servertokenpak serve, tokenpak cost, tokenpak savings
  • A/B testing and replay/debug — compare compression configs, replay past requests
  • 50 built-in compression recipes — YAML, customizable

80%+ of operations cost zero tokens. See docs/quickstart.md and docs/api-tpk-v1.md to get started.


Pricing

Free Pro Team
Context compression
Client integration (all 9)
Model routing
Cost tracking
Vault indexing + search
CLI + proxy
Advanced compression recipes
Budget enforcement + alerts
Priority support
Multi-agent coordination
Shared vault (team)
RBAC + audit logs
Price Free $99/mo $299/mo

See tokenpak.ai/pricing for full tier details and enterprise options.


Support

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tokenpak-1.5.1.tar.gz (2.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tokenpak-1.5.1-py3-none-any.whl (2.6 MB view details)

Uploaded Python 3

File details

Details for the file tokenpak-1.5.1.tar.gz.

File metadata

  • Download URL: tokenpak-1.5.1.tar.gz
  • Upload date:
  • Size: 2.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for tokenpak-1.5.1.tar.gz
Algorithm Hash digest
SHA256 eb1f42da8a135fb26e3a1841fe99904584603d1a2b7afd01773185dfd3965631
MD5 dec3be506500204b6b4be9057f7cacb7
BLAKE2b-256 39f81ef0ad4d679863d8a7cbfc187ffd28018a75d775a4738fc55750dae53c4a

See more details on using hashes here.

File details

Details for the file tokenpak-1.5.1-py3-none-any.whl.

File metadata

  • Download URL: tokenpak-1.5.1-py3-none-any.whl
  • Upload date:
  • Size: 2.6 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for tokenpak-1.5.1-py3-none-any.whl
Algorithm Hash digest
SHA256 374790285bd84a31c9d107937635de2df5f971156394ce8bac1d887643c8eb2e
MD5 ea4f93b7f9a1ce41dc39eb74d31be34e
BLAKE2b-256 4cf70bf6fd1821da6f1fecce27eb3639b415ecb33f71feb6a9c01d9dc05ebada

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page