Skip to main content

Slash LLM costs with intelligent context compression, smart routing, and cost tracking

Project description

TokenPak — Cut your LLM token spend by 30–50%, zero config

PyPI version Python 3.10+ License: MIT

TokenPak is a local proxy that compresses your LLM context before it hits the API — fewer tokens, lower cost, same results. No code changes, no cloud, no credentials stored.


30-second demo

pip install tokenpak
tokenpak serve                          # start proxy at localhost:8766
tokenpak integrate claude-code --apply  # wire Claude Code to the proxy
✅ Applied: Updated ~/.claude/settings.json (2 changes).

Then verify it's working:

tokenpak demo
┌──────────────────────────────────────────────────────┐
│  TokenPak — Live Compression Demo                    │
├──────────────────────────────────────────────────────┤
│  Scenario              DevOps agent (config + logs)  │
│  Savings drivers                      dedup + alias  │
├──────────────────────────────────────────────────────┤
│  Original                                747 tokens  │
│  Compressed                              502 tokens  │
│  Saved                          245 tokens  (32.8%)  │
│  Cost saved (est.)                $0.00073 per call  │
├──────────────────────────────────────────────────────┤
│  Stages: dedup, alias, segmentize, directives        │
└──────────────────────────────────────────────────────┘

Works with

Claude Code · Cursor · Cline · Continue.dev · Aider · OpenAI SDK · Anthropic SDK · LiteLLM · Codex

Run tokenpak integrate to see the full client list with setup guides for each.


Install

pip install tokenpak

See docs/quickstart.md for virtual-env setup and per-client configuration.

Requirements: Python 3.10+. No external dependencies for core functionality.

Exposing the proxy beyond 127.0.0.1? Set TOKENPAK_PROXY_AUTH_TOKEN to a shared secret to require Authorization: Bearer <token> on remote requests (see docs/configuration/proxy-auth.md).


What's included (Free)

  • Context compression — 30–50% token reduction on real agent workloads, <50ms latency Reproduce: make benchmark-headline
  • Client integration — one command wires Claude Code, Cursor, Aider, and 6 other clients
  • Model routing — send requests to the right model automatically, with fallback rules
  • Cost tracking — per model, per session, per agent; local SQLite, zero cloud
  • TIP Spend Guard — pre-send circuit breaker; blocks runaway requests before provider call. Yes/No release or [TIP: allow=once max=$X] directive. Catches both single-request spikes and the death-by-1000-cuts pattern via session-cumulative tracking. See docs/spend-guard.md.
  • Vault indexing + semantic search — index your codebase; search without an LLM call
  • MultiPak Pro Phase 1 OSS surface — read-only Vault Pak adapter, companion journal promotion-candidate marking, tokenpak pak CLI, /pak/v1/* proxy stubs. Full MultiPak (capture pipeline, recall ranking, Handoff Paks, anchor hydration) requires tokenpak-paid (Pro). See docs/multipak.md.
  • CLI + proxy servertokenpak serve, tokenpak cost, tokenpak savings
  • A/B testing and replay/debug — compare compression configs, replay past requests
  • 50 built-in compression recipes — YAML, customizable

80%+ of operations cost zero tokens. See docs/quickstart.md and docs/api-tpk-v1.md to get started.


Pricing

Free Pro Team
Context compression
Client integration (all 9)
Model routing
Cost tracking
Vault indexing + search
CLI + proxy
Advanced compression recipes
Budget enforcement + alerts
Priority support
Multi-agent coordination
Shared vault (team)
RBAC + audit logs
Price Free $99/mo $299/mo

See tokenpak.ai/pricing for full tier details and enterprise options.


Support

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tokenpak-1.5.4.tar.gz (2.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tokenpak-1.5.4-py3-none-any.whl (2.6 MB view details)

Uploaded Python 3

File details

Details for the file tokenpak-1.5.4.tar.gz.

File metadata

  • Download URL: tokenpak-1.5.4.tar.gz
  • Upload date:
  • Size: 2.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for tokenpak-1.5.4.tar.gz
Algorithm Hash digest
SHA256 0fdaf70ceed321174210c0661af8e2ab5d8a0832341b03071cb0bb820d22cd87
MD5 33121ad3237c42053c9ab77734509b09
BLAKE2b-256 ed5b43611f27b859bfc5bf8dbb9ec603f655bb6f40d67b8b6a7deedbf9d897f0

See more details on using hashes here.

Provenance

The following attestation bundles were made for tokenpak-1.5.4.tar.gz:

Publisher: release.yml on tokenpak/tokenpak

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file tokenpak-1.5.4-py3-none-any.whl.

File metadata

  • Download URL: tokenpak-1.5.4-py3-none-any.whl
  • Upload date:
  • Size: 2.6 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for tokenpak-1.5.4-py3-none-any.whl
Algorithm Hash digest
SHA256 a3344eb45ea0033d131b5442ba35bf2f46d4a0975e384b08117676996cfba147
MD5 2f1f7ed4d95ab9fd06a6a9031c8995f4
BLAKE2b-256 d816969b3d8619a003862385bbf1568fb70e0b179fbb1330d5b0690548af9fa1

See more details on using hashes here.

Provenance

The following attestation bundles were made for tokenpak-1.5.4-py3-none-any.whl:

Publisher: release.yml on tokenpak/tokenpak

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page