Skip to main content

Slash LLM costs with intelligent context compression, smart routing, and cost tracking

Project description

TokenPak — Cut your LLM token spend by 30–50%, zero config

PyPI version Python 3.10+ License: MIT

TokenPak is a local proxy that compresses your LLM context before it hits the API — fewer tokens, lower cost, same results. No code changes, no cloud, no credentials stored.


30-second demo

pip install tokenpak
tokenpak serve                          # start proxy at localhost:8766
tokenpak integrate claude-code --apply  # wire Claude Code to the proxy
✅ Applied: Updated ~/.claude/settings.json (2 changes).

Then verify it's working:

tokenpak demo
┌──────────────────────────────────────────────────────┐
│  TokenPak — Live Compression Demo                    │
├──────────────────────────────────────────────────────┤
│  Scenario              DevOps agent (config + logs)  │
│  Savings drivers                      dedup + alias  │
├──────────────────────────────────────────────────────┤
│  Original                                747 tokens  │
│  Compressed                              502 tokens  │
│  Saved                          245 tokens  (32.8%)  │
│  Cost saved (est.)                $0.00073 per call  │
├──────────────────────────────────────────────────────┤
│  Stages: dedup, alias, segmentize, directives        │
└──────────────────────────────────────────────────────┘

Works with

Claude Code · Cursor · Cline · Continue.dev · Aider · OpenAI SDK · Anthropic SDK · LiteLLM · Codex

Run tokenpak integrate to see the full client list with setup guides for each.


Install

pip install tokenpak

See docs/quickstart.md for virtual-env setup and per-client configuration.

Requirements: Python 3.10+. No external dependencies for core functionality.

Exposing the proxy beyond 127.0.0.1? Set TOKENPAK_PROXY_AUTH_TOKEN to a shared secret to require Authorization: Bearer <token> on remote requests (see docs/configuration/proxy-auth.md).


What's included (Free)

  • Context compression — 30–50% token reduction on real agent workloads, <50ms latency Reproduce: make benchmark-headline
  • Client integration — one command wires Claude Code, Cursor, Aider, and 6 other clients
  • Model routing — send requests to the right model automatically, with fallback rules
  • Cost tracking — per model, per session, per agent; local SQLite, zero cloud
  • TIP Spend Guard — pre-send circuit breaker; blocks runaway requests before provider call. Yes/No release or [TIP: allow=once max=$X] directive. Catches both single-request spikes and the death-by-1000-cuts pattern via session-cumulative tracking. See docs/spend-guard.md.
  • Vault indexing + semantic search — index your codebase; search without an LLM call
  • MultiPak Pro Phase 1 OSS surface — read-only Vault Pak adapter, companion journal promotion-candidate marking, tokenpak pak CLI, /pak/v1/* proxy stubs. Full MultiPak (capture pipeline, recall ranking, Handoff Paks, anchor hydration) requires tokenpak-paid (Pro). See docs/multipak.md.
  • CLI + proxy servertokenpak serve, tokenpak cost, tokenpak savings
  • A/B testing and replay/debug — compare compression configs, replay past requests
  • 50 built-in compression recipes — YAML, customizable

80%+ of operations cost zero tokens. See docs/quickstart.md and docs/api-tpk-v1.md to get started.


Pricing

Free Pro Team
Context compression
Client integration (all 9)
Model routing
Cost tracking
Vault indexing + search
CLI + proxy
Advanced compression recipes
Budget enforcement + alerts
Priority support
Multi-agent coordination
Shared vault (team)
RBAC + audit logs
Price Free $99/mo $299/mo

See tokenpak.ai/pricing for full tier details and enterprise options.


Support

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tokenpak-1.5.5.tar.gz (2.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tokenpak-1.5.5-py3-none-any.whl (2.6 MB view details)

Uploaded Python 3

File details

Details for the file tokenpak-1.5.5.tar.gz.

File metadata

  • Download URL: tokenpak-1.5.5.tar.gz
  • Upload date:
  • Size: 2.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for tokenpak-1.5.5.tar.gz
Algorithm Hash digest
SHA256 5f9ea7a920204235eab37e58f7ec04f29f489407c6e130c64c6b3ffe8a469308
MD5 1d9efd11734b70a349bf65c3b256607f
BLAKE2b-256 5da2760835c09e2072b4e220f490801c888b7d4e9658ad4a51f2e52fa3710d89

See more details on using hashes here.

Provenance

The following attestation bundles were made for tokenpak-1.5.5.tar.gz:

Publisher: release.yml on tokenpak/tokenpak

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file tokenpak-1.5.5-py3-none-any.whl.

File metadata

  • Download URL: tokenpak-1.5.5-py3-none-any.whl
  • Upload date:
  • Size: 2.6 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for tokenpak-1.5.5-py3-none-any.whl
Algorithm Hash digest
SHA256 21749f66acc20eb066eb0e786d8c3e8d435221e094a30887c5d3af1651d1f46d
MD5 65cc0bfd419a879f4e546c75b0c60048
BLAKE2b-256 1b6aa41ddeb02fe868abc8160f7304fd3a877dd31c9fcc24acdd62e5b3b8151d

See more details on using hashes here.

Provenance

The following attestation bundles were made for tokenpak-1.5.5-py3-none-any.whl:

Publisher: release.yml on tokenpak/tokenpak

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page