Skip to main content

Token killer for local developer sessions.

Project description

Tokki

Tokki logo

Distribution: Private wheelhouse License: Proprietary

Tokki is a proprietary local developer tool distributed as compiled wheels. It is a token killer for local developer sessions: built to cut avoidable local agent context before it becomes prompt spend, while keeping implementation details and local payloads private.

This public package and repository contain limited package information, license terms, public proof figures, and security-contact guidance only. Implementation source and detailed operational documentation are private.

Public Report

Proof figures from the maintainer checkout (2026-06-05, local metadata only; summary-only public evidence):

Signal Figure Public evidence boundary
Current-session demo 99.0% avoidable context removed summary-only local ledger; no prompts, raw logs, paths, or file bodies
Current-session net result 4,233,059 tokens kept local aggregate public proof, no per-event details
Repeatable benchmark pack 80,485 net tokens saved tokenizer-counted benchmark bundle; source hidden
Dirty-worktree context 80,263 baseline -> 136 Tokki tokens, 590x source-hidden repository context benchmark
Cost projection $8.218 projected avoided default demo prices; not billing evidence
Privacy guard 0 strict findings public-surface privacy scan passed

This is a public teaser, not an operational manual. Detailed mechanisms, commands, source paths, raw logs, and private reports stay out of this repository.

Tokki and Caveman Code

Caveman Code is the agent choice: a full terminal coding agent whose token strategy is to keep its own replies terse and enforce tight tool-output budgets.

Tokki is the wrapper choice: a source-private, compiled local layer that keeps your existing agent commands and reduces avoidable local context before it becomes prompt spend. Public Tokki evidence remains summary-only: no prompts, raw logs, file bodies, source paths, or implementation details.

Use Caveman Code when you want the agent itself to be the frugal surface. Use Tokki when you want a private compiled-wheel layer around the agents you already use. The two can complement each other: Tokki can install wrappers with tokki setup without making the Tokki source public.

The private CLI also includes tokki benchmark for comparing report-path timings. Its log-digest benchmark path uses the native Rust helper when available and falls back to Python only for compatibility, while public evidence stays summary-only.

Install

Tokki ships as compiled wheels staged in this private repo under wheelhouse/tokki-1.0.0/. Install the wheel matching your OS, then verify with tokki --version and tokki doctor --strict. PyPI publishing is retired. Checksums are stored beside the wheels in SHA256SUMS.

Private maintainers with access to this source repository can install directly from a fresh clone when Rust/Cargo is installed:

uv tool install --force "git+https://github.com/jpmorard/tokki.git"
tokki --version

For a local checkout or venv:

git clone https://github.com/jpmorard/tokki.git
cd tokki
python3 -m pip install .
tokki --version

This private source-install path builds protected-rust during wheel creation when dist-protected/tokki is missing. It is for the private repository only; do not mirror it into tokki-public or the public installers unless explicitly doing public installer/docs work.

Tokki deployment flow

After install, the non-destructive first-run check is:

tokki proof
tokki smoke
tokki privacy explain

To install available wrappers and run the same trust/adoption proof in one flow:

tokki setup --guided

macOS

Apple Silicon wheel:

python3 -m pip install --user --upgrade --force-reinstall \
  wheelhouse/tokki-1.0.0/tokki-1.0.0-py3-none-macosx_11_0_arm64.whl
export PATH="$HOME/Library/Python/3.*/bin:$HOME/.local/bin:$PATH"
tokki --version

Optional isolated install with uv:

uv tool install --force \
  wheelhouse/tokki-1.0.0/tokki-1.0.0-py3-none-macosx_11_0_arm64.whl
tokki --version

Install wrappers after the wheel is installed:

tokki setup --guided

Uninstall:

python3 -m pip uninstall -y tokki
uv tool uninstall tokki 2>/dev/null || true

Linux

x86_64 wheel:

python3 -m pip install --user --upgrade --force-reinstall \
  wheelhouse/tokki-1.0.0/tokki-1.0.0-py3-none-manylinux_2_35_x86_64.whl
export PATH="$HOME/.local/bin:$PATH"
tokki --version

Optional isolated install with pipx:

python3 -m pipx install --force \
  wheelhouse/tokki-1.0.0/tokki-1.0.0-py3-none-manylinux_2_35_x86_64.whl
tokki --version

Install wrappers after the wheel is installed:

tokki setup --guided

Uninstall:

python3 -m pip uninstall -y tokki
python3 -m pipx uninstall tokki 2>/dev/null || true

Agent Wrappers On POSIX

After install, run tokki setup to install wrappers and check the health of the local wrapper path. For codex, the health report also compares the installed CLI version against the latest published @openai/codex version when both can be parsed as real semver tokens; otherwise the version stays unknown and Tokki does not claim an upgrade.

Tokki does not silently replace one agent command with another by default, and it does not auto-use a standalone local LLM just because ollama or another CLI is installed. Cross-agent low-tier handoff, for example launching Codex or a local backend from a simple Claude one-shot prompt, is opt-in. The installer can write a small install.env config that sets TOKKI_MODEL_LOW_AGENT, TOKKI_MODEL_ALLOW_CROSS_AGENT_HANDOFF, and optionally TOKKI_MODEL_LOW_HANDOFF_MODEL; env vars still override that file. Set the agent to codex to route to the latest GPT mini model, claude to stay on Claude with the canonical low-model preset claude-3-5-haiku-latest, or ollama with an explicit model name. Set the agent to local with TOKKI_MODEL_LOW_HANDOFF_COMMAND and optional TOKKI_MODEL_LOW_HANDOFF_ARGS to use another local model CLI instead of Ollama. The local backend is considered only when TOKKI_MODEL_LOW_AGENT=ollama or TOKKI_MODEL_LOW_AGENT=local, TOKKI_MODEL_ALLOW_CROSS_AGENT_HANDOFF=1, model routing selects the low tier, and the wrapped Claude command is a simple one-shot prompt; interactive sessions and unsupported flag combinations stay on Claude. Claude handoff model aliases are allowlisted; stale or invalid aliases fall back to claude-3-5-haiku-latest and are recorded as metadata-only invalid config events.

Tokki also honors TOKKI_TOKEN_SAVING_MODE=aggressive, TOKKI_TOKEN_SAVING_MODE=ultimate, or TOKKI_TOKEN_SAVING_MODE=emergency. Weekly-hours quota signals can escalate the mode automatically: 25% remaining switches to aggressive, 10% to ultimate, and 5% to emergency. The lower modes reduce the compact-response budget, compact-trigger threshold, and native output budgets more aggressively than the default mode. When output overflows, Tokki emits a terse local handle receipt and keeps the full payload recoverable with tokki retrieve <handle>.

Windows

x86_64 PowerShell wheel:

py -m pip install --user --upgrade --force-reinstall `
  wheelhouse\tokki-1.0.0\tokki-1.0.0-py3-none-win_amd64.whl
tokki --version

Optional isolated install with pipx:

py -m pip install --user pipx
py -m pipx ensurepath
pipx install --force `
  wheelhouse\tokki-1.0.0\tokki-1.0.0-py3-none-win_amd64.whl
tokki --version

Install wrappers after the wheel is installed:

tokki setup --guided

Uninstall:

py -m pip uninstall -y tokki
pipx uninstall tokki

Windows notes:

  • The core CLI (tokki run, fix, map, query, model-route, ...) works natively in PowerShell and cmd.
  • The installer and tokki setup install native .exe agent wrappers in the same PATH directory as tokki.exe when supported agent commands are present. Use -NoWrappers or TOKKI_NO_WRAPPERS=1 for a core-CLI-only install. POSIX shell shims remain the Unix/WSL path.
  • Tokki stores its runtime config under %APPDATA%\tokki\runtime.json and logs/reports under %LOCALAPPDATA%\tokki\. Set TOKKI_RUNTIME_CONFIG, TOKKI_LOG_DIR, or TOKKI_REPORT_DIR to override.

Public Package

Current public package: tokki 1.0.0.

1.0.0 provides private wheelhouse artifacts for:

  • macOS arm64: tokki-1.0.0-py3-none-macosx_11_0_arm64.whl
  • Linux x86_64: tokki-1.0.0-py3-none-manylinux_2_35_x86_64.whl
  • Windows x86_64: tokki-1.0.0-py3-none-win_amd64.whl

The wheel intentionally does not include private implementation source, repository-local tests, protected Rust source, or private development scripts.

Support

Use GitHub issues for installation problems and public package metadata issues. For failure reports, prefer tokki issue report so Tokki can send a bounded, privacy-filtered digest with the issue. Use tokki issue fix to read a tokki-auto issue back into a local fix bundle. Do not post secrets, prompts, command output, private repository contents, or customer material in public issues. The tokki-auto label should stay restricted to trusted triage users so untrusted reporters cannot publish into the fix queue.

For a local trust summary before filing anything public, run tokki privacy explain. It describes what Tokki stores locally, what public reports omit, and which audit commands to run before sharing artifacts.

For installation or wrapper issues, run tokki install doctor first. Use tokki path doctor / tokki path repair for PATH drift, tokki installer-parity and tokki installer-matrix to compare POSIX, Windows, uv, pipx, and user-site installer contracts across the private/public surfaces, and tokki conformance for the composed local suite. tokki release evidence --output tokki-evidence.json and tokki release evidence verify --manifest tokki-evidence.json write and verify metadata-only release provenance. tokki support-bundle --output tokki-support.json writes a metadata-only diagnostic bundle for support.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

tokki-1.0.0-py3-none-win_amd64.whl (7.5 MB view details)

Uploaded Python 3Windows x86-64

tokki-1.0.0-py3-none-manylinux_2_35_x86_64.whl (7.1 MB view details)

Uploaded Python 3manylinux: glibc 2.35+ x86-64

tokki-1.0.0-py3-none-macosx_11_0_arm64.whl (6.8 MB view details)

Uploaded Python 3macOS 11.0+ ARM64

File details

Details for the file tokki-1.0.0-py3-none-win_amd64.whl.

File metadata

  • Download URL: tokki-1.0.0-py3-none-win_amd64.whl
  • Upload date:
  • Size: 7.5 MB
  • Tags: Python 3, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.13

File hashes

Hashes for tokki-1.0.0-py3-none-win_amd64.whl
Algorithm Hash digest
SHA256 83631792c11001a54b1179a844d08b2da65ca109610aed6e3429323c9adb928c
MD5 b9f8a9d1eb6117971317634c61ab3ec4
BLAKE2b-256 5b180579efaa6b9eefe0bd30c9f2e8bc2eb0a3758d3d465bf0fb244f3916e4a8

See more details on using hashes here.

File details

Details for the file tokki-1.0.0-py3-none-manylinux_2_35_x86_64.whl.

File metadata

File hashes

Hashes for tokki-1.0.0-py3-none-manylinux_2_35_x86_64.whl
Algorithm Hash digest
SHA256 36aca225c6b9b4a4c313973498dc48ca89e8a84f19142432e4082d9c2cadd54b
MD5 bc1a5b040592a64d61ff996dcb24eb04
BLAKE2b-256 88f8026d95999a7e76b5c09ac9fc922ef3066a8987c681885381dcf96ba1f3a7

See more details on using hashes here.

File details

Details for the file tokki-1.0.0-py3-none-macosx_11_0_arm64.whl.

File metadata

  • Download URL: tokki-1.0.0-py3-none-macosx_11_0_arm64.whl
  • Upload date:
  • Size: 6.8 MB
  • Tags: Python 3, macOS 11.0+ ARM64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.13

File hashes

Hashes for tokki-1.0.0-py3-none-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 4a626682d4b3cd774488dbbf7c84d977a6ff6c1254b6faeb4b36983090faf1d2
MD5 362cfc6c13bd2ebe87ea906cf9273c22
BLAKE2b-256 34fe43c6cacd885a4fae5653a7b3701d17288fb7b89f9c766a54eb4a75284b4e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page