Skip to main content

See how you really use AI — X-ray your AI coding sessions locally

Project description

ctxray

See how you really use AI.

X-ray your AI coding sessions across Claude Code, Cursor, ChatGPT, and 6 more tools. Discover your patterns, find wasted tokens, catch leaked secrets — all locally, nothing leaves your machine.

PyPI version Python 3.10+ License: MIT Tests Coverage

Quick start

pip install ctxray

ctxray scan                    # discover prompts from your AI tools
ctxray wrapped                 # your AI coding persona + shareable card
ctxray insights                # your patterns vs research-optimal
ctxray privacy                 # what sensitive data you've exposed

ctxray demo

What you'll discover

Your AI coding persona

ctxray wrapped generates a Spotify Wrapped-style report of your AI interactions — your persona (Debugger? Architect? Explorer?), top patterns, and a shareable card.

Your prompt patterns

ctxray insights compares your actual prompting habits against research-backed benchmarks. Are your prompts specific enough? Do you front-load instructions? How much context do you provide?

Your privacy exposure

ctxray privacy --deep scans every prompt you've sent for API keys, tokens, passwords, and PII. See exactly what you've shared with which AI tool.

Full prompt diagnostic

ctxray check "your prompt" scores, lints, and rewrites in one command — no LLM, <50ms.

ctxray check — good prompt
More screenshots

ctxray rewrite — rule-based prompt improvement

ctxray rewrite — before/after

ctxray build — assemble prompts from components

ctxray build — structured prompt assembly

What a bad prompt looks like

ctxray check — weak prompt

All commands

Discover your patterns

Command Description
ctxray wrapped AI coding persona + shareable card
ctxray insights Personal patterns vs research-optimal benchmarks
ctxray sessions Session quality scores with frustration signal detection
ctxray agent Agent workflow analysis — error loops, tool patterns, efficiency
ctxray repetition Cross-session repetition detection — spot recurring prompts
ctxray patterns Personal prompt weaknesses — recurring gaps by task type
ctxray distill Extract important turns from conversations with 6-signal scoring
ctxray projects Per-project quality breakdown
ctxray style Prompting fingerprint with --trends for evolution tracking
ctxray privacy See what data you sent where — file paths, errors, PII exposure

Optimize your prompts

Command Description
ctxray check "prompt" Full diagnostic — score + lint + rewrite in one command
ctxray score "prompt" Research-backed 0-100 scoring with 30+ features
ctxray rewrite "prompt" Rule-based improvement — filler removal, restructuring, hedging cleanup
ctxray build "task" Build prompts from components — task, context, files, errors, constraints
ctxray compress "prompt" 4-layer prompt compression (40-60% token savings typical)
ctxray compare "a" "b" Side-by-side prompt analysis (or --best-worst for auto-selection)
ctxray lint Configurable linter with CI/GitHub Action support

Manage

Command Description
ctxray Instant dashboard — prompts, sessions, avg score, top categories
ctxray scan Auto-discover prompts from 9 AI tools
ctxray report Full analytics: hot phrases, clusters, patterns (--html for dashboard)
ctxray digest Weekly summary comparing current vs previous period
ctxray template save|list|use Save and reuse your best prompts
ctxray distill --export Recover context when a session runs out — paste into new session
ctxray init Generate .ctxray.toml config for your project

Supported AI tools

Tool Format Auto-discovered by scan
Claude Code JSONL Yes
Codex CLI JSONL Yes
Cursor .vscdb Yes
Aider Markdown Yes
Gemini CLI JSON Yes
Cline (VS Code) JSON Yes
OpenClaw / OpenCode JSON Yes
ChatGPT JSON Via ctxray import
Claude.ai JSON/ZIP Via ctxray import

Installation

pip install ctxray              # core (all features, zero config)
pip install ctxray[chinese]     # + Chinese prompt analysis (jieba)
pip install ctxray[mcp]         # + MCP server for Claude Code / Continue.dev / Zed

Auto-scan after every session

ctxray install-hook             # adds post-session hook to Claude Code

Browser extension

Capture prompts from ChatGPT, Claude.ai, and Gemini directly in your browser. Live quality badge shows prompt tier as you type — click "Rewrite & Apply" to improve and replace the text directly in the input box.

  1. Install the extension from Chrome Web Store or Firefox Add-ons
  2. Connect to the CLI: ctxray install-extension
  3. Verify: ctxray extension-status

Captured prompts sync locally via Native Messaging — nothing leaves your machine.

CI integration

GitHub Action

# .github/workflows/prompt-lint.yml
name: Prompt Quality
on: pull_request

jobs:
  lint:
    runs-on: ubuntu-latest
    permissions:
      pull-requests: write
    steps:
      - uses: actions/checkout@v4
      - uses: ctxray/ctxray@main
        with:
          score-threshold: 50
          strict: true
          comment-on-pr: true

pre-commit

# .pre-commit-config.yaml
repos:
  - repo: https://github.com/ctxray/ctxray
    rev: v3.0.0
    hooks:
      - id: ctxray-lint

Direct CLI

ctxray lint --score-threshold 50  # exit 1 if avg score < 50
ctxray lint --strict              # exit 1 on warnings
ctxray lint --json                # machine-readable output

Project configuration

ctxray init   # generates .ctxray.toml with all rules documented
# .ctxray.toml (or [tool.ctxray.lint] in pyproject.toml)
[lint]
score-threshold = 50

[lint.rules]
min-length = 20
short-prompt = 40
vague-prompt = true
debug-needs-reference = true
Prompt Science — research foundation

Prompt Science

Scoring is calibrated against 10 peer-reviewed papers covering 30+ features across 5 dimensions:

Dimension What it measures Key papers
Structure Markdown, code blocks, explicit constraints Prompt Report (2406.06608)
Context File paths, error messages, I/O specs, edge cases Zi+ (2508.03678), Google (2512.14982)
Position Instruction placement relative to context Stanford (2307.03172), Veseli+ (2508.07479), Chowdhury (2603.10123)
Repetition Redundancy that degrades model attention Google (2512.14982)
Clarity Readability, sentence length, ambiguity SPELL (EMNLP 2023), PEEM (2603.10477)

Cross-validated findings that inform our engine:

  • Position bias is architectural — present at initialization, not learned. Front-loading instructions is effective for prompts under 50% of context window (3 papers agree)
  • Moderate compression improves output — rule-based filler removal doesn't just save tokens, it enhances LLM performance (2505.00019)
  • Prompt quality is independently measurable — prompt-only scoring predicts output quality without seeing the response (ACL 2025, 2503.10084)

All analysis runs locally in <1ms per prompt. No LLM calls, no network requests.

How it works — architecture

How it works

 Data sources:
 ┌──────────┐ ┌──────────┐ ┌──────────┐ ┌──────────┐ ┌──────────┐
 │Claude Code│ │  Cursor  │ │  Aider   │ │ ChatGPT  │ │ 5 more.. │
 └─────┬────┘ └─────┬────┘ └─────┬────┘ └─────┬────┘ └─────┬────┘
       └─────────────┴───────────┴─────────────┴─────────────┘
                                 │
                    scan -> dedup -> store -> analyze
                                 │
              ┌──────────────────┼──────────────────┐
              v                  v                  v
        ┌──────────┐     ┌──────────────┐    ┌──────────┐
        │ insights │     │  patterns    │    │ sessions │
        │ wrapped  │     │  repetition  │    │ projects │
        │ style    │     │  privacy     │    │ agent    │
        └──────────┘     └──────────────┘    └──────────┘

Key design decisions:

  • Pure rules, no LLM — scoring and rewriting use regex + TF-IDF + research heuristics. Deterministic, private, <1ms per prompt.
  • Adapter pattern — each AI tool gets a parser that normalizes to a common Prompt model. Adding a new tool = one file.
  • Two-layer dedup — SHA-256 for exact matches, TF-IDF cosine similarity for near-dupes.
  • Research-calibrated — 10 peer-reviewed papers inform the scoring weights.
Conversation Distillation

Conversation Distillation

ctxray distill scores every turn in a conversation using 6 signals:

  • Position — first/last turns carry framing and conclusions
  • Length — substantial turns contain more information
  • Tool trigger — turns that cause tool calls are action-driving
  • Error recovery — turns that follow errors show problem-solving
  • Semantic shift — topic changes mark conversation boundaries
  • Uniqueness — novel phrasing vs repetitive follow-ups

Session type (debugging, feature-dev, exploration, refactoring) is auto-detected and signal weights adapt accordingly.

Why ctxray?

After Promptfoo joined OpenAI and Humanloop joined Anthropic, ctxray is the independent, open-source alternative for understanding your AI interactions.

  • 100% local — your prompts never leave your machine
  • No LLM required — pure rule-based analysis, <50ms per prompt
  • 9 AI tools — the only tool that works across Claude Code, Cursor, ChatGPT, and more
  • Research-backed — calibrated against 10 peer-reviewed papers, not vibes

Previously published as reprompt-cli. Same tool, new name, clean namespace.

Privacy

  • All analysis runs locally. No prompts leave your machine.
  • ctxray privacy shows exactly what you've sent to which AI tool.
  • Optional telemetry sends only anonymous feature vectors — never prompt text.
  • Open source: audit exactly what's collected.

Links

Contributing

See CONTRIBUTING.md for development setup and guidelines.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ctxray-3.0.0.tar.gz (2.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ctxray-3.0.0-py3-none-any.whl (297.9 kB view details)

Uploaded Python 3

File details

Details for the file ctxray-3.0.0.tar.gz.

File metadata

  • Download URL: ctxray-3.0.0.tar.gz
  • Upload date:
  • Size: 2.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for ctxray-3.0.0.tar.gz
Algorithm Hash digest
SHA256 0a4ea9fa5a9963055cad559dc012a272459cd2ec01d561495e52939cf31ce6c6
MD5 50105fea224365c0d3dab02761f91017
BLAKE2b-256 3dcb79b01046276c0bb91b585af0bb6a38c3ed0f2f18277c745084f34c5c2157

See more details on using hashes here.

File details

Details for the file ctxray-3.0.0-py3-none-any.whl.

File metadata

  • Download URL: ctxray-3.0.0-py3-none-any.whl
  • Upload date:
  • Size: 297.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for ctxray-3.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 99d2f7a2f0889c938a1f628ec23bffbd6a7ca71b20eefd8d45d182f9f82fe4db
MD5 24918483dc371cc72af0b3507cf784d6
BLAKE2b-256 842b8a3df72403d241dd9a2eec97a04f6269786db93e1b86179a9cf8b0610a25

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page