ACTUALIS
What actually ran.
actualis.app · Latest release · Changelog · Security policy · Trade marks
Local. Read-only. Honest about limits.
Actualis reads existing coding-agent logs and turns them into clear answers about exposure, activity, and cost.
Measure, don't interfere. · Read what's already there. Tell the truth, including limits. · Evidence over opinion.
Terminal-native coding agents write a complete record of every session to your disk: token usage per turn, every tool call, every shell command. What they don't give you is a view across all of it. If you run agents in more than one project, or more than one agent, you cannot currently answer:
- What did my agents cost last month?
- Which project is burning the budget?
- What did issue #412 cost?
- What shell commands have my agents actually been running?
- Did a credential ever end up in a command?
actualis answers all five from data already on your machine,
across Claude Code and Codex, in one report.
Illustrative output from a synthetic fleet — every project, branch and
credential above is invented. Regenerate with tools/make-demo-fleet.py.
$ actualis
FLEET ──────────────────────────────────────────────────────────────
window 2026-05-04 → 2026-06-04 (31 days)
transcripts 168 files, 0.4 GB
messages 38,204
cost $12,480.55 notional, at API list price
per active day $402.60 · per week $2,818.20 · 31 active days of 31
BY PROJECT ─────────────────────────────────────────────────────────
$10,159.17 81.4% ███████████████████████████ web-app
$1,385.34 11.1% ███ api-service
$87.36 0.7% data-pipeline
▲ 81% of all spend is one project: web-app
SHELL AUDIT ────────────────────────────────────────────────────────
bash calls 13,006 73% of all agent tool calls
permission auto=7,140 default=402 acceptEdits=377 plan=14
denied automode-blocked=58 user-rejected=31
▲ 1,315 commands contained credential material
flagged 340 high 148 medium of 13,006 commands
Install
No dependencies beyond Python 3.9+. Either run the file directly:
python3 actualis.py
Or install it as a command:
uv tool install . # or: pipx install .
actualis
uv tool install copies the code, so re-run it with --force after pulling to
pick up changes.
Usage
python3 actualis.py # full report
python3 actualis.py --days 30 # last 30 days
python3 actualis.py --bash # shell audit only
python3 actualis.py --coach # findings and recommended actions only
python3 actualis.py --watch # live alerting on new secrets
python3 actualis.py --project svc # filter to matching projects
python3 actualis.py --json # machine-readable
python3 actualis.py --top 25 # show more projects
python3 actualis.py --agent codex # one agent only (claude | codex | all)
All options
| flag | effect |
|---|---|
--days N |
only the last N days |
--project SUBSTR |
only projects whose name contains SUBSTR |
--top N |
how many projects and tickets to list (default 12) |
--agent {all,claude,codex} |
which agents to include (default all) |
--root DIR |
read one specific transcript directory instead of discovering them |
--bash |
shell audit only |
--coach |
findings and actions only |
--share |
postable summary with nothing identifying in it |
--json |
machine-readable (schema) |
--watch |
live monitor; alert on new secrets and risky commands |
--interval SEC |
--watch poll interval, default 4 |
--quiet |
--watch: notify on secrets only, not every flagged command |
--no-redact |
do not redact credentials from output; unsafe to share |
--explain [TOPIC] |
how a number is computed, what it assumes, how to check it |
--why AFxxx |
explain one finding against your actual numbers |
--agents |
installed agent platforms and whether their binaries are validly signed |
--mcp |
run as an MCP server over stdio (below) |
--version |
print version |
What the report contains
FLEET totals and sources · TOKENS broken out by cache bucket with the
multiplier applied to each · BY AGENT · BY MODEL · CACHE EFFICIENCY ·
BY TICKET · TOOL CALLS · SUBAGENTS · SHELL AUDIT · COACH.
Documentation
| docs/findings.md | every coach finding AF001–AF011: what it means, when it fires, what to do |
| docs/secrets.md | which credential types are detected, and what is deliberately not flagged |
| docs/json.md | --json schema |
| CONTRIBUTING.md | ground rules, and the CLA note that keeps dual licensing possible |
| SECURITY.md | what counts as a vulnerability, and how to report one |
| CHANGELOG.md | what changed |
Cost per ticket
Branch names almost always carry the issue number, so the same data that answers "what did this project cost" also answers "what did issue #412 cost" — the unit engineering and finance already budget in.
BY TICKET (top 5 of 58)
cost ticket msgs days where
$1,884.10 #412 3,110 5 feat/412-checkout-v2, feat/412-checkout-api +1
$1,102.40 #310 1,240 2 fix/310-session-timeout
$980.25 #907 1,206 2 feat/907-export-queue
$8,140.20 across 58 tickets (12 spanning several branches) · $3,890.15 on trunk
One ticket often spans several branches, so grouping by ticket rather than branch
is the point. feat/412-p4-…, p5-… and p6-… are one number. Work on trunk or
in a detached HEAD is reported separately rather than guessed at.
Recognised: feat/412-slug, fix/310-slug, PROJ-456, feature/PROJ-456,
issue-742, gh_91, 412-slug. Anything else is left unattributed rather than
invented.
The coach
The report says what happened; --coach says what to do about it. Findings carry
stable ids (AF001–AF010) so they can be quoted and documented, and each one
carries evidence, an action, and an impact estimate where one can be computed
honestly.
Benchmarks are computed against you, not against other users. Project versus project, week versus week, ticket versus your median ticket. That needs no telemetry, no account, and no population — it works on day one with one user, and it keeps the no-network promise intact.
Findings are earned. On a fleet with nothing notable, the coach prints nothing.
Full reference: docs/findings.md.
Cache efficiency
CACHE EFFICIENCY
fleet hit rate 98.1% of input context served from cache
saved $71,905.40 versus sending the same context uncached
hit rate context saved project
97.4% 14,220,551,900 $58,110.20 web-app
96.9% 2,140,882,003 $8,795.15 api-service
96.1% 412,660,004 $1,102.30 data-pipeline
No project is more than 15 points below your median of 96.1%.
Hit rate is cache_read / (input + cache_write + cache_read) — the share of
input context served from cache. Output tokens are excluded because they are
not cacheable, and including them makes a chatty project look broken when its
caching is fine.
Savings are measured against the counterfactual of sending the same context uncached, priced per model at the message level. Note that a project doing mostly cache writes can show negative savings, since a 1-hour write costs 2.00x. That is reported rather than clamped to zero.
A project more than 15 points below your own median is flagged (AF002) as
likely having something unstable early in its prompt prefix. Projects below the
reporting threshold are excluded from both the table and the coach, so the two
never disagree.
Subagents
Subagent runs are reported separately: how many, which models, how much shell and edit activity, wall-clock, and lines changed.
SUBAGENTS
214 runs · 18.4 hours wall-clock · 38,910 lines added, 6,204 removed
151 claude-sonnet-5
34 claude-haiku-4-5
22 claude-opus-4-8[1m]
tool activity bash 3,402 · read 1,188 · edit 820
cost floor $16.44 — a LOWER BOUND, excluded from the headline figure
Their cost is a floor, not a total, and it is kept out of the headline number.
The parent transcript records only each run's final message: totalTokens equals
the sum of that single usage object in 873 of 873 observed cases, and scales
about 2x from a 4-tool run to a 45-tool run, which is context growth rather than
summation. The cumulative spend of a subagent's turns is not recoverable, so it is
not estimated.
The bigger finding is what the audit cannot see. 3,402 shell commands ran inside subagents — 21% of all shell activity — and their command text is never written to the parent transcript. Subagents inherit the parent's permissions but not its visibility. The shell audit says so explicitly rather than reporting a number that looks complete.
Sharing a summary
--share prints a postable summary containing nothing that identifies you: no
project names, branches, ticket ids, paths, commands, or fingerprints. Only
totals, rates, distributions, and generic finding titles.
actualis · what my coding agents cost and did
31 active days 2 agent(s) 38,204 messages 17,540,882,110 tokens
$12,480.55 at API list price · $402.60/active day
98.1% of input context from cache, saving $71,905.40 against sending it uncached
81% of spend in a single project
$41.20 median cost per ticket, over 58 tickets
13,006 shell commands 73% of all tool calls
92% of turns ran unsupervised
21% of shell activity happened inside subagents, where commands are not recorded
19 distinct credentials found in command history 6 critical, 18 worth rotating
coach AF004 AF003 AF005 AF011 AF001 AF007 AF008 AF009
The test suite plants identifying strings — a project name, a branch, a path, a live-shaped key, an internal hostname — and asserts that none of them can reach this output. Secret fingerprints are excluded too, since a hash is still an identifier that could be correlated.
Nothing is a black box
Every figure is answerable: where it came from, how it was computed, what it assumes, and how to check it without trusting this tool.
actualis --explain # list the topics
actualis --explain cost # the formula, the assumptions, an independent check
actualis --why AF005 # why one finding fired, with your actual numbers
Topics: sources, cost, cache, tickets, secrets, subagents, shell,
coach, agents.
Each explanation carries the same four parts, deliberately: what it measures, the exact formula, what it assumes, and a command that checks the answer some other way. If a number cannot be interrogated, it should not be acted on.
Are your agents what they claim to be?
This tool reads what agents did. The obvious next question is whether the agent
itself is genuine — a modified claude binary could do anything and still write
a plausible transcript.
$ actualis --agents
OK Claude Code claude
Developer ID Application: Anthropic PBC (Q6L2SF6YDW)
signature valid, team Q6L2SF6YDW as expected
OK Codex codex
Developer ID Application: OpenAI OpCo, LLC (2DC432GLL2)
signature valid, team 2DC432GLL2 as expected
- GitHub Copilot CLI copilot
no code signature (expected for npm and script installs)
| status | meaning |
|---|---|
OK |
validly signed by the publisher expected for that tool |
WARN |
validly signed, but not by the expected publisher |
FAIL |
signature present and invalid — the binary was modified |
- |
unsigned; normal for npm and script installs |
? |
signed by an unpinned publisher, or unassessable on this platform |
Team IDs are pinned per tool, so a valid signature from the wrong publisher is visible rather than silently accepted.
What a valid signature proves: the binary came from that publisher and has
not been altered since signing. Tested by flipping one byte in a 325 MB signed
binary; it reports FAIL. What it does not prove: that the software is safe,
or that the publisher deserves trust. Unsigned is not malicious — script
based tools are never code-signed.
macOS only. Other platforms report unassessed rather than pretending.
Ask the agent about itself
--mcp runs an MCP server over stdio, so the agent producing the data can query
it mid-session: "what did this ticket cost?", "do I have credentials
exposed?"
claude mcp add actualis -- actualis --mcp
Five tools: fleet_summary, ticket_cost, exposed_secrets, coach_findings,
shell_audit.
No port, no daemon, no network — stdio only, and the same read-only local scan as everything else. Implemented against the standard library rather than the MCP SDK, because a tool whose pitch is "one auditable file, no supply chain" cannot take a dependency to speak line-delimited JSON.
Everything it returns is written back into a transcript that this tool then scans, so the surface is deliberately narrow: aggregates, types, fingerprints and counts. Never a secret value, and never raw command text.
The scan is cached for the life of the process, since a large fleet takes about a minute to read.
Privacy
Nothing leaves your machine. No network calls, no telemetry, no analytics, no
config file, no writes. It opens files under ~/.claude/projects read-only and
prints to stdout. The whole program is one readable file; if you're about to point
a tool at your session history, you should be able to audit it in a sitting, so it
was written to be read.
Every transcript directory it scanned is printed in the report header. It checks
~/.claude/projects and $CLAUDE_CONFIG_DIR/projects, because a machine can
have both, and a fleet report that silently covers half your fleet is worse than
no report.
About the cost number
Costs are Anthropic API list prices, verified 2026-08-22, including the cache multipliers that dominate agent workloads:
| multiplier on input rate | |
|---|---|
| cache read | 0.10× |
| cache write, 5m TTL | 1.25× |
| cache write, 1h TTL | 2.00× |
This matters more than it sounds. On a typical agent workload 97% of all tokens are cache reads, so any tool that prices them at the input rate will overstate your spend by roughly an order of magnitude.
If you're on a Pro or Max subscription, this is not a bill. Your actual outlay is the flat subscription fee. Read the total as what this would have cost at API list price: an opportunity-cost figure, a consumption signal, and a way to see which project is eating your quota. Models with no published rate are priced at the top of the known range for their provider, and that share is reported as its own number so you can subtract it rather than having to trust it.
One message is counted once. A transcript repeats the same assistant record while a response streams — identical message id, identical usage block, a fresh record uuid each time — so the number of records is not the number of messages. Versions before 0.1.1 billed every record. On a real corpus of 145,116 usage records, 50.9% were repeats and the total came out 2.13× too high: $46,997 reported against $22,064 actual. The report prints how many repeats it collapsed, so you can see the deduplication working rather than take it on faith. If you have a figure from 0.1.0, re-run it.
The shell audit
72% of what a coding agent does is run shell commands. That is the largest surface
by far, and it's the one thing an MCP gateway structurally cannot see, because a
gateway sits between the agent and MCP servers and never observes a local Bash
call.
The audit is deterministic. Plain pattern matching, no model in the loop, no
scoring that drifts between runs. A command either matches a rule or it doesn't,
and you can read every rule in the source. Categories: destructive, privilege,
remote-exec, credentials, egress, git, publish, database, audit.
A flag means "worth looking at", not "wrong". Most rm -rf calls are a build
directory. The point is that you can see them at all.
The rules were tuned against 48,000 real agent commands, and tuning meant deleting
rules as much as adding them. A rule matching >/dev/null 2>&1 as "audit
tampering" fired 1,206 times at essentially 100% false positive, so it's gone; a
noisy rule destroys trust in the rules that matter. Current flag rate is about 3.8%.
Redaction
Credentials are redacted from all output by default, including --json.
Agent transcripts contain live secrets. This is not hypothetical: the first real
run of this tool surfaced a live deployment token sitting in plaintext in a saved
session. Since the output of a reporting tool gets pasted into issues, dropped into
chat, and screenshotted, redaction is the default and --no-redact is an explicit
opt-out that prints a warning.
Full list of what is and is not detected: docs/secrets.md.
Redaction covers KEY=value for secret-shaped names, ~25 known token prefixes
(ghp_, sk-ant-, AKIA, vcp_, glpat-, …), Authorization: headers, and
passwords in connection URLs. Shell variable references like $VERCEL_TOKEN are
left readable, because the reference isn't the secret and masking it only makes the
output harder to read. Redaction is idempotent.
If the report tells you commands contained credential material, those secrets are sitting in plaintext in your transcripts. Rotate anything live.
Which agents, and why not the others
| Agent | Supported | Why |
|---|---|---|
| Claude Code | yes | ~/.claude/projects/**/*.jsonl |
| Codex | yes | $CODEX_HOME/sessions/**/rollout-*.jsonl |
| Cursor | no | Nothing to read. All composerData records are empty shells: conversationMap {}, usageData {}. The ai_code_hashes and conversation_summaries tables have zero rows. Content is server-side. |
| Windsurf | no | globalStorage holds config and auth only. No conversation or usage store. Server-side. |
| Cline, Aider | not yet | Both write local files. Untested, likely feasible. |
The pattern is clean: terminal-native agents write local rollouts, IDE forks are thin clients that keep everything server-side. Supporting Cursor or Windsurf would mean network calls and OAuth against their APIs, which would cost this tool the three properties it's built on — no network, read-only, auditable in one sitting. That trade isn't worth making, so the scope is stated honestly instead: every agent with a shell on your machine.
Two provider quirks the cost code has to get right, because both silently overcharge if handled like the other:
- Anthropic reports
input_tokensexcluding cache, with cache reads and writes as separate buckets. - OpenAI reports
input_tokensincludingcached_input_tokens, andreasoning_output_tokensas a subset ofoutput_tokens. Neither is an addition. - Codex's
total_token_usageis cumulative across a session and itstoken_countevents repeat, so the session total is the final value, never a sum.
Limitations
- Reporting only. It observes; it does not enforce. Claude Code's own permission rules, sandboxing, and hooks are where enforcement belongs.
- Pattern matching has a ceiling. A command that builds a string dynamically, or runs a script whose contents live in a file, will not be caught. This raises the floor on visibility; it is not a security boundary.
- Prices are hardcoded and dated in the source. They will drift. OpenAI rates come from a third-party aggregator rather than OpenAI's own page.
- Deduplication is by message id. A record with no id cannot be keyed and is always counted, so a transcript format that stops emitting ids would silently return to over-counting. A repeat count of zero on a large scan is the signal that this has happened.
- Rates use active days, not calendar span, so one stale session from months ago doesn't silently divide your weekly burn rate by five.
- Cache TTL inference. Older transcripts only record a flat cache-creation total, which is assumed to be 5-minute TTL and may under-price slightly.
Verification
The cost pipeline is cross-checked against an independent jq implementation over
the same transcripts. Do the same before trusting any number here that matters to
you.
That cross-check once agreed with a number that was twice too high, and the
reason is worth stating plainly: the jq implementation summed usage across every
record, which is exactly the mistake the Python was making. Two implementations
sharing an assumption agree with each other and are both wrong. An independent
check is only independent where the assumptions differ, so a useful one here has
to deduplicate on message.id — which the tool now does, and reports:
# what the tool says
actualis --json | jq '.cost_usd, .duplicate_usage_records_skipped'
# count distinct messages yourself, independently of this tool
cat ~/.claude/projects/*/*.jsonl \
| jq -r 'select(.message.usage) | .message.id' | sort -u | wc -l
Tray app
cd tray-go && go build -ldflags "-s -w" -o actualis-tray . && ./actualis-tray
A constant gauge mark with a status dot in the corner — the pattern Docker, 1Password and Teams use, so the app stays recognisable and only the badge changes. Green check when clean, amber when there is something to rotate, red when it is critical. A newly exposed credential also raises a native notification and flashes the badge.
macOS, Linux and Windows from one Go codebase, ~2 MB, no Electron and no
webview. It is a thin shell over --json; all measurement stays in the CLI.
See tray-go/README.md.
Running it in the background (macOS)
--watch tails the transcripts and raises a native notification when an agent
runs a command carrying a new credential. To keep it running without a terminal,
install the LaunchAgent:
mkdir -p ~/Library/LaunchAgents
sed "s|__ACTUALIS__|$(command -v actualis)|; s|__HOME__|$HOME|" \
packaging/app.actualis.watch.plist \
> ~/Library/LaunchAgents/app.actualis.watch.plist
launchctl bootstrap gui/$(id -u) \
~/Library/LaunchAgents/app.actualis.watch.plist
Check it, read it, stop it:
launchctl print gui/$(id -u)/app.actualis.watch | head -20
tail -f ~/Library/Logs/actualis-watch.log
launchctl bootout gui/$(id -u)/app.actualis.watch
It is a LaunchAgent rather than a LaunchDaemon on purpose: it must run inside your logged-in session for notifications to post at all, and it should hold exactly your permissions and no more. Only events are logged — the heartbeat is suppressed when stdout is not a terminal — so the log stays small.
If notifications do not appear, allow them for Script Editor in
System Settings → Notifications. osascript posts under that identity.
License
AGPL-3.0-or-later. Copyright (C) 2026 Digital Foundry Solutions, LLC.
Running this tool places no obligation on you. Use it privately, inside a company, on client work, however you like. Running is not distributing, and the copyleft never touches your code, your projects, or your data — none of which this tool transmits anywhere in the first place.
Two situations do carry an obligation, and both are deliberate:
- Distributing a modified version means shipping its source under the same licence.
- Running a modified version as a network service means offering that source to its users (AGPL section 13). This is the clause GPL-3.0 lacks, and the reason for choosing AGPL: the plausible future product here is a multi-machine server, and AGPL is what stops someone taking this, closing it, and hosting it.
Copyright is held by a single entity, so a commercial licence for anyone who cannot accept those terms remains available without a contributor agreement.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file actualis-0.1.2.tar.gz.
File metadata
- Download URL: actualis-0.1.2.tar.gz
- Upload date:
- Size: 81.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
887c278faecd05c157f143c5be8115250098b4189fae54dab14708434be585cd
|
|
| MD5 |
37668dbc634559f4f964ea7e8629fc1c
|
|
| BLAKE2b-256 |
409a973f25bd5d91cea40fa1e44a11c644bb442ef705b49f37d797ad2270ad21
|
Provenance
The following attestation bundles were made for actualis-0.1.2.tar.gz:
Publisher:
release.yml on digital-foundry/actualis
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
actualis-0.1.2.tar.gz -
Subject digest:
887c278faecd05c157f143c5be8115250098b4189fae54dab14708434be585cd - Sigstore transparency entry: 2581839303
- Sigstore integration time:
-
Permalink:
digital-foundry/actualis@502f071978e32b864d192341eeabc2fc2e91a16c -
Branch / Tag:
refs/tags/v0.1.2 - Owner: https://github.com/digital-foundry
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@502f071978e32b864d192341eeabc2fc2e91a16c -
Trigger Event:
push
-
Statement type:
File details
Details for the file actualis-0.1.2-py3-none-any.whl.
File metadata
- Download URL: actualis-0.1.2-py3-none-any.whl
- Upload date:
- Size: 64.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a34702782ebd05bfa537f9f53fc92bf9ffb40d4fbf3ca49819928a99c77a57dd
|
|
| MD5 |
00f2bfe39ee0dab4a23054e993dc61dc
|
|
| BLAKE2b-256 |
7c7d126d40371b13df79d018fd6e7b60e680c5486765a7dfcb33a5a047c3d269
|
Provenance
The following attestation bundles were made for actualis-0.1.2-py3-none-any.whl:
Publisher:
release.yml on digital-foundry/actualis
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
actualis-0.1.2-py3-none-any.whl -
Subject digest:
a34702782ebd05bfa537f9f53fc92bf9ffb40d4fbf3ca49819928a99c77a57dd - Sigstore transparency entry: 2581839314
- Sigstore integration time:
-
Permalink:
digital-foundry/actualis@502f071978e32b864d192341eeabc2fc2e91a16c -
Branch / Tag:
refs/tags/v0.1.2 - Owner: https://github.com/digital-foundry
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@502f071978e32b864d192341eeabc2fc2e91a16c -
Trigger Event:
push
-
Statement type: