grip
Token-efficient, CDP-native browser SDK for AI agents.
Built directly on Chrome DevTools Protocol — no Playwright, no Puppeteer, no wrapper overhead.
pip install grip-browser
What is Grip?
Grip is a CDP-native browser SDK for AI agents that turns a web page into a ~2,000-token semantic snapshot instead of ~59,000 tokens of raw HTML (medians over 8 real pages, 2026-08-10). It runs on the Chrome DevTools Protocol directly — no Playwright, no Puppeteer, no wrapper binary.
Why Grip
Agents don't need the DOM. They need to know what's on the page and what they can act on. Grip sends the model only the interactive elements and visible text — structured, indexed, and fuzzy-matchable.
Measured across 8 real pages (Wikipedia, GitHub, react.dev, BBC, Hacker News, Python docs, arXiv, example.com) on 2026-08-10: grip's snapshot is a median 16.0x smaller than the page's raw HTML — that is the median of the per-page ratios, and per page it runs from 3.3x on example.com, which is already tiny, to 68.4x on GitHub. The underlying medians are 58,912 tokens of raw HTML (range 167–459,193) against 1,998 tokens of grip snapshot (range 50–19,946). Per-page tables: benchmarks/RESULTS_COMPETITORS.md.
The spread is the point: quoting the median alone is wrong for most individual pages by a large factor in one direction or the other.
That 16.0x is against raw HTML, which is the right comparison if your agent would otherwise put the DOM in the prompt. Against naively tag-stripped text — what a retrieval API sends a model — the reduction is only about 1.4x, because most of what grip removes is markup rather than words. That 1.4x is a separate, older measurement: median characters over the 23 pages of the 33-page reach corpus where both arms returned content, range 0.5x–3.7x, and it has not been re-run against the 8-page corpus above. Both numbers are measured; use whichever matches what you would otherwise send. Method and data: evaluation/.
Grip vs Playwright MCP vs Puppeteer
| Playwright MCP | Puppeteer | Grip | |
|---|---|---|---|
| Tokens per snapshot | 11,597 median | 58,280 median (HTML) 27,489 median (a11y tree) |
1,998 median |
| Built on | Playwright | Chromium binary API | pure CDP |
| Shadow DOM traversal | partial | no | full |
| Fuzzy element match (no selectors) | no | no | yes |
| Typed error recovery | no | no | yes |
| Prompt-injection guard | no | no | yes |
All three token figures are measured on the same 8 real pages with the same encoder
(tiktoken cl100k_base), run 2026-08-10. grip is the smallest payload on 8 of 8 pages
— a median 5.0x below Playwright MCP (range 2.5x–7.3x) and 15.4x below
Puppeteer's page.content(). Puppeteer has no single canonical observation, so both
the HTML and accessibility-tree payloads are shown. On Hacker News, Playwright MCP's
snapshot came out larger than the raw HTML it describes — an accessibility tree is
not automatically a compression. Per-page tables, ratios and method:
benchmarks/RESULTS_COMPETITORS.md.
This measures payload size only. It says nothing about task success, latency, reliability or cross-browser support.
Honest caveat: Playwright and Puppeteer are broader general-purpose automation frameworks with huge ecosystems and cross-browser support. Grip is narrower on purpose — it does one thing (feed an LLM the smallest useful view of a page) and does not try to replace them for human-driven E2E testing.
When to use Grip
- You're building an autonomous or semi-autonomous agent that browses the web and you're paying per token.
- Your agent loop is blowing its context window on raw HTML or screenshots.
- You want typed, recoverable errors (
CAPTCHA_REQUIRED,RATE_LIMITED,ELEMENT_STALE) instead of parsing exception strings. - You need shadow DOM / web-component pages handled without special-casing.
When not to use Grip
- You need cross-browser (Firefox/WebKit) human E2E test coverage — use Playwright.
- Your task is a fixed, deterministic scrape with known selectors and no LLM in the loop — a plain scraper is simpler.
FAQ
Is Grip a Playwright wrapper? No. Grip talks to Chrome over the DevTools Protocol directly. There is no Playwright or Puppeteer dependency underneath.
How does it cut tokens? It sends the model only interactive elements (inputs, buttons, links) and visible text, indexed for fuzzy matching — not the full HTML tree, not a screenshot. On 2026-08-10 a trivial page like example.com came out at 50 tokens against 167 raw; the Wikipedia article on Python, the heaviest page in the corpus, came out at 19,946 against 459,193 raw.
Which LLMs does it work with? Anthropic and OpenAI adapters ship in the box; any model works via the LLMAdapter protocol.
Does it handle CAPTCHAs / bot blocks? It detects and classifies them (page.detect_challenge()), and returns a typed error with a suggested recovery action (escalate, backoff, rotate). page.solve_challenge() attempts checkbox, Turnstile and slider stages in-process and only reports success it can verify; image-grid and text challenges come back to your model with a screenshot. No third-party solving service is used, and success rates are unmeasured — see Challenges and automation tells.
What do I need installed? Python 3.11+ and Chrome or Chromium. Grip finds Chrome automatically, and falls back to the Chrome for Testing build that Playwright or Puppeteer already downloaded if no system Chrome is present. Set CHROME_EXECUTABLE to override.
The problem
Most browser tools give AI agents raw HTML or screenshots. Raw HTML on a real page runs tens of thousands of tokens — a measured median of 58,912 across 8 popular sites on 2026-08-10, ranging from 167 on example.com to 459,193 for a single Wikipedia article. A PNG screenshot estimates at ~3,000 tokens, a JPEG at ~800 (grip's own Screenshot.tokens_estimated, a size estimate rather than a corpus measurement). The 58,280 median in the tables above is a separate arm — Puppeteer's page.content() on the same 8 pages — not a second reading of this one. Both burn through context windows fast and slow your agent down.
What grip does instead
grip gives your agent a semantic summary of what's on the page — just the interactive elements and visible text, structured for LLM consumption:
PAGE: Amazon.com
URL: https://www.amazon.com/
INTERACTIVE:
[inp:0] "search here" (placeholder)
[btn:1] "Go"
[btn:2] "Sign in"
[lnk:3] "Returns & Orders"
CONTENT:
Delivering to New York — Shop deals in...
1,998 tokens per snapshot, median across those 8 pages on 2026-08-10, but the range is 50 to 19,946 and the median is not what you should budget for. example.com, the smallest page on the web, is 50 tokens. The Wikipedia article on Python is 19,946 — against 459,193 raw.
Quick start
import asyncio
from grip import Browser
async def main():
async with Browser(headless=True) as browser:
page = await browser.open("https://news.ycombinator.com")
snapshot = await page.snapshot()
print(snapshot.text_content) # readable page text
print(snapshot.elements) # interactive elements only
print(snapshot.tokens_estimated) # 3,540 for this page on 2026-08-10; 1,998 median across 8 real pages
asyncio.run(main())
Full agent loop
async with Browser(headless=True) as browser:
page = await browser.open("https://amazon.com")
await page.snapshot() # build element index
await page.type("search", "blue sneakers")
await page.click("Go") # fuzzy match — no selectors needed
await page.snapshot() # re-index after navigation
doc = await page.read() # prose, citable blocks, no nav chrome
shot = await page.screenshot() # JPEG, ~800 tokens for vision models
shot.save("result.jpg")
Concurrent pages
Every open() gets its own tab and its own CDP connection, so pages are
independent and can be driven in parallel:
async with Browser(headless=True) as browser:
urls = ["https://example.com", "https://example.org", "https://example.net"]
pages = await asyncio.gather(*(browser.open(u) for u in urls))
snapshots = await asyncio.gather(*(p.snapshot() for p in pages))
for snap in snapshots:
print(snap.url, snap.tokens_estimated)
for page in pages:
await page.close() # closes the tab; browser.close() also closes any left open
page.goto(url) navigates an existing tab in place. There is no built-in
concurrency limit — wrap in an asyncio.Semaphore if you need one, since the
safe ceiling depends on your machine rather than on grip.
Read mode
snapshot() answers "what can I click here". read() answers "what does this page
say" — main content isolated, navigation and footer chrome dropped, and every block
carrying the heading trail above it so a claim can be cited back to a location.
async with Browser(headless=True) as browser:
page = await browser.open("https://docs.python.org/3/library/asyncio-task.html")
doc = await page.read()
print(doc.outline()) # heading map of the page
for block in doc.blocks:
print(block.citation, block.text[:60])
# [12] Coroutines and tasks › Coroutines Source code: Lib/asyncio/...
read(max_chars=N) truncates by dropping whole blocks, never mid-sentence. The
default is no limit — deciding which parts of a page matter is ranking, and that
belongs to the caller.
Challenges and automation tells
grip detects checkbox, Turnstile, slider, image-grid, text and invisible
challenges from the page's DOM and frame URLs, and classifies them without a
network call (page.detect_challenge()). Detection is tested against real widget
markup.
page.solve_challenge() implements in-process solve flows for the checkbox,
Turnstile and slider stages, using human-shaped pointer motion and no
third-party solving API. Each flow reports "solved" only after it verifies
the outcome — a response token is present, or the widget has left the page. If
neither is true when the timeout expires it returns "timeout", never "solved".
Image-grid and text challenges return "needs_vision" with a screenshot for your
own model to answer; grip does not ship a classifier. Solve success rates are
unmeasured as of 2026-08-10: they depend on IP reputation and provider-side
scoring, so any number quoted here without a stated egress would be meaningless.
result = await page.solve_challenge(timeout=30.0)
match result.status:
case "solved": ... # verified: token present or widget gone
case "needs_vision": ... # result.screenshot -> your model -> page.click_at(x, y)
case "unsupported": ... # named in result.stage
case "timeout": ... # NOT solved; the challenge is still there
case "none": ...
Human-shaped input is available on its own: page.click_at(x, y, human=True) and
page.drag(start, end) travel a curved, eased Bézier path with a randomized press
dwell. Straight-line constant-velocity motion is the clearest synthetic-input
tell. page.click(desc, human=True) uses that path instead of the JS click: it
re-resolves the element first, so it still raises ELEMENT_STALE on a stale
handle and clicks the element's live position rather than the one the snapshot
recorded. The default stays the JS path — it is faster and works headless —
and human=True is for challenge flows.
Chrome under CDP sets navigator.webdriver and puts HeadlessChrome in the user
agent. Browser(stealth=True) removes both. It is off by default because grip is a
general-purpose SDK and silently masking automation would surprise anyone using it
for ordinary testing. Measured once, on 2026-08-10, with
evaluation/stealth_measurement.py:
probe stealth=False stealth=True
https://bot.sannysoft.com/ 10 tells 4 tells
https://abrahamjuliot.github.io/creepjs/ 3 tells 0 tells
.venv/bin/python -m evaluation.stealth_measurement
Read that narrowly. These probes count the signals they choose to report, so fewer tells is not "undetectable" — a service that scores rather than lists may weigh signals these pages never surface. It was not tested against any live anti-bot system: no reCAPTCHA, no Cloudflare challenge, no commercial bot manager. It is one run on one machine, one Chrome build and one IP, so run-to-run variance is unknown. It says nothing about TLS/JA3. And it does not predict that a site will let you through — IP reputation usually decides that, and neither flag touches it. (A competitor measured the page-world shim approach against live reCAPTCHA and found it made detection easier; that is a different mechanism — init scripts patching navigator from inside the page — than the two launch flags measured here, so both results can hold.)
grip does not hide that it is automation at the network layer. TLS/JA3
fingerprints, and full headless fingerprint parity, live below the Chrome
DevTools Protocol and cannot be reached from a Python client driving stock
Chromium. If a site blocks you on IP reputation or TLS fingerprint, no flag in
this library will change that — that is an egress problem, and the answer is a
residential or mobile proxy, which grip supports via proxy=.
With an LLM (autonomous mode)
from grip import Browser
from grip.adapters.anthropic import AnthropicAdapter
llm = AnthropicAdapter(api_key="sk-ant-...")
async with Browser(llm=llm, headless=True) as browser:
result = await browser.run(
goal="Find the cheapest blue sneakers under $80",
url="https://amazon.com"
)
print(result.data)
print(f"Used {result.tokens} tokens")
grip handles the snapshot → decide → act loop automatically. You just provide the goal.
Snapshot delta
Inside the run loop, grip sends the model a full snapshot on the first turn and a delta after that — only the elements and content that changed.
Measured end to end, an agent driving grip spends ~18x fewer prompt tokens over
a 6-turn run than the same agent dumping outerHTML (16.9x–18.4x across repeat
runs; 17.8x on the reported run, ranging 4.6x–41.8x across the four scenarios).
That figure is the median of the per-scenario ratios over four real sites, six
real turns each, counted with tiktoken cl100k_base.
Most of that win is compression, not the delta, and it is worth being clear about which mechanism does what:
| median | per-scenario range | |
|---|---|---|
| compression — grip snapshot vs raw HTML, per turn | 11.3x | 2.9x – 22.0x |
| delta — vs sending a full snapshot every turn, per turn | 1.0x | 1.0x – 8.8x |
| pruning — superseded page states dropped, cumulative | 1.4x | 1.0x – 2.2x |
| end to end — raw HTML vs grip delta + pruning, cumulative | 17.8x | 4.6x – 41.8x |
The 11.3x compression figure is the large term, and any serious accessibility-tree tool gets some version of it.
The delta's per-turn median is only 1.0x because build_delta returns None on
a URL change: on a navigation turn grip sends a full snapshot by design, and a
realistic agent run is mostly navigation. Three of the four scenarios had 0–2
same-document turns out of 6. Where it pays is when an agent works within one
page — filling a form, driving an SPA. On the 8 turns across all scenarios
where a delta could fire, repeat observations cost a median 9.1x less, range
0.5x–175.0x. The 0.5x is a real defect the benchmark surfaced: on a
click-driven navigation where the reported URL lagged the document, grip diffed
two unrelated pages and emitted a delta larger than the snapshot it replaced.
It is documented, not smoothed away.
Pruning is a separate mechanism from the delta and is what carries navigation-heavy runs: superseded page states are not re-sent, so cumulative prompt cost grows with the number of turns rather than with their square.
Full method, per-scenario tables, stability across 20 runs and the things this
does not measure (task success, latency, model quality) are in
benchmarks/RESULTS_AB.md. Reproduce with:
.venv/bin/python benchmarks/bench_agent_ab.py
Why not Playwright or Puppeteer?
| Playwright MCP | Puppeteer | grip | |
|---|---|---|---|
| Tokens per snapshot | 11,597 median | 58,280 median (HTML) 27,489 median (a11y tree) |
1,998 median |
| Shadow DOM traversal | Partial | No | Full |
| Prompt injection guard | No | No | Yes |
| Typed error recovery | No | No | Yes |
| Element staleness detection | No | No | Yes |
| Pure CDP (no binary bloat) | No | No | Yes |
| Screenshot token tracking | No | No | Yes |
Token figures: 8 real pages, tiktoken cl100k_base, 2026-08-10 —
benchmarks/RESULTS_COMPETITORS.md. Payload size
is one axis: Playwright and Puppeteer are broader general-purpose automation frameworks
and this table says nothing about task success, latency or cross-browser support.
Structured errors
Every error comes back as a typed BrowserError — not a bare string — so your agent can make decisions:
from grip import GripError
from grip.errors.types import ErrorType, RecoveryAction
try:
await page.click("checkout")
except GripError as e:
match e.error.type:
case ErrorType.CAPTCHA_REQUIRED:
# recovery: ESCALATE_TO_HUMAN or VISION_FALLBACK
await escalate(e.error.message)
case ErrorType.RATE_LIMITED:
# recovery: EXPONENTIAL_BACKOFF + RETRY
await asyncio.sleep(30)
await page.click("checkout")
case ErrorType.AUTH_REQUIRED:
# recovery: ESCALATE_TO_HUMAN
raise NeedsLogin(e.error.message)
case ErrorType.ELEMENT_STALE:
# recovery: RE_SNAPSHOT + RETRY
await page.snapshot()
await page.click("checkout")
Full error taxonomy
| Type | When | Suggested recovery |
|---|---|---|
ELEMENT_NOT_FOUND |
fuzzy match failed | re-snapshot, retry with different description |
ELEMENT_STALE |
element moved after navigation | re-snapshot |
ANTI_BOT_BLOCK |
Cloudflare, DDoS-Guard, 403 | rotate identity |
CAPTCHA_REQUIRED |
CAPTCHA challenge page | escalate to human |
RATE_LIMITED |
429 Too Many Requests | exponential backoff |
AUTH_REQUIRED |
login wall | escalate to human |
ZERO_RESULTS |
page loaded, no matching content | retry, broaden query |
NETWORK_TIMEOUT |
navigation timed out | exponential backoff |
NAVIGATION_FAILED |
blank page / bad URL | retry |
Shadow DOM
grip traverses shadow DOM trees automatically. Web components, Chrome extensions, custom elements — all discovered in the same snapshot:
snapshot = await page.snapshot()
shadow_elements = [el for el in snapshot.elements if el.in_shadow_dom]
Trace
Every action is recorded with timing and token cost:
async with Browser() as browser:
page = await browser.open("https://example.com")
await page.snapshot()
await page.click("Learn more")
await page.screenshot()
print(browser.trace.total_tokens) # total tokens used
browser.trace.to_jsonl("audit.jsonl") # machine-readable audit log
LLM adapters
grip ships with OpenAI and Anthropic adapters out of the box:
from grip.adapters.openai import OpenAIAdapter
from grip.adapters.anthropic import AnthropicAdapter
llm = OpenAIAdapter(api_key="sk-...") # gpt-4o, gpt-4-turbo, etc.
llm = AnthropicAdapter(api_key="sk-ant-...") # claude-opus-4-7, etc.
Or bring your own by implementing the LLMAdapter protocol:
from grip.adapters.base import LLMAdapter, LLMResponse
class MyAdapter:
async def complete(self, messages, tools) -> LLMResponse:
...
Requirements
- Python 3.11+
- Google Chrome (or Chromium) installed
grip finds Chrome automatically. Override with CHROME_EXECUTABLE env var.
Install
pip install grip-browser
# with OpenAI support
pip install grip-browser[openai]
# with Anthropic support
pip install grip-browser[anthropic]
Measured numbers
Everything in this table was measured on this branch. Anything not in it is not
claimed: cold-start time, memory, requests per second and challenge solve rates
are all unmeasured, and quoting them would be a guess. Tokens against other
tools ARE measured — Playwright MCP and Puppeteer, in
benchmarks/RESULTS_COMPETITORS.md. The
snapshot-size figures live in Why Grip with their own method note.
| Measured | How | |
|---|---|---|
| Prompt tokens over a 6-turn run, grip vs raw HTML | 17.8x fewer (4.6x–41.8x per scenario; 16.9x–18.4x across repeat runs) | median of per-scenario ratios, 4 live sites × 6 real turns, tiktoken cl100k_base; benchmarks/RESULTS_AB.md |
| — of which compression, per turn | 11.3x (2.9x–22.0x) | grip snapshot vs outerHTML of the same DOM state, same run |
| — of which delta, per turn | 1.0x (1.0x–8.8x) | vs sending a full snapshot every turn; build_delta returns None on navigation, so most turns send a full snapshot |
| — of which pruning, cumulative | 1.4x (1.0x–2.2x) | superseded page states dropped from the transcript; independent of the delta |
| Delta saving on same-document turns | 9.1x median (0.5x–175.0x) | the 8 turns of 24 where a delta fired; the 0.5x is the URL-lag defect documented in the results file |
| Cumulative prompt cost over a run | grows with turns, not turns² | superseded page states are not re-sent |
| Unit tests | 249 pass | pytest tests/unit |
| gripsearch tests | 33 pass | pytest in gripsearch/ |
| Integration tests | 74 pass | real Chrome, live network |
| Unit coverage | 84.18% | unit tests only; CI fails below 80 |
| Lint | ruff 83 → 0 | both gates previously passed vacuously because neither was configured |
| Types | mypy --strict 35 → 0 |
as above |
| example.com, live | open 0.80s, snapshot 0.01s, 1 element, 50 tokens | headless Chrome, single page |
| Local file fixture | open 0.61s, snapshot 0.01s | file:// page, no network |
| Chrome profile directories stranded | 0 | across a 57-minute full-suite run |
Test and lint counts are for this branch and will move. Re-run them rather than trusting the table if the number matters to you.
Contributing
Contributions are welcome. See CONTRIBUTING.md for dev setup, running tests, and lint/type-check commands. Please also read the Code of Conduct. Found a security issue? See SECURITY.md instead of opening a public issue.
License
MIT — see LICENSE.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file grip_browser-0.5.1.tar.gz.
File metadata
- Download URL: grip_browser-0.5.1.tar.gz
- Upload date:
- Size: 68.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/7.0.0 CPython/3.14.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
01e903812299d9257ebcf24e9f1d699a70d43a3a2b96d44ba7f6b4e3fa80b4d2
|
|
| MD5 |
e326007dc30b68f169c62ba33e0a5a96
|
|
| BLAKE2b-256 |
a79db348a01376ff45bae960e731487c95f5a529838e511262f9d0acb8cd7ef0
|
File details
Details for the file grip_browser-0.5.1-py3-none-any.whl.
File metadata
- Download URL: grip_browser-0.5.1-py3-none-any.whl
- Upload date:
- Size: 71.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/7.0.0 CPython/3.14.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e833db46d6e6cc1c51db20e9988c2ca378e633b679ef59957ba7968cb5676845
|
|
| MD5 |
759e4210d99d6872ee66614454442b4a
|
|
| BLAKE2b-256 |
036bf983317d22860b633bb57170b10d356f8083c3ef62a515638b15a15349c8
|