SimMirror

Mirror and drive the iOS Simulator from Claude Code, CLI agents and the browser.

A live iOS Simulator in any browser tab or web page, an animated cursor that shows exactly what your AI agent is about to tap, and token-efficient UI snapshots so agents read the screen as compact text instead of screenshots. Works with Claude Code, Codex, Cursor and any other MCP client.

Status: 1.0. The agent tools, the viewer, the protocol and the embedding API are stable, and a check holds every 1.x release to what SimMirror promises not to break.

Why SimMirror

• See the simulator anywhere. A live H.264 or JPEG stream in a Chrome tab, an iframe or a <sim-mirror> web component, with touch, scrolling, typing, hardware buttons and light and dark mode.
• Watch what the agent does. Every agent gesture is announced before it lands, and the viewer's cursor glides to the spot first -- so you can follow along, and step in: an agent waits for your hand to be still.
• Spend fewer tokens. Agents read accessibility snapshots with stable element refs and diffs between screens, act in batches with waits, and reach for a screenshot only when a question is visual.

Install

Claude Code, with the plugin (tools, a skill that teaches snapshot-first use, and /sim-mirror:open):

/plugin marketplace add AndrewKochulab/sim-mirror
/plugin install sim-mirror@sim-mirror

Any MCP client, as a stdio server:

claude mcp add sim-mirror -- uvx --from sim-mirror==1.0.0 sim-mirror mcp

Configurations for Codex, Cursor and other clients.

The command, for sim-mirror open, doctor and the rest:

uv tool install sim-mirror==1.0.0

The viewer library, for your own pages: npm install @andrewkochulab/sim-mirror (npm). SimMirror itself is on PyPI; a Homebrew formula comes with v1.0.

Requirements: an Apple Silicon Mac, Xcode 26 or later, uv, and for touching the screen, idb_companion (brew install facebook/fb/idb-companion). Details in Installation.

Quickstart

sim-mirror doctor     # check this Mac, ending with a real tap on a simulator
sim-mirror open       # this project's simulator, live in a browser tab

Then ask your agent:

Open Settings → General → About and tell me which iOS version this simulator runs. Use sim_snapshot rather than screenshots.

Getting started explains what happens along the way.

Features

Live viewer. H.264 through WebCodecs where the page can decode it, JPEG otherwise, negotiated per connection. Touch, drag, scroll, typing and paste, Home and Lock, light and dark, and a device picker. It reconnects by itself after a blip and says plainly when the simulator is off.

Agent cursor. Every agent gesture -- tap, long press, swipe, drag, typing -- reaches the viewer before it lands, and the viewer's own pointer glides there first (agent.cursor_lead_ms). Never the Mac's pointer.

Screen understanding. A snapshot is a few lines -- e2 button "General" (201,319) -- with refs that stay with their elements across scrolls, a digest, and diffs. sim_act plays up to 20 steps in one call and waits for text, its absence, or the screen to settle. See Screen understanding.

Connectors. idb_companion gives full control; without it the simctl connector still mirrors the screen, view-only, and says why. More connectors plug in through an entry point. See Connectors.

Embedding. An iframe with a one-shot ticket, the <sim-mirror> element themed with CSS custom properties, or SimMirror inside a Python application with its own sign-in.

Settings panel. sim-mirror open --settings puts every setting a click away in the viewer, a tab per section, saved for one project or all of them and applied before it says so. Settings that decide what runs or who may reach the daemon wait for a code from sim-mirror settings confirm. See The settings panel.

Doctor. Checks Xcode, its Simulator frameworks, runtimes, idb_companion, Device Hub and the desktop session, then proves a tap reaches a simulator. See the doctor.

Security. Loopback only, a Host allowlist, exact Origin checks, CORS and framing only for origins you list, hashed scoped tokens, and one-shot codes in URL fragments. See Security.

Build and test. sim_build_run and sim_test build with xcodebuild for the agent's simulator, install and launch, and answer with only what failed and where -- each failing test named so it can be run again alone, and on another simulator when asked. Off by default, since they run commands: sim-mirror config set build.tools true.

Measure the token cost

benchmarks/tool_budget.py calls each read-only tool through the same MCP relay a client uses and prints each answer's bytes, estimated tokens and latency on your own screens; see the token budget example. On an iPhone 17 Pro simulator (iOS 26.5, idb connector) showing Settings → General, 5 calls each (2026-09-16):

Bytes are the whole answer, an image's base64 included; tokens are estimates (text at about 4 characters a token, an image at about 750 pixels a token).

Compatibility

Rows checked on real hardware are marked verified, with the date, in Compatibility.

From 1.0 the tools, the protocol, the embedding API, the viewer package, settings and the command line are held to what SimMirror promises not to break: a 1.x release adds, and never breaks. Connectors are the exception, and pin a minor version.

Documentation

Everything: getting started, clients, embedding, screen understanding, connectors, security, architecture, and the reference for tools, configuration, the command line and the protocol.

Roadmap

See ROADMAP.md and the milestones. How SimMirror relates to other tools is in Comparison.

Contributing

Contributions are welcome. Read CONTRIBUTING.md and the Code of Conduct; AI coding agents read AGENTS.md. Report security issues privately as described in SECURITY.md. Questions go to Discussions.

License

Apache-2.0. See NOTICE and THIRD_PARTY_LICENSES.md.

SimMirror is an independent project, not affiliated with Apple or Anthropic. iOS, iPhone, Xcode and Simulator are trademarks of Apple Inc.; Claude and Claude Code are trademarks of Anthropic PBC.