Skip to main content

Visual Desktop Bridge - Give any AI full control over Windows

Project description

Visual Desktop Bridge (Claude Bridge)

Visual Desktop Bridge - Give any AI full control over Windows Currently designed for Claude Code and Claude Desktop.

[!NOTE] This project was formerly known as "Universal PC Control".

Overview

Visual Desktop Bridge is a "body" for your AI "brain". It allows Claude to:

  1. See your screen (using screenshots and grid overlays).
  2. Control your mouse/keyboard (using coordinate grids and hotkeys).
  3. Manage applications (launch, switch, close).
  4. Run locally on your PC while communicating securely with the cloud/MCP.

Key Features

  • Vision-First Control: Claude sees a grid overlay (e.g., "Click A5") to interact with any app, even those without accessibility API support (Spotify, Games, etc.).
  • Persistent Connection: Agents are remembered across sessions.
  • Fast & Lightweight: Built on fastmcp and optimized for low latency.
  • Safe: Includes a "Safety Sentinel" to block dangerous commands (like deleting files) unless explicitly approved.

Installation

Easy Install (Windows)

  1. Download the latest release.
  2. Run ClaudeBridgeAgent.exe.
  3. The agent will auto-register with your MCP configuration.

Manual Setup (Developers)

  1. Clone the repo.
  2. Install dependencies:
    pip install -r requirements.txt
    pip install -r requirements-local.txt
    
  3. Run the bridge server:
    python bridge_mcp.py
    
  4. Run the local agent:
    python local_agent.py
    

Usage with Claude

Once running, you can ask Claude to:

  • "Take a screenshot and tell me what you see."
  • "Open Notepad and type 'Hello World'."
  • "Click the Play button on Spotify."
  • "Organize the files in my Downloads folder."

Architecture

  • Bridge Server (bridge_mcp.py): Acts as the MCP entry point for Claude.
  • Local Agent (local_agent.py): Runs on the Windows PC, executing actual mouse/keyboard commands.
  • Vision Engine: Uses pyautogui and PIL to generate grid-augmented screenshots for the AI.

Safety

By default, "Safe Mode" is ON. Dangerous commands (powershell, file writes) require user confirmation via the desktop overlay.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bridge_mcp-1.1.3.tar.gz (31.2 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bridge_mcp-1.1.3-py3-none-any.whl (8.7 kB view details)

Uploaded Python 3

File details

Details for the file bridge_mcp-1.1.3.tar.gz.

File metadata

  • Download URL: bridge_mcp-1.1.3.tar.gz
  • Upload date:
  • Size: 31.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for bridge_mcp-1.1.3.tar.gz
Algorithm Hash digest
SHA256 5ad86bfa405ca336481e6f4501154313fb9387923430d169102564e7165e8293
MD5 ccc781c1fe25446a94a79badd103c998
BLAKE2b-256 6af5cfc4d4db2d37c54e543621cbc59c7b3b8d1fa9e29a4ba89e3b1e8dcd229f

See more details on using hashes here.

File details

Details for the file bridge_mcp-1.1.3-py3-none-any.whl.

File metadata

  • Download URL: bridge_mcp-1.1.3-py3-none-any.whl
  • Upload date:
  • Size: 8.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for bridge_mcp-1.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 009cc564201790720eba65953ef108b5792c3e589e052ec209fee4032b5b19b9
MD5 48d88c9f9eeb16e46d818aedbf92edcb
BLAKE2b-256 ea839c07971f9f84fb67389eb1323f95cfdb6c93b574cfb4a5a32391fab66d1b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page