Skip to main content

MCP server for Windows desktop UI automation inspection and scripting via UI Automation API

Project description

uiautomation-mcp

GitHub

基于 UI Automation API 的 MCP Server,用于检查和自动化 Windows 桌面 UI 元素。

为 AI 助手提供探索 UI 控件树、检查元素属性、执行操作(点击、输入、切换等)以及生成可直接使用的 Python 自动化脚本的能力。

安装

pip install uiautomation-mcp

或使用 uv

uv pip install uiautomation-mcp

使用方式

命令行启动

uiautomation-mcp

通过 stdio 启动 MCP Server。

MCP 客户端配置

添加到 MCP 客户端配置文件(如 .kiro/settings/mcp.json):

{
  "mcpServers": {
    "uiautomation": {
      "command": "uiautomation-mcp",
      "disabled": false,
      "autoApprove": []
    }
  }
}

也可以通过 uvx 直接运行(无需预装):

{
  "mcpServers": {
    "uiautomation": {
      "command": "uvx",
      "args": ["uiautomation-mcp"],
      "disabled": false,
      "autoApprove": []
    }
  }
}

工具列表

工具 说明
list_windows 列出桌面上所有可见的顶层窗口
inspect_element_tree 从指定元素开始探索 UI 控件树
get_element_detail 获取元素的完整详情,包括自动化模式和定位策略
inspect_at_point 检查屏幕坐标处的 UI 元素
find_elements 按名称、类型、AutomationId 或类名搜索元素
capture_screenshot 截取窗口或桌面的屏幕截图
activate_window 将窗口激活并置于前台
perform_action 对元素执行操作(点击、输入、切换、展开等)
generate_script_snippet 生成可直接复制使用的 Python 自动化代码

典型工作流

  1. list_windows — 找到目标应用窗口
  2. activate_window — 将窗口置于前台
  3. inspect_element_tree — 探索 UI 结构
  4. find_elements / get_element_detail — 定位具体控件
  5. perform_action — 与元素交互
  6. generate_script_snippet — 获取可复用的自动化代码

系统要求

  • Windows 操作系统
  • Python >= 3.12

许可证

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

uiautomation_mcp-0.1.0.tar.gz (72.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

uiautomation_mcp-0.1.0-py3-none-any.whl (10.3 kB view details)

Uploaded Python 3

File details

Details for the file uiautomation_mcp-0.1.0.tar.gz.

File metadata

  • Download URL: uiautomation_mcp-0.1.0.tar.gz
  • Upload date:
  • Size: 72.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.10 {"installer":{"name":"uv","version":"0.10.10","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":null,"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for uiautomation_mcp-0.1.0.tar.gz
Algorithm Hash digest
SHA256 89e53190b4d445699275caadbc0add14778ec149fce8b2b8c0aaaaadddb33b87
MD5 de98320af50d135acaf0211fe3bace2c
BLAKE2b-256 f7b54bb427c802caf37ce301a3882715f4140e61d68503436140dca891fc3960

See more details on using hashes here.

File details

Details for the file uiautomation_mcp-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: uiautomation_mcp-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 10.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.10 {"installer":{"name":"uv","version":"0.10.10","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":null,"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for uiautomation_mcp-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 fedaddc4ba388b83b12d8cf7fe35259a5da2db80b3022c3bcdc9519e0d9b3bb1
MD5 afe975231698818252dea83de4c02aa7
BLAKE2b-256 544dd51d349dc0f6ca5ba2ecbed3ca8b8572d8cca0eabf2be4fa8050d6ffc25b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page