glance-sdk

Structured screen understanding for AI apps. glance.run

Replace expensive screenshot-to-vision-model pipelines with one function call. Glance reads the macOS accessibility tree and gives your AI structured data about every UI element — role, label, value, and exact pixel coordinates.

Install

pip install glance-sdk

Usage

from glance_sdk import screen, capture, find, check_access

# LLM-ready text — drop directly into your prompt
context = screen()

# Full structured data
state = capture()
print(state["app"])           # "VS Code"
print(state["elementCount"])  # 342
print(state["captureTimeMs"]) # 28.5

# Find element by name → exact coordinates
btn = find("Submit")
print(btn["centerX"], btn["centerY"])  # 520, 340

# Check accessibility permission
has_access = check_access()

Why

Requirements

• macOS 14.2+
• Accessibility permission (System Settings -> Privacy & Security -> Accessibility)

License

MIT