pyvisionauto 0.1.1

PyVisionAuto: Cross-platform desktop automation toolkit with visual image matching, mouse/keyboard control, and screen recording

PyVisionAuto

PyVisionAuto is an end-to-end desktop automation toolkit. It is centered on visual image matching and also includes screen recording, mouse automation, and keyboard automation capabilities.

Scope

• Linux (X11 session) and Windows
• Real physical display required

Install

pip install pyvisionauto

System dependencies

Linux

• python3-tk (for border overlay highlight)
• xdotool (preferred for window activation)
• wmctrl (fallback for window activation)
• ffmpeg (optional, only for recording APIs; install via sudo apt install ffmpeg)

Windows

• tkinter (bundled with most Python installations on Windows)
• ffmpeg (optional, only for recording APIs; must be installed and added to system PATH)

Installing ffmpeg on Windows: Download from ffmpeg.org, extract the archive, and add the bin folder to your system PATH.

Quick start

from pyvisionauto import Screen

screen = Screen()
screen.wait("login_button.png", timeout=10).highlight().click()

Activate a window before matching

screen.activate_window("Calculator")
screen.click("button.png")

Runtime screenshot

Highlighted match region during runtime:

Platform differences

Feature	Linux	Windows
Screen capture & template matching	Supported	Supported
Mouse / keyboard automation	Supported	Supported
Highlight overlay	Supported	Supported
Window activation	xdotool / wmctrl	pyautogui (pygetwindow)
Screen recording	ffmpeg + x11grab	ffmpeg + gdigrab

Screen recording requires ffmpeg installed and added to system PATH. Linux uses x11grab, Windows uses gdigrab.

Notes

• Wayland-only and headless environments are not currently supported.
• On Windows with high-DPI scaling, coordinate accuracy may be affected.