PyClickerRPA 0.1.0

Visual auto-click / RPA tool: window capture, OpenCV image matching, OCR, a node flow editor and step-list editor, recorder, scheduler and triggers (Windows).

PyClickerRPA

A visual auto-click / RPA tool for Windows — window/screen capture, OpenCV template matching, optional OCR, a node-based flow editor and a linear step-list editor, an action recorder, a scheduler, and image/color triggers.

It is a Python/PySide6 port of a Qt/C++ AutoClicker, and reads/writes the same .json task format.

Install

pip install PyClickerRPA

Optional OCR (find-text / read-text steps) needs PaddleOCR:

pip install "PyClickerRPA[ocr]"

Run

GUI:

autoclicker

Headless (run a saved task against a window by title, or the whole screen):

autoclicker-run task.json --window "Notepad"

Features

• Targeting: pick any visible window (or the whole screen); background-window capture via PrintWindow.
• Matching: OpenCV TM_CCOEFF_NORMED template matching (multi-scale, ROI, multi-target), pixel-color checks, and optional PaddleOCR text find / read.
• Editors: drag-and-drop node flow graph (back-edges become loops) and a step list with a full per-step parameter dialog; both interoperate.
• ~30+ step types: click image/text/position, click-all, relative & offset clicks, wait / random wait, drag / long-press / pinch / scroll, key / type / hotkey, loop / goto / while / do-until, if image/text/color/count/var, set-var (++/--, last_x/last_y/last_text), read-text→variable, call sub-task, groups.
• Authoring aids: action recorder (global hooks), snippet library, task packages (.zip with templates), edit-on-preview coordinate picking, template crop / color pick, single-step test run.
• Runtime: live variables panel, hit markers on the preview, screenshot on failure, retry / repeat / until policies.
• Automation: global hotkeys (F6 run/stop, ESC stop), scheduler, and a monitor/trigger mode (run a task when an image/color appears) with tray icon.
• Correctness: multi-monitor + high-DPI aware coordinates.

Notes

• Windows only (uses Win32 for capture and SendInput).
• OCR's first run downloads PaddleOCR models (~100 MB).
• Some target windows may require running as administrator.

License

MIT