Skip to main content

Wrapper around pyautogui for automating mouse and keyboard - plus some new functions

Project description

pyrobogui Downloads

Wrapper around pyautogui - plus some new functions

Build on top of pyautogui but with some extra features:

  • timeouts,
  • setup,
  • aproximate match of images (install manually opencv and numpy if you need this feature),
  • can be oriented to a screen coordonate automation or screen images automation or both



pip install pyrobogui

If you are using MAC or Linux checkout pyautogui documentation on how to install tkinter.

Automate the boring stuff book


from pyrobogui import robo, pag

# use the robo.method() to do what you need 
# pag - is the pyautogui instance, if you need more barebones features

Mouse functions, 

Describing the parameters:
Put either:
  • image - path to image


  • x - coodonate number
  • y - coordonate number

Additionally you have:

  • offsetUp - make action up from the center specified
  • offsetDown - make action down from the center specified
  • offsetLeft - make action down from the center specified
  • offsetRight - make action down from the center specified
  • imageError - raise error when this image is found in screen while waiting for the image needed
  • timeout - if the seconds specified passes without the image needed to appear then raise error

These parameters are available for the bellow functions too:

  • rightClick
  • doubleClick
  • hover
  • dragTo

Scroll functions


Insert a number for the functions bellow (scroll is noticeable for values over 120)
  • scrollUp
  • scrollDown
  • scrollLeft
  • scrollRight

Keyboard functions

robo.write (text, 

  • text - the string to write on the center of the image or the coordinates specified

For a list of key names you can press check pyautogui documentation # Ex:"ctrl, c")
  • keys - the hotkeys you want to press, you can press max 3 keys (ex:"ctrl, alt, delete"))

Additional functions

Start setup to get the x,y coordinates and RGB color from the screen Useful when you want to start an automation process based on x,y coodinates(xy positions must be the same each time the process runs!)


Wait a number of seconds equivalent to > time.sleep(x)

robo.waitSeconds(5) #wait 5 seconds

Get coordinates of the image:

robo.getImageLocation(image, full_match=False)
  • image - image you need to find on screen
  • full_match - by default if will reduce the match if not found on screen down to 70%. If you set it to True it will try to find on screen an identical match size, colors etc.

Get to coordonates for the images needed.
You can count images of the same type on the screen from UP to DOWN, and LEFT to RIGHT.
robo.imageNeddle(image, imageNr='last') 

Useful for casses where you have images that look the same on the screen but they are positioned in different places.

For example let's say the you have a form with a lot of radio buttons and you want to click on the 5th radio button, you will do:

robo.imageNeddle("./img/radio_button.png", 5)

Also you the options for imageNr parameter:

  • imageNr=5 - returns the specified counted image
  • imageNr='last'
  • imageNr='first'
  • imageNr='all' - returns a list of image locations

Wait functions

robo.waitColorToAppear(xyrgb, imageError=None, timeout=1800) #ex:robo.waitColorToAppear("100, 200, 255, 255, 255") 
robo.waitColorToDisappear(xyrgb, imageError=None, timeout=1800)
  • xyrgb - a string like this "100, 200, 255, 255, 255"
  • imageError - if this image apprears on screen the function will stop
  • timeout - wait for the image to appear a specific number of seconds if that seconds pass then raise error
robo.waitImageToAppear(image, imageError=None, timeout=1800, full_match=False)
robo.waitImageToDisappear(image, imageError=None, timeout=1800, full_match=False)
  • image - image you need on screen
  • imageError - stop if this image is found
  • timeout - stop if takes too long time
  • full_match - by default if will aproximate the image on screen by 70% if you change it to True it will match it 100%

full_match - not on all PC's the rgb colors, image size are the same, they may vary a little; that's way full_match is False by default

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyrobogui-0.0.8.tar.gz (6.9 kB view hashes)

Uploaded source

Built Distribution

pyrobogui-0.0.8-py3-none-any.whl (7.5 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page