agentdesk 0.2.1

A desktop for AI agents

AgentDesk

A desktop for AI agents.

Built on agentd to make desktop VMs accessible to AI agents.

Implements the ToolsV1 protocol

Installation

pip install agentdesk

Quick Start

from agentdesk import Desktop

desktop = Desktop.local()
desktop.view(background=True)

desktop.open_url("https://google.com")

desktop.move_mouse(500, 500)

desktop.click()

img = desktop.take_screenshot()

Usage

Create a local desktop

from agentdesk import Desktop

desktop = Desktop.local()

$ agentdesk create --provider qemu

*requires qemu

Create a remote desktop on GCE

desktop = Desktop.gce()

$ agentdesk create --provider gce

Create a remote desktop on EC2

desktop = Desktop.ec2()

$ agentdesk create --provider ec2

View the desktop in the UI

desktop.view()

$ agentdesk view old_mckinny

*requires docker

List desktops

Desktop.list()

$ agentdesk get

Delete a desktop

Desktop.delete("old_mckinny")

$ agentdesk delete old_mckinny

Use the desktop

desktop.open_url("https://google.com")

coords = desktop.mouse_coordinates()

desktop.move_mouse(500, 500)

desktop.click()

desktop.type_text("What kind of ducks are in Canada?")

desktop.press_key('Enter')

desktop.scroll()

img = desktop.take_screenshot()

Examples

GPT-4V provides a notebook using a desktop

Developing

Please open an issue before creating a PR.