Skip to main content

AgentDesk

Desktops for AI agents   :computer:
Explore the docs »

View Demo · Report Bug · Request Feature


AgentDesk provides full-featured desktop environments which can be programatically controlled by AI agents. Spin them up locally or in the cloud.

▶ Built on agentd a runtime daemon which exposes a REST API for interacting with the desktop.

▶ Implements the DeviceBay Protocol.

Installation

pip install agentdesk

Quick Start

from agentdesk import Desktop

# Create a desktop container
desktop = Desktop.docker()

# Launch the UI for it
desktop.view(background=True)

# Open a browser to Google
desktop.open_url("https://google.com")

# Take actions on the desktop
desktop.move_mouse(500, 500)
desktop.click()
img = desktop.take_screenshots()

Usage

Create a local desktop

from agentdesk import Desktop

desktop = Desktop.docker()
$ agentdesk create --provider docker

*requires docker

Create a remote desktop on Kubernetes

desktop = Desktop.kube()
$ agentdesk create --provider kube

View the desktop in the UI

desktop.view()
$ agentdesk view old_mckinny

*requires docker

List desktops

Desktop.find()
$ agentdesk get

Delete a desktop

Desktop.delete("old_mckinny")
$ agentdesk delete old_mckinny

Use the desktop

desktop.open_url("https://google.com")

coords = desktop.mouse_coordinates()

desktop.move_mouse(500, 500)

desktop.click()

desktop.type_text("What kind of ducks are in Canada?")

desktop.press_key('Enter')

desktop.scroll()

img = desktop.take_screenshots()

Processors

Process images to make them more accessible to LMMs.

Grid

Add a coordinate grid on top of the image

from agentdesk.processors import GridProcessor

img = desktop.take_screenshots()

processor = GridProcessor()
grid_img = processor.process_b64(img)

Community

Come join us on Discord.

Developing

Please open an issue before creating a PR.

Changes to the VM happen in agentd.

Metadata

Release files for agentdesk 0.2.137

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for agentdesk 0.2.137
File Size Uploaded
agentdesk-0.2.137.tar.gz 53.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for agentdesk 0.2.137
File Interpreter ABI Platform
agentdesk-0.2.137-py3-none-any.whl Python 3 none any Details

Total release size: 120.4 kB

Release files / agentdesk-0.2.137.tar.gz

Download URL agentdesk-0.2.137.tar.gz
Size 53.1 kB
Tags Source
SHA-256 checksum
How to use checksums
7c6ca663cfd5299cdd7eec4f5cf652ee99575dba5cf2c719a4645f0e044b7272
BLAKE2b-256 checksum
How to use checksums
9455e72660577f4b065823d1bcd81c888587ea20367d5dd0eafeaba092472c5e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.8.3 CPython/3.10.1 Darwin/24.3.0

Release files / agentdesk-0.2.137-py3-none-any.whl

Download URL agentdesk-0.2.137-py3-none-any.whl
Size 67.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
13fca16b2e0c4b71c6105d4fe1eab8c5297dc7eb8f0259d7e32abdd262857807
BLAKE2b-256 checksum
How to use checksums
72d0c2769b7f3ba4bfb4c72f522a0067b6e7139f4d186c00d8d38b3b8df7f71d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.8.3 CPython/3.10.1 Darwin/24.3.0

Release history Release notifications | RSS feed

This release

0.2.137 This release

2 release files

0.2.94

2 release files

0.2.93

2 release files

0.2.92

2 release files

0.2.91

2 release files

0.2.90

2 release files

0.2.89

2 release files

0.2.88

2 release files

0.2.87

2 release files

0.2.86

2 release files

0.2.85

2 release files

0.2.83

2 release files

0.2.82

2 release files

0.2.81

2 release files

0.2.80

2 release files

0.2.79

2 release files

0.2.78

2 release files

0.2.77

2 release files

0.2.76

2 release files

0.2.75

2 release files

0.2.74

2 release files

0.2.73

2 release files

0.2.72

2 release files

0.2.65

2 release files

0.2.64

2 release files

0.2.63

2 release files

0.2.62

2 release files

0.2.61

2 release files

0.2.60

2 release files

0.2.57

2 release files

0.2.56

2 release files

0.2.55

2 release files

0.2.54

2 release files

0.2.53

2 release files

0.2.52

2 release files

0.2.51

2 release files

0.2.50

2 release files

0.2.43

2 release files

0.2.42

2 release files

0.2.41

2 release files

0.2.40

2 release files

0.2.39

2 release files

0.2.38

2 release files

0.2.37

2 release files

0.2.36

2 release files

0.2.35

2 release files

0.2.34

2 release files

0.2.33

2 release files

0.2.32

2 release files

0.2.31

2 release files

0.2.30

2 release files

0.2.29

2 release files

0.2.28

2 release files

0.2.27

2 release files

0.2.9

2 release files

0.2.8

2 release files

0.2.7

2 release files

0.2.6

2 release files

0.2.5

2 release files

0.2.4

2 release files

0.2.3

2 release files

0.2.2

2 release files

0.2.1

2 release files

0.2.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page