Skip to main content

droid-use

droid-use is a Python package for Android UI automation driven by screenshots, grounding, and ADB.

It focuses on two related workflows:

  • Direct Android device control through ADB helpers such as screenshot capture, tap, long press, swipe, text input, and key events.
  • Screenshot grounding that turns a natural-language instruction plus a phone screenshot into a concrete device action or bounding box, with visual overlays and evaluator feedback loops.

It also includes Airtest-oriented utilities so an AI agent can help write or refine Android automation scripts that rely on visual matching and OCR.

Main capabilities

  • ADB-backed Android interaction helpers
  • Screenshot-based coordinate grounding for taps, long presses, swipes, and bbox selection
  • Coordinate conversion helpers for pixel and normalized coordinate systems
  • Grounding orchestration with operator/evaluator loops and artifact logging
  • Airtest helper utilities for AI-authored automation scripts

Installation

pip install droid-use

For local development:

pip install -e .

Example

from droid_use import get_screenshot, interact_with_screen

get_screenshot("/tmp/screen.png")
result = interact_with_screen(
    "/tmp/screen.png",
    "点击底部中间的登录按钮",
    max_rounds=3,
)

print(result)

Airtest-oriented usage

The package also ships helper modules under droid_use.airtest_utils for workflows where an AI agent writes or edits Airtest-style Android automation scripts.

Metadata

Release files for droid-use 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for droid-use 0.1.0
File Size Uploaded Provenance Actions
droid_use-0.1.0.tar.gz 62.3 kB Without provenance Details for droid_use-0.1.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for droid-use 0.1.0
File Interpreter ABI Platform Actions
droid_use-0.1.0-py3-none-any.whl Python 3 none any Details for droid_use-0.1.0-py3-none-any.whl

Total release size: 124.1 kB

Release files / droid_use-0.1.0.tar.gz

Download URL droid_use-0.1.0.tar.gz
Size 62.3 kB
Tags Source
SHA-256 checksum
How to use checksums
628932a8f5f8f7ec0765deb6280969e97a87704bd62ddc3401dfab179deca828
BLAKE2b-256 checksum
How to use checksums
828e089816a1b76c2d6a393542ab4f60145632c1c49fccbe3d17d463284b6b22
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.3

Release files / droid_use-0.1.0-py3-none-any.whl

Download URL droid_use-0.1.0-py3-none-any.whl
Size 61.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
b4bf63eec6802edd93706fd5fe4aed9fd403365b9c146b95493fd4eda81818e9
BLAKE2b-256 checksum
How to use checksums
4b7f3d93c1d3e824c3a37894d2435e32edadaf36ee7b0854684aae2b44f77e6d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.3

Security for droid-use 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page