droid-use
droid-use is a Python package for Android UI automation driven by screenshots, grounding, and ADB.
It focuses on two related workflows:
- Direct Android device control through ADB helpers such as screenshot capture, tap, long press, swipe, text input, and key events.
- Screenshot grounding that turns a natural-language instruction plus a phone screenshot into a concrete device action or bounding box, with visual overlays and evaluator feedback loops.
It also includes Airtest-oriented utilities so an AI agent can help write or refine Android automation scripts that rely on visual matching and OCR.
Main capabilities
- ADB-backed Android interaction helpers
- Screenshot-based coordinate grounding for taps, long presses, swipes, and bbox selection
- Coordinate conversion helpers for pixel and normalized coordinate systems
- Grounding orchestration with operator/evaluator loops and artifact logging
- Airtest helper utilities for AI-authored automation scripts
Installation
pip install droid-use
For local development:
pip install -e .
Example
from droid_use import get_screenshot, interact_with_screen
get_screenshot("/tmp/screen.png")
result = interact_with_screen(
"/tmp/screen.png",
"点击底部中间的登录按钮",
max_rounds=3,
)
print(result)
Airtest-oriented usage
The package also ships helper modules under droid_use.airtest_utils for workflows where an AI agent writes or edits Airtest-style Android automation scripts.
Metadata
Release files for droid-use 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| droid_use-0.1.0.tar.gz | 62.3 kB | Without provenance | Details for droid_use-0.1.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| droid_use-0.1.0-py3-none-any.whl | Python 3 | none | any | Details for droid_use-0.1.0-py3-none-any.whl |
Total release size: 124.1 kB
Release files / droid_use-0.1.0.tar.gz
| Download URL | droid_use-0.1.0.tar.gz |
|---|---|
| Size | 62.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
628932a8f5f8f7ec0765deb6280969e97a87704bd62ddc3401dfab179deca828
|
|
BLAKE2b-256 checksum How to use checksums |
828e089816a1b76c2d6a393542ab4f60145632c1c49fccbe3d17d463284b6b22
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.3
|
Release files / droid_use-0.1.0-py3-none-any.whl
| Download URL | droid_use-0.1.0-py3-none-any.whl |
|---|---|
| Size | 61.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b4bf63eec6802edd93706fd5fe4aed9fd403365b9c146b95493fd4eda81818e9
|
|
BLAKE2b-256 checksum How to use checksums |
4b7f3d93c1d3e824c3a37894d2435e32edadaf36ee7b0854684aae2b44f77e6d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.3
|
Security for droid-use 0.1.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.