cua-agent is a general Computer-Use framework with liteLLM integration for running agentic workflows on macOS, Windows, and Linux sandboxes. It provides a unified interface for computer-use agents across multiple LLM providers with advanced callback system for extensibility.
Features
- Safe Computer-Use/Tool-Use: Using Computer SDK for sandboxed desktops
- Multi-Agent Support: Anthropic Claude, OpenAI computer-use-preview, UI-TARS, Omniparser + any LLM
- Multi-API Support: Take advantage of liteLLM supporting 100+ LLMs / model APIs, including local models (
huggingface-local/,ollama_chat/,mlx/) - Cross-Platform: Works on Windows, macOS, and Linux with cloud and local computer instances
- Extensible Callbacks: Built-in support for image retention, cache control, PII anonymization, budget limits, and trajectory tracking
Install
pip install "cua-agent[all]"
Quick Start
import asyncio
import os
from agent import ComputerAgent
from computer import Computer
async def main():
# Set up computer instance
async with Computer(
os_type="linux",
provider_type="cloud",
name=os.getenv("CUA_CONTAINER_NAME"),
api_key=os.getenv("CUA_API_KEY")
) as computer:
# Create agent
agent = ComputerAgent(
model="anthropic/claude-3-5-sonnet-20241022",
tools=[computer],
only_n_most_recent_images=3,
trajectory_dir="trajectories",
max_trajectory_budget=5.0 # $5 budget limit
)
# Run agent
messages = [{"role": "user", "content": "Take a screenshot and tell me what you see"}]
async for result in agent.run(messages):
for item in result["output"]:
if item["type"] == "message":
print(item["content"][0]["text"])
if __name__ == "__main__":
asyncio.run(main())
Docs
- Agent Loops
- Supported Agents
- Supported Models
- Chat History
- Callbacks
- Custom Tools
- Custom Computer Handlers
- Prompt Caching
- Usage Tracking
- Benchmarks
License
MIT License - see LICENSE file for details.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
cua_agent-0.4.31.tar.gz
(102.4 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
cua_agent-0.4.31-py3-none-any.whl
(127.1 kB
view details)
File details
Details for the file cua_agent-0.4.31.tar.gz.
File metadata
- Download URL: cua_agent-0.4.31.tar.gz
- Upload date:
- Size: 102.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
001896301c9a6710ac3b62f705b599a31b2d1b56f9fbb08eb3b55a410c5b37ff
|
|
| MD5 |
ac4e96ed85dc4b1f3b4cf21f75676b70
|
|
| BLAKE2b-256 |
a7344935641295874a7aff5fe47068afe1c0c557cd71632f43de6d868fbd56c6
|
File details
Details for the file cua_agent-0.4.31-py3-none-any.whl.
File metadata
- Download URL: cua_agent-0.4.31-py3-none-any.whl
- Upload date:
- Size: 127.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
468059d6257d41811a69bbe7dadc410c61d373239fcb233e703fe00c2c30e92a
|
|
| MD5 |
5f20b847b6c6dbce47587b3ac5dec877
|
|
| BLAKE2b-256 |
aba8e32b605a1393440a0bceaaf029c7b92e0e5f993d80f09d2880249e0c450e
|