Qwen Realtime Plugin for Vision Agents
Qwen3 Realtime LLM integration for Vision Agents framework with native audio output and built-in speech recognition using WebSocket-based realtime communication.
Features
- Native audio output: No TTS service needed - audio comes directly from the model
- Built-in STT: Integrated speech-to-text using
gummy-realtime-v1- no external STT service required - Server-side VAD: Automatic turn detection with configurable silence thresholds
- Video understanding: Optional video frame support for multimodal interactions
- Real-time streaming: WebSocket-based bidirectional communication for low-latency responses
- Interruption handling: Automatic cancellation when user starts speaking
Installation
uv add "vision-agents[qwen]"
# or directly
uv add vision-agents-plugins-qwen
Usage
from vision_agents.core import User, Agent
from vision_agents.plugins import getstream, qwen
agent = Agent(
edge=getstream.Edge(),
agent_user=User(name="Qwen Assistant"),
instructions="Be helpful and friendly",
llm=qwen.Realtime(
model="qwen3-omni-flash-realtime",
voice="Cherry",
fps=1,
),
# No STT or TTS needed - Qwen Realtime provides both
)
Configuration
| Parameter | Description | Default | Accepted Values |
|---|---|---|---|
model |
Qwen Realtime model identifier | "qwen3-omni-flash-realtime" |
Model name string |
api_key |
DashScope API key | None (from env) |
String or None |
base_url |
WebSocket API base URL | "wss://dashscope-intl.aliyuncs.com/api-ws/v1/realtime" |
URL string |
voice |
Voice for audio output | "Cherry" |
Voice name string |
fps |
Video frames per second | 1 |
Integer |
include_video |
Include video frames in requests | False |
Boolean |
video_width |
Video frame width | 1280 |
Integer |
video_height |
Video frame height | 720 |
Integer |
Environment Variables
Set DASHSCOPE_API_KEY in your environment or .env file:
DASHSCOPE_API_KEY=your_dashscope_api_key_here
Example
See plugins/qwen/example/qwen_realtime_example.py for a complete working example.
Dependencies
- vision-agents
- websockets
- aiortc
- av
2 maintainers
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file vision_agents_plugins_qwen-0.6.6.tar.gz.
File metadata
- Download URL: vision_agents_plugins_qwen-0.6.6.tar.gz
- Upload date:
- Size: 8.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.16 {"installer":{"name":"uv","version":"0.11.16","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
039910940c309965893d7192e9bc1b682949fc5568feda968a0b52f63d80c03c
|
|
| MD5 |
070b591301d622dc7007a50566f68601
|
|
| BLAKE2b-256 |
6500e1d118db20245c9e5cdfca1863c6b560903bf35592d646660c6a3a59248d
|
File details
Details for the file vision_agents_plugins_qwen-0.6.6-py3-none-any.whl.
File metadata
- Download URL: vision_agents_plugins_qwen-0.6.6-py3-none-any.whl
- Upload date:
- Size: 7.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.16 {"installer":{"name":"uv","version":"0.11.16","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6077a91dbced2dcada65d91e3e58ad7c12c013a5e03a41f0e7b8c83eb938be83
|
|
| MD5 |
1ead2a9af07626719bcb4171b93896c3
|
|
| BLAKE2b-256 |
17b2302ab0a600dcf487ea14ab595e037e7e2f4f7237dfcf0ab0911e8aeddb5c
|
