Qwen Realtime Plugin for Vision Agents
Qwen3 Realtime LLM integration for Vision Agents framework with native audio output and built-in speech recognition using WebSocket-based realtime communication.
Features
- Native audio output: No TTS service needed - audio comes directly from the model
- Built-in STT: Integrated speech-to-text using
gummy-realtime-v1- no external STT service required - Server-side VAD: Automatic turn detection with configurable silence thresholds
- Video understanding: Optional video frame support for multimodal interactions
- Real-time streaming: WebSocket-based bidirectional communication for low-latency responses
- Interruption handling: Automatic cancellation when user starts speaking
Installation
uv add "vision-agents[qwen]"
# or directly
uv add vision-agents-plugins-qwen
Usage
from vision_agents.core import User, Agent
from vision_agents.plugins import getstream, qwen
agent = Agent(
edge=getstream.Edge(),
agent_user=User(name="Qwen Assistant"),
instructions="Be helpful and friendly",
llm=qwen.Realtime(
model="qwen3-omni-flash-realtime",
voice="Cherry",
fps=1,
),
# No STT or TTS needed - Qwen Realtime provides both
)
Configuration
| Parameter | Description | Default | Accepted Values |
|---|---|---|---|
model |
Qwen Realtime model identifier | "qwen3-omni-flash-realtime" |
Model name string |
api_key |
DashScope API key | None (from env) |
String or None |
base_url |
WebSocket API base URL | "wss://dashscope-intl.aliyuncs.com/api-ws/v1/realtime" |
URL string |
voice |
Voice for audio output | "Cherry" |
Voice name string |
fps |
Video frames per second | 1 |
Integer |
include_video |
Include video frames in requests | False |
Boolean |
video_width |
Video frame width | 1280 |
Integer |
video_height |
Video frame height | 720 |
Integer |
Environment Variables
Set DASHSCOPE_API_KEY in your environment or .env file:
DASHSCOPE_API_KEY=your_dashscope_api_key_here
Example
See plugins/qwen/example/qwen_realtime_example.py for a complete working example.
Dependencies
- vision-agents
- websockets
- aiortc
- av
2 maintainers
Metadata
2 maintainers
Release files for vision-agents-plugins-qwen 0.6.9
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| vision_agents_plugins_qwen-0.6.9.tar.gz | 8.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| vision_agents_plugins_qwen-0.6.9-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 16.1 kB
Release files / vision_agents_plugins_qwen-0.6.9.tar.gz
| Download URL | vision_agents_plugins_qwen-0.6.9.tar.gz |
|---|---|
| Size | 8.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9de328f56b8ffc93896800aa2bef05cad0799c45858739e3a7779b28c787ae17
|
|
BLAKE2b-256 checksum How to use checksums |
7ca832576855643ef21178434f683479f4485e9c120a57f4525f1e4dd9e200ce
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.10 {"installer":{"name":"uv","version":"0.10.10","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Release files / vision_agents_plugins_qwen-0.6.9-py3-none-any.whl
| Download URL | vision_agents_plugins_qwen-0.6.9-py3-none-any.whl |
|---|---|
| Size | 7.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
f139d06ea68ab68ad62925a25be9c981bdc5a5f47015ced079cf01e20e2cee7f
|
|
BLAKE2b-256 checksum How to use checksums |
87fc8e7e1eb4ce7b4cd2736e3bc142f96a0fa074cc5a50cd501f9117cc8f4c36
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.10 {"installer":{"name":"uv","version":"0.10.10","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
