Qwen Realtime Plugin for Vision Agents
Qwen3 Realtime LLM integration for Vision Agents framework with native audio output and built-in speech recognition using WebSocket-based realtime communication.
Features
- Native audio output: No TTS service needed - audio comes directly from the model
- Built-in STT: Integrated speech-to-text using
gummy-realtime-v1- no external STT service required - Server-side VAD: Automatic turn detection with configurable silence thresholds
- Video understanding: Optional video frame support for multimodal interactions
- Real-time streaming: WebSocket-based bidirectional communication for low-latency responses
- Interruption handling: Automatic cancellation when user starts speaking
Installation
uv add "vision-agents[qwen]"
# or directly
uv add vision-agents-plugins-qwen
Usage
from vision_agents.core import User, Agent
from vision_agents.plugins import getstream, qwen
agent = Agent(
edge=getstream.Edge(),
agent_user=User(name="Qwen Assistant"),
instructions="Be helpful and friendly",
llm=qwen.Realtime(
model="qwen3-omni-flash-realtime",
voice="Cherry",
fps=1,
),
# No STT or TTS needed - Qwen Realtime provides both
)
Configuration
| Parameter | Description | Default | Accepted Values |
|---|---|---|---|
model |
Qwen Realtime model identifier | "qwen3-omni-flash-realtime" |
Model name string |
api_key |
DashScope API key | None (from env) |
String or None |
base_url |
WebSocket API base URL | "wss://dashscope-intl.aliyuncs.com/api-ws/v1/realtime" |
URL string |
voice |
Voice for audio output | "Cherry" |
Voice name string |
fps |
Video frames per second | 1 |
Integer |
include_video |
Include video frames in requests | False |
Boolean |
video_width |
Video frame width | 1280 |
Integer |
video_height |
Video frame height | 720 |
Integer |
Environment Variables
Set DASHSCOPE_API_KEY in your environment or .env file:
DASHSCOPE_API_KEY=your_dashscope_api_key_here
Example
See plugins/qwen/example/qwen_realtime_example.py for a complete working example.
Dependencies
- vision-agents
- websockets
- aiortc
- av
Metadata
Release files for vision-agents-plugins-qwen 0.6.9
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| vision_agents_plugins_qwen-0.6.9.tar.gz | 8.5 kB | Without provenance | Details for vision_agents_plugins_qwen-0.6.9.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| vision_agents_plugins_qwen-0.6.9-py3-none-any.whl | Python 3 | none | any | Details for vision_agents_plugins_qwen-0.6.9-py3-none-any.whl |
Total release size: 16.1 kB
Release files / vision_agents_plugins_qwen-0.6.9.tar.gz
| Download URL | vision_agents_plugins_qwen-0.6.9.tar.gz |
|---|---|
| Size | 8.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9de328f56b8ffc93896800aa2bef05cad0799c45858739e3a7779b28c787ae17
|
|
BLAKE2b-256 checksum How to use checksums |
7ca832576855643ef21178434f683479f4485e9c120a57f4525f1e4dd9e200ce
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.10 {"installer":{"name":"uv","version":"0.10.10","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Release files / vision_agents_plugins_qwen-0.6.9-py3-none-any.whl
| Download URL | vision_agents_plugins_qwen-0.6.9-py3-none-any.whl |
|---|---|
| Size | 7.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
f139d06ea68ab68ad62925a25be9c981bdc5a5f47015ced079cf01e20e2cee7f
|
|
BLAKE2b-256 checksum How to use checksums |
87fc8e7e1eb4ce7b4cd2736e3bc142f96a0fa074cc5a50cd501f9117cc8f4c36
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.10 {"installer":{"name":"uv","version":"0.10.10","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Security for vision-agents-plugins-qwen 0.6.9
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.