Smart Turn Detection Plugin
An AI-powered turn detection plugin for Vision Agents that uses the Smart Turn model to detect when a speaker has completed their turn in a conversation.
Overview
Smart Turn is an open-source, community-driven, native audio turn detection model that goes beyond simple Voice Activity Detection (VAD). It analyzes grammar, tone, pace of speech, and various other complex audio and semantic cues to determine when a user has finished speaking, matching human expectations more closely than VAD-based approaches.
For more information about the Smart Turn model, visit the official repository.
Installation
uv add "vision-agents[smart_turn]"
# or directly
uv add vision-agents-plugins-smart-turn
Usage
from vision_agents.plugins.smart_turn import TurnDetection
# Initialize with FAL API key from environment variable
turn_detector = TurnDetection()
# Or specify API key directly
turn_detector = TurnDetection(api_key="your_fal_api_key")
# Register event handlers
@turn_detector.on("turn_started")
def on_turn_started(event_data):
print(f"Turn started: {event_data.participant}")
@turn_detector.on("turn_ended")
def on_turn_ended(event_data):
print(f"Turn ended: {event_data.participant} (confidence: {event_data.confidence:.3f})")
# Start detection
turn_detector.start()
# Process audio
await turn_detector.process_audio(pcm_data, user_id="user123")
# Stop detection
turn_detector.close()
Configuration Options
api_key: FAL API key (default: reads from FAL_KEY environment variable)buffer_duration: Duration in seconds to buffer audio before processing (default: 2.0)confidence_threshold: Probability threshold for "complete" predictions (default: 0.5)sample_rate: Audio sample rate in Hz (default: 16000)channels: Number of audio channels (default: 1)
2 maintainers
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file vision_agents_plugins_smart_turn-0.6.9.tar.gz.
File metadata
- Download URL: vision_agents_plugins_smart_turn-0.6.9.tar.gz
- Upload date:
- Size: 7.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.10.10 {"installer":{"name":"uv","version":"0.10.10","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6d4868349a8de63073344b5120ce8d0e9286291f74f30f68df615631b5300771
|
|
| MD5 |
af276bb9c7017846deb39958f74126be
|
|
| BLAKE2b-256 |
aff40097ac34a498c50ca24a4f5d19956847d1bd011e47111c096f759f2cad5f
|
File details
Details for the file vision_agents_plugins_smart_turn-0.6.9-py3-none-any.whl.
File metadata
- Download URL: vision_agents_plugins_smart_turn-0.6.9-py3-none-any.whl
- Upload date:
- Size: 7.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.10.10 {"installer":{"name":"uv","version":"0.10.10","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d1e1e0c17a11c26b34a900c0d97f354902f6180e74bc11c8a7598e6c8ca1a4ac
|
|
| MD5 |
9c8fba7fa288d2ccb5d8c71464f01aeb
|
|
| BLAKE2b-256 |
9c7bad3b102252e6934af514a73de8fcd30f30b39beb9e8ee3349581bdce4338
|
