Skip to main content

Krisp turn detection plugin for Vision Agents

Project description

Krisp Plugin

This plugin provides Krisp-based turn detection capabilities for Vision Agents using the Krisp Audio SDK.

Features

  • Turn Detection: Real-time detection of speaking turns using Krisp's turn-taking model
  • High Accuracy: Leverages Krisp's advanced audio processing for reliable turn detection
  • Configurable: Adjustable confidence thresholds and frame durations
  • Low Latency: Optimized for real-time conversational AI applications

Installation

pip install vision-agents-plugins-krisp

Note: This plugin requires the Krisp Audio SDK and a valid Krisp model file (.kef).

Usage

from vision_agents.plugins import krisp

# Create turn detector
turn_detector = krisp.TurnDetection(
    model_path="path/to/krisp-viva-tt-v1.kef",
    frame_duration_ms=15,
    confidence_threshold=0.5
)

# Start detection
turn_detector.start()

# Process audio
await turn_detector.process_audio(audio_data, user_id="user123")

# Stop detection
turn_detector.stop()

Configuration

  • model_path: Path to the Krisp model file (.kef)
  • frame_duration_ms: Duration of audio frames in milliseconds (10, 15, 20, 30, or 32)
  • confidence_threshold: Threshold for turn detection (0.0 to 1.0)

Requirements

  • Python 3.10+
  • krisp-audio SDK
  • vision-agents-core
  • Krisp model file

License

Apache-2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vision_agents_plugins_krisp-0.1.0.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vision_agents_plugins_krisp-0.1.0-py3-none-any.whl (4.7 kB view details)

Uploaded Python 3

File details

Details for the file vision_agents_plugins_krisp-0.1.0.tar.gz.

File metadata

File hashes

Hashes for vision_agents_plugins_krisp-0.1.0.tar.gz
Algorithm Hash digest
SHA256 f5924a7f56619b1af2dc6af0d6be0da41e0f1ea51ec37ee42b7e770c3cbc86b4
MD5 1db6361bf08fd0114e427340c2dde007
BLAKE2b-256 90c1d112ff09eb6b9206a692f9d006b9813969d807962659b766e2a06946236d

See more details on using hashes here.

File details

Details for the file vision_agents_plugins_krisp-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for vision_agents_plugins_krisp-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 558967bb8861d16b9b57504dce073f97aff90d1e75a2e6cee0f6c28279cc9a5d
MD5 2dca8e3fe7f23368d309b6eb95568df9
BLAKE2b-256 77906cc21eb1467692cf8bd049618f9908cf74744ffae0d76ec8c3b8c18ffd6c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page