Skip to main content

Krisp turn detection plugin for Vision Agents

Project description

Krisp Plugin

This plugin provides Krisp-based turn detection capabilities for Vision Agents using the Krisp Audio SDK.

Features

  • Turn Detection: Real-time detection of speaking turns using Krisp's turn-taking model
  • High Accuracy: Leverages Krisp's advanced audio processing for reliable turn detection
  • Configurable: Adjustable confidence thresholds and frame durations
  • Low Latency: Optimized for real-time conversational AI applications

Installation

pip install vision-agents-plugins-krisp

Note: This plugin requires the Krisp Audio SDK and a valid Krisp model file (.kef).

Usage

from vision_agents.plugins import krisp

# Create turn detector
turn_detector = krisp.TurnDetection(
    model_path="path/to/krisp-viva-tt-v1.kef",
    frame_duration_ms=15,
    confidence_threshold=0.5
)

# Start detection
turn_detector.start()

# Process audio
await turn_detector.process_audio(audio_data, user_id="user123")

# Stop detection
turn_detector.stop()

Configuration

  • model_path: Path to the Krisp model file (.kef)
  • frame_duration_ms: Duration of audio frames in milliseconds (10, 15, 20, 30, or 32)
  • confidence_threshold: Threshold for turn detection (0.0 to 1.0)

Requirements

  • Python 3.10+
  • krisp-audio SDK
  • vision-agents-core
  • Krisp model file

License

Apache-2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vision_agents_plugins_krisp-0.1.3.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vision_agents_plugins_krisp-0.1.3-py3-none-any.whl (4.7 kB view details)

Uploaded Python 3

File details

Details for the file vision_agents_plugins_krisp-0.1.3.tar.gz.

File metadata

File hashes

Hashes for vision_agents_plugins_krisp-0.1.3.tar.gz
Algorithm Hash digest
SHA256 e2c6b97b55eeaced4f99a83e68c27086f5695b990580bd8610741041809376e3
MD5 8729115612de6967a6a4f53587bcc7b3
BLAKE2b-256 2d3bfb4e202cc34eafa420bbcfcdb08bf6174a54575b2d23eceabd48498d306a

See more details on using hashes here.

File details

Details for the file vision_agents_plugins_krisp-0.1.3-py3-none-any.whl.

File metadata

File hashes

Hashes for vision_agents_plugins_krisp-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 7c627912fa9be3f5af55ae3dbf8bb0dca659fa9b6e05a10e994dca73e78b4be1
MD5 9c1d72c10b9cd7a2ddf608f98ec5d480
BLAKE2b-256 c36ec346b6a802e873a2ea9246bba3533763ed86ba94474a1c600b3b13965268

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page