Skip to main content

Krisp turn detection plugin for Vision Agents

Project description

Krisp Plugin

This plugin provides Krisp-based turn detection capabilities for Vision Agents using the Krisp Audio SDK.

Features

  • Turn Detection: Real-time detection of speaking turns using Krisp's turn-taking model
  • High Accuracy: Leverages Krisp's advanced audio processing for reliable turn detection
  • Configurable: Adjustable confidence thresholds and frame durations
  • Low Latency: Optimized for real-time conversational AI applications

Installation

pip install vision-agents-plugins-krisp

Note: This plugin requires the Krisp Audio SDK and a valid Krisp model file (.kef).

Usage

from vision_agents.plugins import krisp

# Create turn detector
turn_detector = krisp.TurnDetection(
    model_path="path/to/krisp-viva-tt-v1.kef",
    frame_duration_ms=15,
    confidence_threshold=0.5
)

# Start detection
turn_detector.start()

# Process audio
await turn_detector.process_audio(audio_data, user_id="user123")

# Stop detection
turn_detector.stop()

Configuration

  • model_path: Path to the Krisp model file (.kef)
  • frame_duration_ms: Duration of audio frames in milliseconds (10, 15, 20, 30, or 32)
  • confidence_threshold: Threshold for turn detection (0.0 to 1.0)

Requirements

  • Python 3.10+
  • krisp-audio SDK
  • vision-agents-core
  • Krisp model file

License

Apache-2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vision_agents_plugins_krisp-0.1.9.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vision_agents_plugins_krisp-0.1.9-py3-none-any.whl (4.7 kB view details)

Uploaded Python 3

File details

Details for the file vision_agents_plugins_krisp-0.1.9.tar.gz.

File metadata

File hashes

Hashes for vision_agents_plugins_krisp-0.1.9.tar.gz
Algorithm Hash digest
SHA256 b7831678b95ebe0476a257e64e834510326a50ee86e0057cc5adbc926e25b709
MD5 522cd8d3c8e98d7282e4aa36f06e352b
BLAKE2b-256 121963e346bd6eeb3abfcd3e2d254e72cc013a7cbb6c4342802ac82fcabbfbe7

See more details on using hashes here.

File details

Details for the file vision_agents_plugins_krisp-0.1.9-py3-none-any.whl.

File metadata

File hashes

Hashes for vision_agents_plugins_krisp-0.1.9-py3-none-any.whl
Algorithm Hash digest
SHA256 d780d1b8b28efcc7d97a6b328a42bf7efb1397d7b5aa6100a858a7048fda331d
MD5 0c5008aa571a5ccdbf3575c321a52fa8
BLAKE2b-256 fed2e9f55cd2c2d4b3dce2e0bc873c06881ad8fe879e3a9faba729361b5e3f74

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page