Skip to main content

Krisp turn detection plugin for Vision Agents

Project description

Krisp Plugin

This plugin provides Krisp-based turn detection capabilities for Vision Agents using the Krisp Audio SDK.

Features

  • Turn Detection: Real-time detection of speaking turns using Krisp's turn-taking model
  • High Accuracy: Leverages Krisp's advanced audio processing for reliable turn detection
  • Configurable: Adjustable confidence thresholds and frame durations
  • Low Latency: Optimized for real-time conversational AI applications

Installation

pip install vision-agents-plugins-krisp

Note: This plugin requires the Krisp Audio SDK and a valid Krisp model file (.kef).

Usage

from vision_agents.plugins import krisp

# Create turn detector
turn_detector = krisp.TurnDetection(
    model_path="path/to/krisp-viva-tt-v1.kef",
    frame_duration_ms=15,
    confidence_threshold=0.5
)

# Start detection
turn_detector.start()

# Process audio
await turn_detector.process_audio(audio_data, user_id="user123")

# Stop detection
turn_detector.stop()

Configuration

  • model_path: Path to the Krisp model file (.kef)
  • frame_duration_ms: Duration of audio frames in milliseconds (10, 15, 20, 30, or 32)
  • confidence_threshold: Threshold for turn detection (0.0 to 1.0)

Requirements

  • Python 3.10+
  • krisp-audio SDK
  • vision-agents-core
  • Krisp model file

License

Apache-2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vision_agents_plugins_krisp-0.1.8.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vision_agents_plugins_krisp-0.1.8-py3-none-any.whl (4.7 kB view details)

Uploaded Python 3

File details

Details for the file vision_agents_plugins_krisp-0.1.8.tar.gz.

File metadata

File hashes

Hashes for vision_agents_plugins_krisp-0.1.8.tar.gz
Algorithm Hash digest
SHA256 e576aadceeef758966ce9740ab222124fc4f4b1bd19f93a6031ee1040e41f3c8
MD5 290e9491b289ea46b1acb6a3a782c6f8
BLAKE2b-256 fc46525c211a435401c901ec9a5ec8c69494e12f5e7fcb4db688db5e23ab0a3f

See more details on using hashes here.

File details

Details for the file vision_agents_plugins_krisp-0.1.8-py3-none-any.whl.

File metadata

File hashes

Hashes for vision_agents_plugins_krisp-0.1.8-py3-none-any.whl
Algorithm Hash digest
SHA256 aa7c3fd6eebaf072ac6a979fa5d09613c3cf5fad3e5faf606d1a6345448bc2a4
MD5 e931cbd559fd4e2eb90ca4ff192d58de
BLAKE2b-256 e03c1145058c4e5ad22e1688bd737b01441f18ff49ca7d0c1055ce062a7490b5

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page