A lightweight, fast, and AI-powered custom wake word detection system.
Project description
VoxPulse - Custom Wake Word Detection Framework
VoxPulse is a lightweight, offline, and 100% private DIY custom wake-word detection library for Python. Instead of relying on pre-trained corporate wake words like "Alexa" or "Hey Siri", VoxPulse empowers developers to train their own voice assistants with any custom name, in any language!
Why VoxPulse? (Pros & Cons)
Pros (The Good Stuff)
- 100% Privacy: Everything runs locally on your machine. No internet required, no voice data is sent to the cloud.
- Auto-Data Pipeline: You just provide raw
.wavrecordings. VoxPulse automatically handles background noise mixing, time-stretching, pitch-shifting, and Mel-Spectrogram feature extraction. - CPU & Battery Efficient: Features RMS Silence Gating. The AI model goes to sleep when the room is silent (CPU usage drops to ~0%) and only triggers the neural network when someone speaks.
- Lightweight: Uses a custom 2D Convolutional Neural Network (CNN) compiled into TensorFlow Lite (
.tflite), making it blazing fast even on low-end hardware.
Cons (The Limitations)
- DIY Approach: Since it's a custom framework, there is no pre-trained model. You must spend 5 minutes recording your own voice and room noise to use it.
- Environment Sensitive: The accuracy heavily depends on the quality of the background noise (
negativedataset) you provide during training.
How to Use VoxPulse (Quick Start Guide)
Step 1: Install the Library
Install VoxPulse directly via pip:
pip install voxpulse
Step 2: Prepare Your Dataset
Create a folder named dataset in your project directory with two sub-folders:
- dataset/positive/ - Record and save 10-15 short
.wavfiles of you saying your custom wake word (e.g., "Hey Friday"). Keep them around 1 to 1.5 seconds long. - dataset/negative/ - Record a single 5-10 minute
.wavfile of your normal room background noise (fan sounds, typing, distant talking) and place it here.
Step 3: Train Your Custom Model
Create a python script (e.g., train.py) and run the auto-pipeline:
from voxpulse.model import VoxPulseTrainer
# This single command will automatically augment data, extract features, and train the CNN!
trainer = VoxPulseTrainer(dataset_dir="dataset")
trainer.train_and_export(epochs=20, export_name="my_custom_model.tflite")
Step 4: Run the Inference Engine
Once your .tflite model is generated, you can use it to trigger any Python function in real-time. Create run.py:
from voxpulse.inference import VoxPulseEngine
def trigger_my_action():
print("Custom Wake Word Detected! Executing action...")
# Add your automation code here (e.g., open Spotify, turn on lights)
# Load your newly trained model
engine = VoxPulseEngine(model_path="my_custom_model.tflite", threshold=0.70)
# Start listening in the background
engine.start_listening(on_detect_callback=trigger_my_action)
Under the Hood (Architecture)
VoxPulse abstracts away the complexity of audio machine learning. When you call the training function, it executes the following pipeline automatically:
graph TD
A[Raw Audio: dataset/positive] -->|Step 1: Auto-Augmentation| B[Pitch Shift & Time Stretch]
D[Background Noise: dataset/negative] -->|Mix Noise| B
B -->|Step 2: Mel-Spectrogram| C[Feature Matrices]
C -->|Step 3: CNN Training| E[Keras Sequential Model]
E -->|Step 4: Compilation| F[Lightweight TFLite Model]
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file voxpulse-1.0.1.tar.gz.
File metadata
- Download URL: voxpulse-1.0.1.tar.gz
- Upload date:
- Size: 10.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.10.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8f0c7e82e07a94acb17aa1ce24874d023fb6d0c828f1a1034879a86f0d4a9935
|
|
| MD5 |
0ada7807097653d6188ad85fb522f6db
|
|
| BLAKE2b-256 |
c3ecb3f759f27ffc7b414ac0d5fa47b7ba55a6f9ea6e95e34eba695a374c53e5
|
File details
Details for the file voxpulse-1.0.1-py3-none-any.whl.
File metadata
- Download URL: voxpulse-1.0.1-py3-none-any.whl
- Upload date:
- Size: 10.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.10.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f05cf86c219501051fa7be1d1598a08bf070d200dc20644c057c3d4c835f0964
|
|
| MD5 |
7cf55a47e5c857b7e92e6541b790491b
|
|
| BLAKE2b-256 |
2b69defbf0aa6d191f9ab97df78f67ee8173fbb3a6b8d701fe44f510c2689346
|