VAD-Enhanced ASR Framework for Researchers
Project description
Praasper
Praasper is a speech processing framework designed to help researchers transcribe audio files into word-level timestamps — from a single word to a complete sentence — with high accuracy in both transcription and timestamps.
In Praasper, the pipeline has four stages. First, long recordings are split at natural pauses via pause-aware chunking. Second, VAD (Praditor) performs coarse DBSCAN clustering followed by fine sliding-window boundary detection — automatically calibrated per file via a two-stage grid search (amp × eps_ratio → numValid refinement). Third, ASR (Fun-ASR-Nano) transcribes each VAD-bounded segment with word-level timestamps. Fourth, timestamps are aligned to VAD intervals by temporal overlap and exported as a Praat TextGrid file.
How to use
Here is one of the simplest examples:
import praasper
model = praasper.init_model()
model.annote("data_folder")
Here are the parameters you can pass to init_model and annote:
| Param | Default | Description |
|---|---|---|
infer_mode |
"local" |
ASR backend: "local" for on-device FunASR-Nano, "api" for DashScope cloud API. |
device |
"auto" |
Hardware for local inference: "auto", "cuda", or "cpu". Ignored in API mode. |
ASR |
FunAudioLLM/Fun-ASR-Nano-2512 | Advanced: override the default local ASR model. See FunASR model zoo. |
api_key |
None |
DashScope API key. Required when infer_mode="api". Can also be set via DASHSCOPE_API_KEY env var. |
cache_dir |
None |
Directory for caching ASR models. When set, HF_HOME / MODELSCOPE_CACHE / TRANSFORMERS_CACHE are redirected here. |
grid_search_effort |
"normal" |
Grid search level: "normal" (22 combos) or "high" (100 combos). "high" adds cutoff0 sweep and 0.05-step amp. Can be set on init_model and overridden per-run via annote(). |
input_path |
— | Path to the folder where audio files are stored. |
seg_dur |
15. | Segment large audio into pieces, in seconds. |
min_pause |
0.2 | Minimum pause duration between two utterances, in seconds. |
skip_existing |
False |
Skip files that already have an output .TextGrid. |
verbose |
False |
Print verbose progress messages during processing. |
Here are code examples showing how to use these parameters:
import praasper
# Local inference (default)
model = praasper.init_model()
# Local inference on GPU
model = praasper.init_model(device="cuda")
# DashScope cloud API
model = praasper.init_model(infer_mode="api", api_key="sk-...")
# Custom local ASR model (advanced)
model = praasper.init_model(ASR="iic/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch")
# High-effort grid search (100 combos, more thorough VAD calibration)
model = praasper.init_model(grid_search_effort="high")
model.annote(
input_path="data_folder",
min_pause=.8,
seg_dur=15.
)
Custom VAD Parameters
By default, Praasper automatically calibrates VAD parameters for each recording via a grid search — no manual tuning is required. For advanced users who need custom parameters, a dict or .txt file can be passed directly.
Parameters use the internal Praditor format: a dict with onset and offset sections, each containing amp, cutoff0, cutoff1, numValid, and eps_ratio. Praasper keeps onset and offset identical internally.
Here is a code example showing how to override the default parameters for a specific audio file. The VAD parameters are passed as a dict with onset and offset sections:
import praasper
model = praasper.init_model()
# Define custom VAD parameters
custom_params = {
"onset": {"amp": "1.05", "cutoff0": "60", "cutoff1": "10800", "numValid": "475", "eps_ratio": "0.05"},
"offset": {"amp": "1.05", "cutoff0": "60", "cutoff1": "10800", "numValid": "475", "eps_ratio": "0.05"},
}
model.annote(
input_path="data_folder",
params=custom_params,
)
Alternatively, save the parameters to a .txt file and pass the file path instead:
model.annote(
input_path="data_folder",
params="/path/to/custom_params.txt",
)
In both cases, Praasper will use your custom VAD parameters instead of running the auto grid search. To export the current parameters to a .txt file for later reuse:
model.export_params("/path/to/custom_params.txt")
ASR: local vs. cloud
Praasper supports two ASR backends, chosen via the infer_mode parameter:
infer_mode |
Backend | Best for |
|---|---|---|
"local" (default) |
FunASR-Nano — lightweight, runs on laptop CPU/GPU | Offline work, no API costs, privacy |
"api" |
DashScope (AliCloud) — cloud ASR with stronger accuracy | High-accuracy needs, server deployments |
Local mode (infer_mode="local")
model = praasper.init_model() # auto-detect GPU/CPU
model = praasper.init_model(device="cuda") # force GPU
model = praasper.init_model(device="cpu") # force CPU
The default model is FunAudioLLM/Fun-ASR-Nano-2512, which supports Chinese, English, and Japanese with word-level timestamps. Power users can swap in a different FunASR model via the ASR parameter.
API mode (infer_mode="api")
model = praasper.init_model(infer_mode="api", api_key="sk-...")
# or set DASHSCOPE_API_KEY environment variable:
# model = praasper.init_model(infer_mode="api")
Note: DashScope requires audio files to be hosted at a public URL (HTTP/HTTPS/OSS). Local file paths are not supported in API mode.
Mechanism
Praasper processes audio in four stages:
1. Pause-aware chunking. Long recordings are split into segments (default 15 s) at natural pauses detected by the VAD, placing boundaries at silence-gap midpoints. If no gap is found, the threshold relaxes until a boundary can be placed. This preserves utterance integrity across chunks.
2. Voice Activity Detection (VAD). Praasper uses Praditor, a DBSCAN-based detector. The first stage clusters the amplitude envelope to separate speech from silence into broad candidate segments. The second stage applies a sliding-window detector with locally estimated noise thresholds to place onset and offset boundaries at millisecond precision. By default, Praasper auto-calibrates per recording: a two-stage grid search selects the best parameters: Stage 1 sweeps amp (1.1–1.3) × eps_ratio (0.02–0.05) to maximise onset boundary SNR, then Stage 2 refines numValid (DBSCAN min points) around the winner. With grid_search_effort="high", the grid expands to 8 amp values (0.05 step) and a cutoff0 sweep [0, 200 Hz], totalling 100 combos. Manual tuning is available but not required.
3. Automatic Speech Recognition (ASR). Each VAD-bounded segment is transcribed by Fun-ASR-Nano, a lightweight model producing word-level timestamps. It supports Chinese (Mandarin and 7 dialects: Wu, Cantonese, Min, Hakka, Gan, Xiang, Jin), English, and Japanese. For higher accuracy, DashScope cloud ASR is available via infer_mode="api".
4. Overlap matching and export. ASR word timestamps are matched to VAD intervals by maximum temporal overlap. Unmatched words are assigned to the nearest interval by distance. Words in the same interval are concatenated; empty intervals are discarded. Adjacent overlapping intervals are merged. Processing runs in parallel (4 workers). Output is a Praat-compatible TextGrid file.
Advanced users can override the auto-calibration by supplying custom VAD parameters via a Python dict or .txt file (see Custom VAD Parameters).
Setup
pip installation
pip install -U praasper
If you have a successful installation and don't care about GPU acceleration, you can stop right here.
GPU Acceleration (Windows/Linux)
Currently, Praasper utilizes Fun-ASR-Nano from FunASR as the default local ASR engine. Cloud ASR is also available via DashScope (infer_mode="api").
FunASRautomatically detects the best currently available device to use. But you still need to first install the GPU-support version oftorchin order to enable CUDA acceleration.
- For macOS users, only
CPUis supported as the processing device. - For Windows/Linux users, the priority order should be:
CUDA->CPU.
If you have no experience in installing CUDA, follow the steps below:
First, go to command line and check the latest CUDA version your system supports:
nvidia-smi
Results should pop up like this (It means that this device supports CUDA up to version 12.9).
| NVIDIA-SMI 576.80 Driver Version: 576.80 CUDA Version: 12.9 |
Next, go to NVIDIA CUDA Toolkit and download the latest version, or whichever version that fits your system/need.
Lastly, install torch that fits your CUDA version. Find the correct pip command in this link.
Here is an example for CUDA 12.9:
pip install --force-reinstall torch torchaudio --index-url https://download.pytorch.org/whl/cu129
(Advanced) uv installation
uv is also highly recommended for a much faster installation. First, make sure uv is installed in your default environment:
pip install uv
Then, create a virtual environment (e.g., .venv):
uv venv .venv
You should see a new .venv folder appear in your project directory. (You may also want to restart the terminal.)
Lastly, install praasper (by prefixing pip with uv):
uv pip install -U praasper
For CUDA support, here is an example for downloading torch that fits CUDA 12.9:
uv pip install --force-reinstall torch torchaudio --index-url https://download.pytorch.org/whl/cu129
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file praasper-0.7.1.tar.gz.
File metadata
- Download URL: praasper-0.7.1.tar.gz
- Upload date:
- Size: 31.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9710d591cec7446bad71ebe3df4c9740640cd58c023c9bfe1e1044da4ee23198
|
|
| MD5 |
3b874ab8809484f7fc54876a83273724
|
|
| BLAKE2b-256 |
6d31b02cb6a94ad8588d475e39b2f1993dec63372aea1021cfc1a34817444a3a
|
File details
Details for the file praasper-0.7.1-py3-none-any.whl.
File metadata
- Download URL: praasper-0.7.1-py3-none-any.whl
- Upload date:
- Size: 29.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6e3860e7d44067ec648e83b2ef64c00ee76c40c90a417a10d1d646bc02e4e0a3
|
|
| MD5 |
c24aa5c060bf692d50dbdc6a6a770c47
|
|
| BLAKE2b-256 |
75015fb70e01800b4bbf85fcfa96dfe33e84472cec4a20bfc3d152bffef092f8
|