fasr-asr-paraformer

英文文档地址: README_EN.md

Paraformer 语音识别插件。离线模型返回带时间戳的 token，seaco_paraformer 额外支持热词偏置。

安装

pip install fasr-asr-paraformer

注册模型

流水线使用

from fasr import AudioPipeline

pipeline = (
    AudioPipeline()
    .add_pipe("detector", model="fsmn")
    .add_pipe(
        "recognizer",
        model="paraformer",
        batch_size=64,
        disable_log=True,
    )
    .add_pipe("sentencizer", model="ct_transformer")
)

热词识别使用 seaco_paraformer：

pipeline = (
    AudioPipeline()
    .add_pipe("detector", model="fsmn")
    .add_pipe("recognizer", model="seaco_paraformer")
    .add_pipe("sentencizer", model="ct_transformer")
)

audio = pipeline.run("meeting.wav", hotwords=["Paraformer", "fasr"])[0]

Confection 配置

[asr_model]
@asr_models = "paraformer"
batch_size = 64
device = "cuda:0"
disable_update = true
disable_log = true
disable_pbar = true

放在流水线里：

[pipeline]
@pipelines = "AudioPipeline.v1"
pipe_order = ["recognizer"]

[pipeline.pipes]

[pipeline.pipes.recognizer]
@pipes = "thread_pipe"
batch_size = 4

[pipeline.pipes.recognizer.component]
@components = "recognizer"

[pipeline.pipes.recognizer.component.model]
@asr_models = "paraformer"
batch_size = 64
device = "cuda:0"
disable_log = true
disable_pbar = true

单独使用

from fasr.config import registry

model = registry.asr_models.get("paraformer")(batch_size=64)
spans = model.transcribe(audio_spans)
for span in spans:
    print(span.text)
    for token in span.tokens or []:
        print(token.text, token.start_ms, token.end_ms)

参数

输出

• paraformer 和 seaco_paraformer 会填充 span.raw_text。
• 有时间戳时，span.tokens 中的 start_ms / end_ms 是 channel 绝对时间。
• 如果不传 device，模型会在检测到 CUDA 时自动选 cuda:0， 否则回退到 cpu 并给出提醒日志。
• seaco_paraformer 可通过 hotwords=[...] 传热词。

依赖

• fasr
• funasr
• Python 3.10-3.12