ming-tts-mnn

Zero-shot text-to-speech on the CPU, one command. This package runs Ming-3.0-tts-0.5B through MNN graphs converted from the released weights.

pip install ming-tts-mnn
ming-tts "傍晚的风从山口吹过来，远处的云慢慢染成了金色。" -o hello.wav

The first run downloads one precision tier (fp16 by default, ~2.9 GB including the shared assets) from HuggingFace and caches it; every later run is offline. The wheel itself is code only.

What you get

• 44.1 kHz output, Chinese and English, punctuation-aware sentence splitting.
• Zero-shot voice cloning: pass any 5–20 s wav plus its transcript.
• No GPU, no PyTorch, no ONNX Runtime — the whole model (LLM backbone, flow-matching head, aggregator, VAE encoder/decoder, CAM++ speaker encoder) runs on MNN.

int4 is shipped because it was asked for, not because it is the best trade: on a three-sentence paragraph it can loop and produce 40 s of audio instead of 13 s. If you want the small download, use int4mix.

Command line

# default voice: a bundled sample prompt (clones that speaker)
ming-tts "今天天气不错。" -o out.wav

# clone your own voice
ming-tts "今天天气不错。" --prompt-wav me.wav --prompt-text "这是我录音说的话。" -o out.wav

# no prompt at all: the model's own average voice
ming-tts "Hello from the other side." --no-prompt -o out.wav

# smallest download
ming-tts "今天天气不错。" -p int4mix

# download only, then run offline later
ming-tts --download-only -p int8

Useful flags: -l/--language (default: detected from the text), --cfg (2.0), --seed (0), --threads (MNN's default), --max-length (characters per fragment, 50), --source modelscope, --model-dir (use an already downloaded tree).

Python

from ming_tts_mnn import MingTTSMNN

tts = MingTTSMNN.from_pretrained("int8")          # downloads once, then cached
wav = tts.synthesize("傍晚的风从山口吹过来。")     # float32, 44.1 kHz
wav, info = tts.synthesize("今天天气不错。", return_info=True)

# voice cloning
wav = tts.synthesize("Read this in my voice.",
                     prompt_wav="me.wav",
                     prompt_text="这是我录音说的话。")

MingTTSMNN(model_dir, precision=...) skips the download when you already have the files (layout: assets/, tokenizer/, <precision>/*.mnn).

Speed

Measured on an Apple M5 Pro with 4 MNN threads: a 3–6 s Chinese sentence takes 1–2× its own duration (RTF 1.1–2.0), depending on how many autoregressive steps the stop head decides on. The flow-matching head dominates; int8/int4 buy memory, not much speed.

Files and cache

Weights come from yunfengwang/Ming-3.0-tts-0.5B-MNN (mirror: yunfeng/Ming-3.0-tts-0.5B-MNN on ModelScope). They live in the standard HuggingFace cache (~/.cache/huggingface/hub), so HF_HOME and HF_HUB_CACHE work as usual. Downloading int4 fetches only that tier plus the shared assets and tokenizer.

The int4mix tier is a mix of the int8 and int4 files; ask for it by name and both directories are fetched.

Notes

• The release stops an utterance when a learned stop head crosses 0.5. That decision is discrete and sensitive to accumulated rounding, so two runs that differ only in arithmetic can differ in length by a few tenths of a second — including the original's own fp32 vs bf16 runs.
• --temperature 0 (the default) still draws flow-matching noise; use --seed for reproducible output.
• 44.1 kHz mono, 16-bit wav. The model is MIT licensed; so is this port.

Links

• Converted weights: https://huggingface.co/yunfengwang/Ming-3.0-tts-0.5B-MNN
• Original model: https://huggingface.co/inclusionAI/Ming-3.0-tts-0.5B