MaskGCT

MaskGCT is a zero-shot text-to-speech model using masked generative codec transformer from Amphion.

Installation

cd models/maskgct
just setup maskgct

Usage

from ttsdb_maskgct import MaskGCT

model = MaskGCT(model_id="ttsds/maskgct")
audio, sr = model.synthesize(
    text="Hello, world!",
    reference_audio="path/to/reference.wav",
    text_reference="Text spoken in the reference audio.",
    language="en"
)

Audio Examples

Generated audio samples from integration tests:

To regenerate examples, run:

just hf-weights-prepare maskgct  # Download weights first
just test-integration maskgct

Supported Languages

• English (en)
• Chinese (zh)
• Korean (ko)
• Japanese (ja)
• French (fr)
• German (de)

Citation

@article{wang2024maskgct,
  title={MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformer},
  author={Wang, Yuancheng and Zhan, Haoyue and Liu, Liwei and Zeng, Ruihong and Guo, Haotian and Zheng, Jiachen and Zhang, Qiang and Zhang, Xueyao and Zhang, Shunsi and Wu, Zhizheng},
  journal={arXiv preprint arXiv:2409.00750},
  year={2024}
}