sea-g2p 0.6.2

Fast multilingual text-to-phoneme converter for South East Asian languages.

🦭 SEA-G2P

Fast multilingual text-to-phoneme converter for South East Asian languages.

Author: Pham Nguyen Ngoc Bao

🚀 Used By

SEA-G2P is the core phonemization engine powering:

• VieNeu-TTS: An advanced on-device Vietnamese Text-to-Speech model with instant voice cloning.

By using SEA-G2P, VieNeu-TTS achieves high-fidelity pronunciation and seamless Vietnamese-English code-switching.

Installation

pip install sea-g2p

Usage

Simple Pipeline

from sea_g2p import SEAPipeline

pipeline = SEAPipeline(lang="vi")
result = pipeline.run("Giá SP500 hôm nay là 4.200,5 điểm.")
print(result)
#zˈaːɜ ˈɛɜt̪ pˈe nˈam tʃˈam hˈom nˈaj lˌaː2 bˈoɜn ŋˈi2n hˈaːj tʃˈam fˈəɪ4 nˈam ɗˈiɛ4m.

Individual Modules

from sea_g2p import Normalizer, G2P

normalizer = Normalizer(lang="vi")
g2p = G2P(lang="vi")

text = "Giá SP500 hôm nay là 4.200,5 điểm"
normalized = normalizer.normalize(text)
print(normalized)
phonemes = g2p.convert(normalized)
print(phonemes)
#giá ét pê năm trăm hôm nay là bốn nghìn hai trăm phẩy năm điểm.
#zˈaːɜ ˈɛɜt̪ pˈe nˈam tʃˈam hˈom nˈaj lˌaː2 bˈoɜn ŋˈi2n hˈaːj tʃˈam fˈəɪ4 nˈam ɗˈiɛ4m.

Features

• Blazing Fast: Core engine rewritten in Rust with binary mmap lookup.
• Zero Dependency: Pre-compiled wheels for Windows, Linux, and macOS.
• Smart Normalization: Specialized for Vietnamese (numbers, dates, technical terms).
• Bilingual Support: Handles mixed Vietnamese/English text seamlessly.

📊 Performance

The following benchmarks were conducted on a dataset of 100,000 words (26,000+ lines):

Module	Language	Implementation	Throughput	Avg Time/Line
Normalizer	Vietnamese	Python	~39,000 words/s	0.09 ms
G2P	Multilingual	Rust Core	~480,000 words/s	0.007 ms

Total Pipeline Throughput: ~36,000 words/s (Tested on CPython 3.12, Windows 11)

Technical Architecture

SEA-G2P is designed for maximum performance in production environments:

• Memory Mapping (mmap): Instead of loading a huge JSON/SQLite into RAM, we use a custom binary format (.bin) mapped directly into memory. This allows near-instant startup and extremely low memory overhead.
• String Pooling: To minimize file size, all unique strings (words and phonemes) are stored once in a global string pool and referenced by 4-byte IDs.
• Binary Search: Words are pre-sorted during the build process, allowing O(log n) lookup speeds directly on the memory-mapped data.

For full details on the specification, see src/g2p/mod.rs.

Development

To install for development purposes:

1. Clone the repository:

   git clone https://github.com/pnnbao97/sea-g2p
   cd sea-g2p
   

2. Install in editable mode:

   pip install -e .