vinorm

Install ViNorm package

pip install vinorm

Using in python script

from vinorm import TTSnorm
S=TTSnorm("Hàm này được phát triển từ 8/2019. Có phải tháng 12/2020 đã có vaccine phòng ngừa Covid-19 xmz ?")

Some option

TTSnorm(text, punc = False, unknown = True, lower = True, rule = False )

lower: If true, get normalization with lowercase
rule: If true, just get normalization wit Regex, not using Dictionary Checking (this flag is not used with another flag)
punc: If true, do not replace punctuation with dot and coma
unknown: If true, replace unknown word, discard word undefine and do not contain vowel, do not spell word with vowel

From version 2.0, do not replace unknown words, skip them for espeak handle in phonetization step

This version does not parse case: "Tổ chức WTO" WTO do not in dictionary -> unknow -> keep origin, do not spell as in version 1.0, this aim to use with espeak, let espeak handle, but the drawback is the output of espeak for this case is "ve1kɛɜpte1ɔ7", it does not split each syllable.
For new entity, need to update in the dictionary

For version 1.0: spell words that is unknow by each character, check previous commit

python setup.py sdist bdist_wheel
twine upload dist/*

Metadata

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution for vinorm 2.0.7
File	Size	Uploaded
vinorm-2.0.7.tar.gz	40.2 MB	Dec 24, 2020	Details

Table of built distributions (wheels) for vinorm 2.0.7
File	Interpreter	ABI	Platform	Reset
vinorm-2.0.7-py3-none-any.whl 40.4 MB Dec 24, 2020	Python 3	none	any	Details

Total release size: 80.5 MB

Download URL	vinorm-2.0.7.tar.gz
Size	40.2 MB
Tags	Source
SHA-256 checksum How to use checksums	`1ec35ce3bbc5259c64e56537d07512787aad55648e0d6063404f8efc96f993a8`
BLAKE2b-256 checksum How to use checksums	`9c3c764745fe4737ff8313ebf3d1bfe25d437a8577cb1fa9a3478f2c485e9b0f`
Upload date	Dec 24, 2020
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/3.2.0 pkginfo/1.6.1 requests/2.25.1 setuptools/51.0.0.post20201207 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.7.1`

Download URL	vinorm-2.0.7-py3-none-any.whl
Size	40.4 MB
Tags	Python 3
SHA-256 checksum How to use checksums	`822d28bdd181480ddbe30caf1746fb79e904fea1bdb31d52274e766704779ed1`
BLAKE2b-256 checksum How to use checksums	`af2c1c75ac16ad68cc8c25e535d5c78353abe74dbdb083a2075397484ea8cbbb`
Upload date	Dec 24, 2020
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/3.2.0 pkginfo/1.6.1 requests/2.25.1 setuptools/51.0.0.post20201207 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.7.1`