viet-text-tools 0.1.3

Functions for working with Vietnamese text

Functions for working with Vietnamese text

Installation

To get the latest stable release from PyPi

pip install viet_text_tools

Usage

normalize_diacritics()

You can normalize diacritics for a Vietnamese word. The return value is in composed (NFC) form

normalize_diacritics('nghìên') == 'nghiền'

Pass new_style=True to use new style tone placement

normalize_diacritics('thủy', new_style=True) == 'thuỷ'

Pass decomposed=True to return a string in decomposed (NFD) form

len(normalize_diacritics('thủy')) == 4
len(normalize_diacritics('thủy', decomposed=True)) == 5

vietnamese_sort_key()

A key function for use with sorted() to sort Vietnamese text with the correct collation order

words = ['anh', 'ba', 'áo', 'cắt', 'cá', 'cả']
sorted(words) == ['anh', 'ba', 'cá', 'cả', 'cắt', 'áo']
sorted(words, key=vietnamese_sort_key) == ['anh', 'áo', 'ba', 'cả', 'cá', 'cắt']