khmerspell 0.1.1

Khmer Spelling or Unicode Character Reordering based on the [khmer character specification](https://github.com/sillsdev/khmer-character-specification/blob/master/specification.md).

Khmer Spelling

Khmer Spelling or Unicode Character Reordering which corrects the ordering of Khmer unicode character by following the rule / specification in the khmer character specification.

Features

1. khnormal: Fixes Khmer Unicode Character ordering or incorrect spelling. This work is cloned from specification's python script.
2. ...

Installation

pip install khmerspell

Usage

To correct the spelling khmer text.

from khmerspell import khnormal

text = "ខ្ញំុជាស្រ្តីខ្មែរ" # wrong encoding ordering

encoded_text = khnormal(text)

print(encoded_text) # correct encoding ordering, according to the specification

Further more, you can print out each unicode character to see what has been changed, as following:

def get_hex_code_points(sentence):
    """
    Get the Unicode code points of each character in the token.
    """
    return [f"U+{ord(char):04X}" for char in sentence]

text = "ខ្ញំុជាស្រ្តីខ្មែរ"
# Print the text
print(text)

# Print unicode code of each character
print(get_hex_code_points(text))

# Encode the text
encoded_text = khnormal(text)

# Print the encoded text
print(encoded_text)

# Print the unicode code of each encoded character
print(get_hex_code_points(encoded_text))

Contribution

You are welcomed to contribute to this project so long as you abide by the license below. You can either create issues for us to fix or a PR for us to review.

License

Khmer Character Specification/Usages by SIL is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.