A Khmer word segmentation tool built for NIPTICT Khmer Word Segmentation CRF model.
Project description
Khmer Segment
A Khmer word segmentation tool built for NIPTICT (now CADT) Khmer Word Segmentation CRF model.
[!IMPORTANT]
km-5tag-seg-model
is required for this script to work. This library doesn't provide the model file.
Usage
pip install khmersegment
from khmersegment import Segmenter
segmenter = Segmenter("-m km-5tag-seg-model")
print(segmenter("Hello មិនដឹងប្រាប់អ្នកណាទេ?", deep=False))
# => ['Hello', ' ', 'មិន', 'ដឹង', 'ប្រាប់', 'អ្នកណា', 'ទេ', '?']
print(segmenter("Hello មិនដឹងប្រាប់អ្នកណាទេ?", deep=True))
# => ['Hello', ' ', 'មិន', 'ដឹង', 'ប្រាប់', 'អ្នក', 'ណា', 'ទេ', '?']
License
Apache-2.0
Related
- pycrfpp Python binding for CRF++
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
khmersegment-0.1.2.tar.gz
(7.0 kB
view hashes)