Light-weight sentence tokenizer for Korean.
Project description
A light-weight sentence tokenizer for Korean.
Half-width punctuation is generally used in Korean, but this tokenizer also supports full-width punctuation. (For details about full-width punctuation in Korean, please see https://www.w3.org/TR/klreq/).
Sample Code:
from kr_sentence.tokenizer import tokenize
paragraph_str = "저는 미국인이에요. 만나서 반갑습니다."
sentence_list = tokenize(paragraph_str)
for sentence in sentence_list: print(sentence)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kr_sentence-0.0.3.tar.gz
(2.7 kB
view hashes)
Built Distribution
Close
Hashes for kr_sentence-0.0.3-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 64d9073f5389f8d0a48afca2804ecad02ac609834e7c523ee0df5023a988f762 |
|
| MD5 | e11f294f4310b564b44c742cc03a7328 |
|
| BLAKE2b-256 | e0430496f75daed088f1ddd46f4b3dcde1bca9774871aa420101faee69945747 |
