Light-weight sentence tokenizer for Korean.
Project description
A light-weight sentence tokenizer for Korean.
Half-width punctuation is generally used in Korean, but this tokenizer also supports full-width punctuation. (For details about full-width punctuation in Korean, please see https://www.w3.org/TR/klreq/).
Sample Code:
from kr_sentence.tokenizer import tokenize
paragraph_str = "저는 미국인이에요. 만나서 반갑습니다."
sentence_list = tokenize(paragraph_str)
for sentence in sentence_list: print(sentence)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kr_sentence-0.0.1.tar.gz
(2.7 kB
view hashes)
Built Distribution
Close
Hashes for kr_sentence-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bc71681ad8b41e17950cd97424a48ee5059a36acac9c99c99726f2793bc8c248 |
|
MD5 | bda426742b01e1d0a2cfcfbc93588c8c |
|
BLAKE2b-256 | a98d6c9cae0f365125a3fc352447314050163963100bef86cb4e118031066306 |