Light-weight sentence tokenizer for Japanese.
Project description
A light-weight sentence tokenizer for Japanese.
Sample Code:
from ja_sentence.tokenizer import tokenize
paragraph_str = “えー!?くれるの?本当にいいの…?嬉しい!!”
sentence_list = tokenize(input_str)
- for sentence in sentence_list:
print(sentence)
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ja_sentence-0.0.2.tar.gz
(2.0 kB
view hashes)