Light-weight sentence tokenizer for Japanese.
Project description
# ja-sentence
A light-weight sentence tokenizer for Japanese.
## Sample
from ja_sentence.tokenizer import tokenize
paragraph_str = “えー!?くれるの?本当にいいの…?嬉しい!!”
sentence_list = tokenize(input_str)
- for sentence in sentence_list:
print(sentence)
## Repository
The repository can be found at [https://github.com/Rairye/ja-sentence](https://github.com/Rairye/ja-sentence)
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ja_sentence-0.0.1.tar.gz
(2.1 kB
view hashes)