A light-weight sentence tokenizer for Japanese.
Sample Code:
from ja_sentence.tokenizer import tokenize
paragraph_str = "えー!?くれるの?本当にいいの…?嬉しい!!"
sentence_list = tokenize(paragraph_str)
for sentence in sentence_list: print(sentence)
Metadata
Release files for ja-sentence 0.0.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| ja_sentence-0.0.5.tar.gz | 2.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| ja_sentence-0.0.5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 5.7 kB
Release files / ja_sentence-0.0.5.tar.gz
| Download URL | ja_sentence-0.0.5.tar.gz |
|---|---|
| Size | 2.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c81eb0deafcbc3f4e8469de89ccd9023228cfc5488d7669e0f84a6bb98669e68
|
|
BLAKE2b-256 checksum How to use checksums |
412910e5e0b6dc4ad6778a1ab674b6b1fdf5f6bed277bc1d7bf4ccf6d38d3699
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.7.9
|
Release files / ja_sentence-0.0.5-py3-none-any.whl
| Download URL | ja_sentence-0.0.5-py3-none-any.whl |
|---|---|
| Size | 3.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
cf379e3d1498f58648532bc625d530e350cb79036f000e3abc2fa028507cefb7
|
|
BLAKE2b-256 checksum How to use checksums |
cf0fc62609e6c77553632f4e8998c58b40d130814ee923979137720ebd6a3456
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.7.9
|