Skip to main content

A light-weight sentence tokenizer for Japanese.

Sample Code:

from ja_sentence.tokenizer import tokenize

paragraph_str = "えー!?くれるの?本当にいいの…?嬉しい!!"

sentence_list = tokenize(paragraph_str)

for sentence in sentence_list: print(sentence)

Metadata

Release files for ja-sentence 0.0.5

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for ja-sentence 0.0.5
File Size Uploaded
ja_sentence-0.0.5.tar.gz 2.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for ja-sentence 0.0.5
File Interpreter ABI Platform
ja_sentence-0.0.5-py3-none-any.whl Python 3 none any Details

Total release size: 5.7 kB

Release files / ja_sentence-0.0.5.tar.gz

Download URL ja_sentence-0.0.5.tar.gz
Size 2.5 kB
Tags Source
SHA-256 checksum
How to use checksums
c81eb0deafcbc3f4e8469de89ccd9023228cfc5488d7669e0f84a6bb98669e68
BLAKE2b-256 checksum
How to use checksums
412910e5e0b6dc4ad6778a1ab674b6b1fdf5f6bed277bc1d7bf4ccf6d38d3699
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.7.9

Release files / ja_sentence-0.0.5-py3-none-any.whl

Download URL ja_sentence-0.0.5-py3-none-any.whl
Size 3.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
cf379e3d1498f58648532bc625d530e350cb79036f000e3abc2fa028507cefb7
BLAKE2b-256 checksum
How to use checksums
cf0fc62609e6c77553632f4e8998c58b40d130814ee923979137720ebd6a3456
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.7.9

Release history Release notifications | RSS feed

This release

0.0.5 This release

2 release files

0.0.4

2 release files

0.0.3

2 release files

0.0.2

1 release file

0.0.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page