Sudachi B Imitator Transformers
This package imitates Japanese morphological analysis of Sudachi SplitMode.B and SudachiDict-full with a small transformers model.
You can add tokenization and part-of-speech estimation to your environment
with only 4MB additoinal disk space if you already have transrofmers in your environment.
Installation
$ pip install sudachi_b_imitator_transformers
Usage Examples
>>> import sudachi_b_imitator_transformers
>>> tagger = sudachi_b_imitator_transformers.Tagger()
>>> sample_text = '使い方のサンプルです。'
>>> tagger.parse(sample_text)
[('使い方', '名詞'), ('の', '助詞'), ('サンプル', '名詞'), ('です', '助動詞'), ('。', '補助記号')]
Input string length must be 256 or less.
1 maintainer
Release files for sudachi-b-imitator-transformers 0.2.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| sudachi_b_imitator_transformers-0.2.1.tar.gz | 2.2 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| sudachi_b_imitator_transformers-0.2.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 4.3 MB
Release files / sudachi_b_imitator_transformers-0.2.1.tar.gz
| Download URL | sudachi_b_imitator_transformers-0.2.1.tar.gz |
|---|---|
| Size | 2.2 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
d7c9b95370a085f122349565c7e57319861f052318830637ad76e41e0fda6ce9
|
|
BLAKE2b-256 checksum How to use checksums |
5f59dece2f7aac880596ad62d27f5f9a2df464df9cdb47310f760359f3e1b6ea
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.8.10
|
Release files / sudachi_b_imitator_transformers-0.2.1-py3-none-any.whl
| Download URL | sudachi_b_imitator_transformers-0.2.1-py3-none-any.whl |
|---|---|
| Size | 2.2 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
f7315b3383ad61f04bc4ece25c4e8d1578ea53acce0c4abb3ab5e85e1beb6643
|
|
BLAKE2b-256 checksum How to use checksums |
45fbacc121febff6e39eefdaa0c84579f7d0440889934f09580df074289ac3af
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.8.10
|
