Skip to main content

Sudachi C Imitator Transformers

This package imitates Japanese morphological analysis of Sudachi SplitMode.C and SudachiDict-full with a small transformers model.
You can add tokenization and part-of-speech estimation to your environment
with only 4MB additoinal disk space if you already have transrofmers in your environment.

Installation

$ pip install sudachi_c_imitator_transformers

Usage Examples

>>> import sudachi_c_imitator_transformers
>>> tagger = sudachi_c_imitator_transformers.Tagger()
>>> sample_text = '使い方のサンプルです。'
>>> tagger.parse(sample_text)
[('使い方', '名詞'), ('の', '助詞'), ('サンプル', '名詞'), ('です', '助動詞'), ('。', '補助記号')]

Input string length must be 256 or less.

Release files for sudachi-c-imitator-transformers 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for sudachi-c-imitator-transformers 0.2.1
File Size Uploaded
sudachi_c_imitator_transformers-0.2.1.tar.gz 2.2 MB Details

Built distribution (wheel)

Table of built distributions (wheels) for sudachi-c-imitator-transformers 0.2.1
File Interpreter ABI Platform
sudachi_c_imitator_transformers-0.2.1-py3-none-any.whl Python 3 none any Details

Total release size: 4.3 MB

Release files / sudachi_c_imitator_transformers-0.2.1.tar.gz

Download URL sudachi_c_imitator_transformers-0.2.1.tar.gz
Size 2.2 MB
Tags Source
SHA-256 checksum
How to use checksums
227d4233c4afc1d5d2b0ed34da886a29b88c49f880d242a5d5ed2377901afd7a
BLAKE2b-256 checksum
How to use checksums
570784bf973093bfd37095bd679f9aee2ca2e15e9044739ccd3d339b1ef17860
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.8.10

Release files / sudachi_c_imitator_transformers-0.2.1-py3-none-any.whl

Download URL sudachi_c_imitator_transformers-0.2.1-py3-none-any.whl
Size 2.2 MB
Tags Python 3
SHA-256 checksum
How to use checksums
a5ec795ad2388c7c24a18039f76b15854107893d9a7447b430baafe935a2b7f3
BLAKE2b-256 checksum
How to use checksums
4976b72fa7ba056aa03609f3e00d9b9f77bf6253b2fb1e3e288bdba9a2ca2787
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.8.10

Release history Release notifications | RSS feed

This release

0.2.1 This release

2 release files

0.2.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page