chinormfilter
Filter synonym written in lucene format to avoid duplication with Sudachi normalization. Mainly used when migrating to sudachi analyzer.
Usage
$ chinormfilter tests/test.txt -o out.txt
filtered result is following.
レナリドミド,レナリドマイド
リンゴ => 林檎
飲む,呑む
tlc => tlc,全肺気量
リンたんぱく質,リン蛋白質,リンタンパク質
↓ filter
レナリドミド,レナリドマイド
tlc => tlc,全肺気量
Specify system dict
$ chinormfilter tests/test.txt -s full -o out.txt
Use Custom Dict
Specify dict via sudachi.json
$ chinormfilter tests/test.txt -s sudachi.json -o out.txt
TODO
- custom dict test
1 maintainer
Metadata
1 maintainer
Release files for chinormfilter 0.5.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| chinormfilter-0.5.3.tar.gz | 6.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| chinormfilter-0.5.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 13.2 kB
Release files / chinormfilter-0.5.3.tar.gz
| Download URL | chinormfilter-0.5.3.tar.gz |
|---|---|
| Size | 6.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
67fcfe6c5d191dcf505a3d7d73292b01f3da696a3933c1f4395bb5baead34f63
|
|
BLAKE2b-256 checksum How to use checksums |
5ea225954bab0cecbcb149f9cd0fa6d15caa108b40bb8b3cb5a1627e25f06109
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.4
|
Release files / chinormfilter-0.5.3-py3-none-any.whl
| Download URL | chinormfilter-0.5.3-py3-none-any.whl |
|---|---|
| Size | 7.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
28b181d50d78bfb94e8c3fbe39038ef47cff4c889f6ba3d2a9fe3ef8451a8380
|
|
BLAKE2b-256 checksum How to use checksums |
017ee134bd54901bd904dd5dde58e45ffe3cc801732c184b6973faac0f543a67
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.4
|
