中文錯誤類型文字增量
Project description
中文錯誤類型文字增量
安裝
pip install zh-mistake-text-aug
使用 (Pipeline)
from zh_mistake_text_aug import Pipeline
import random
random.seed(7)
pipeline = Pipeline()
augs = pipeline("中文語料生成")
for aug in augs:
print(aug)
type='MissingWordMaker' correct='中文語料生成' incorrect='中文料生成' incorrect_start_at=2 incorrect_end_at=2 span='語'
type='MissingVocabMaker' correct='中文語料生成' incorrect='語料生成' incorrect_start_at=0 incorrect_end_at=2 span='中文'
type='PronounceSimilarWordMaker' correct='中文語料生成' incorrect='中文語尥生成' incorrect_start_at=3 incorrect_end_at=3 span='尥'
type='PronounceSameWordMaker' correct='中文語料生成' incorrect='諥文語料生成' incorrect_start_at=0 incorrect_end_at=0 span='諥'
type='PronounceSimilarVocabMaker' correct='中文語料生成' incorrect='鍾文語料生成' incorrect_start_at=0 incorrect_end_at=2 span='鍾文'
type='PronounceSameVocabMaker' correct='中文語料生成' incorrect='中文预料生成' incorrect_start_at=2 incorrect_end_at=4 span='预料'
type='RedundantWordMaker' correct='中文語料生成' incorrect='成中文語料生成' incorrect_start_at=0 incorrect_end_at=0 span='成'
type='MistakWordMaker' correct='中文語料生成' incorrect='谁文語料生成' incorrect_start_at=0 incorrect_end_at=0 span='谁'
可用方法
from zh_mistake_text_aug.data_maker import ...
Data Maker | Description |
---|---|
MissingWordMaker | 隨機缺字 |
MissingVocabMaker | 隨機缺詞 |
PronounceSimilarWordMaker | 隨機相似字替換 |
PronounceSimilarWordPlusMaker | 編輯距離找發音相似並且用高頻字替換 |
PronounceSimilarVocabMaker | 發音相似詞替換 |
PronounceSameWordMaker | 發音相同字替換 |
PronounceSameVocabMaker | 發音相同詞替換 |
RedundantWordMaker | 隨機複製旁邊一個字作為沆於字 |
MistakWordMaker | 隨機替換字 |
MistakeWordHighFreqMaker | 隨機替換高頻字 |
MissingWordHighFreqMaker | 隨機刪除高頻字 |
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for zh-mistake-text-aug-0.1.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8724b198d3806359765012961a4827fd1477c561df6964262e99dfa5c8e80e35 |
|
MD5 | 3ad98036e7f5ea59cb32c1e29c778144 |
|
BLAKE2b-256 | ed858e6c4c9c59bf0c3d31d1f658e044132593bb2eaad14226bdc3b562eec181 |
Close
Hashes for zh_mistake_text_aug-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 089d810336446db8f47441c646892ae618db78520a916e56e8f1eb4ac5b5c3c1 |
|
MD5 | 9b6946c5969dec9f68944d3e5a74e25d |
|
BLAKE2b-256 | d6de781e1ba461defee8122a323f6a04318cdfbbadcfeb01c15553b5e6aa8056 |