Rust Extension For Language Technology Platform(Python).
Project description
LTP extension For Python
LTP for Rust 对 Python 的绑定,用于提升 LTP 的速度,以及加入传统机器学习算法实现的中文信息处理工具。
method | ltp 3.0(c++) | ap(1) | ap(8) | pa | pa-i(0.5) | pa-ii(0.5) |
---|---|---|---|---|---|---|
cws | 97.83 | 97.93 | 97.67 | 97.90 | 97.90 | 97.93 |
pos | 98.35 | 98.41 | 98.30 | 98.39 | 98.39 | 98.38 |
ner | 94.17 | 94.28 | 93.42 | 94.02 | 94.06 | 93.95 |
features
- 分句
- 任务
- 中文分词(cws)
- 对数字、英文、网址、邮件的处理
- 支持自定义词典
- 词性标注(pos)
- 支持自定义词典
- 命名实体识别(ner)
- 中文分词(cws)
- 算法
- 平均感知机(ap)
- 单线程平均感知机
- 多线程平均感知机
- 被动攻击算法(pa)
- 平均感知机(ap)
- 模型量化
- 在线学习
- 增量学习
Benchmark Compare with Jieba
- File Size: 33.85 MB
- Hard Ware:
- MacBook Pro (16-inch, 2019)
- 处理器: 2.6 GHz 六核Intel Core i7
- 内存: 16 GB 2667 MHz DDR4
- 图形卡: Intel UHD Graphics 630 1536 MB
Algorithm | Time(s) | Speed(KB/s) |
---|---|---|
Jieba cut | 35.29 | 982.49 |
LTP legacy(1) | 36.33 | 954.08 |
LTP legacy(2) | 19.41 | 1786.08 |
LTP legacy(4) | 10.74 | 3228.71 |
LTP legacy(8) | 7.07 | 4904.05 |
LTP legacy(16) | 5.89 | 5880.19 |
Benchmark Pipeline
- File Size: 33.85 MB / 305041 lines
- Hard Ware:
- MacBook Pro (16-inch, 2019)
- 处理器: 2.6 GHz 六核Intel Core i7
- 内存: 16 GB 2667 MHz DDR4
- 图形卡: Intel UHD Graphics 630 1536 MB
Algorithm | Time(s) | Speed(KB/s) |
---|---|---|
LTP legacy(1) | 90.66 | 382.33 |
LTP legacy(2) | 49.43 | 701.23 |
LTP legacy(4) | 27.98 | 1238.76 |
LTP legacy(8) | 20.11 | 1723.72 |
LTP legacy(16) | 16.99 | 2040.26 |
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ltp_extension-0.1.3.tar.gz
(85.3 kB
view hashes)
Built Distributions
Close
Hashes for ltp_extension-0.1.3-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a61c9ca749bd5a0d0bf41e423239c47c0aa7ad9f962686136d6cd53de1ec5a5b |
|
MD5 | 339d98706e2bec19200ccbc7cf1ff1ed |
|
BLAKE2b-256 | 7cbe8da836fc626e0e3b483d706c006ecb81702c7eacd8e9b86520f2df351440 |
Close
Hashes for ltp_extension-0.1.3-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2f209955c24ab9325e0b6964b44aa5644953e5812ed38af1c4ff6b6660ed3262 |
|
MD5 | abce2afcd80c8d337bcacaf252da8b6e |
|
BLAKE2b-256 | 47031d1cf6248f61d04ab8f2c755a65608d938cf988ed1ca52b0ef19090fa79f |
Close
Hashes for ltp_extension-0.1.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 191def89df483863efa9ae77099865dae4e70bec4ddedbf62f8e0953568662d4 |
|
MD5 | fcd61d017d65088769c0350c8c762185 |
|
BLAKE2b-256 | a66e8f20de15fcd6402b4ffade68a19f33e301f8332fbd7f832c0415c09023f7 |
Close
Hashes for ltp_extension-0.1.3-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 49d442b6fbf42bd2194010b68674100a13b422b6f058ad3e2ba9c6203ec97659 |
|
MD5 | 69b580746bfcc901955a6b7d729c6784 |
|
BLAKE2b-256 | 30b22e147ef9f495d00a8667a93064f12c13a14b4b7dcb2904bbd6da5bdece87 |
Close
Hashes for ltp_extension-0.1.3-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | acd412447d0b07b448865bff602cf2d13baeb77bd9d1acac18209759235d8f19 |
|
MD5 | 6da194154c2d9ddddf54e0945f22cc52 |
|
BLAKE2b-256 | cb5934a8369a2549ea2c14022a4b0391b7228db08a014b5d92fef9037b68c546 |
Close
Hashes for ltp_extension-0.1.3-cp310-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1f872164f092eccb182bc797b0a3141ba472371cb08c1d3f8ef7e58f9ba20a4e |
|
MD5 | 91b2ea071434330dc086f3806d5c94ab |
|
BLAKE2b-256 | 56a68dca42113578a1f687a7c4812e8258f539765dde0f49895ac307e7ead625 |
Close
Hashes for ltp_extension-0.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4be18d92ff9e48da3bf6bc629e2f836df3359dab565c66adec97682ad9ec4b09 |
|
MD5 | b136dd1c196e8b1cee58ec4dbcd47ddd |
|
BLAKE2b-256 | f2265a4e21c2a75debeb48fa8c9f4ed3caf7d3772b56c1c278a3759716ef6ae5 |
Close
Hashes for ltp_extension-0.1.3-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3fea3c66fce0d5e1fab573fe59aaede43a3d9cd8fc68937cd299dbfa6eedcc09 |
|
MD5 | d23bde0bca3196fe75db318d8cedaa9d |
|
BLAKE2b-256 | 89c2181cea314f5b261b12a424c9809b05a45efac485946f800ef9790618728b |
Close
Hashes for ltp_extension-0.1.3-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2a8cc8bb1c2dfe9cecda561323003f1164527cd3403e898a347a3e8cb1912747 |
|
MD5 | fbbccbb54d7464a21f013b0622f97570 |
|
BLAKE2b-256 | a61bd0203385feb87f0ba2240db10f6795ab768b7851aa45a98d443c93f75bbb |
Close
Hashes for ltp_extension-0.1.3-cp39-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 706fadfc92fb350ccd0171e5227bef50e25d817354896bd305ea89a48149d16d |
|
MD5 | 45dbe3ecf170c3b2df5f5c08d4be06c8 |
|
BLAKE2b-256 | d62778b304deaa8981912867869aa157ac8a71809e7ea12229831e31cb451a16 |
Close
Hashes for ltp_extension-0.1.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | aac7e650e516efc6c68da33406785e7e655780c92f174b3650fdf90eadfa8a4b |
|
MD5 | fa4cec64d003d8c8e468ac3b6cd0afa4 |
|
BLAKE2b-256 | 1c5e9681a1c366cf71a227c919dc1b282aba0f2d000d4397e641d5047b62d0e9 |
Close
Hashes for ltp_extension-0.1.3-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 55e9be0c9d934cf31a18f4fbf7b351d9b954ba81a8a0d3f7630a44ecce273a18 |
|
MD5 | b88a10d27a763136b96972d210cd17e2 |
|
BLAKE2b-256 | 685ba1cb826551f36ad16b52b98458df4403f209589150397234ea3e253fff88 |
Close
Hashes for ltp_extension-0.1.3-cp39-cp39-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b256e6833420c3b7f9cad794eae1d41abcb73d0e42321902d6022a8b2de946b4 |
|
MD5 | b39ecfbbdd00d56b4908cf5bd2589266 |
|
BLAKE2b-256 | b8e8c232203f025ac27aed53eb62fc5ff64d6db6d42b54d345271f727b08a082 |
Close
Hashes for ltp_extension-0.1.3-cp39-cp39-macosx_10_7_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4951704742b6ee5634a0a865212e5a1473da0b0bf8a3be53bb79544a5ee01449 |
|
MD5 | a7e7a56bc386e1280972dadb27432714 |
|
BLAKE2b-256 | b9238ed92cc467696e8c380bcd32ab96212bebea69096e0301bb98778dc018f6 |
Close
Hashes for ltp_extension-0.1.3-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9e5cdde0ddf4af009fb082cb2632506c5ac8fd9987824f92249b00fc64c86d72 |
|
MD5 | 895a666e3e498923f4c70cd7bd7d0cc6 |
|
BLAKE2b-256 | 502645675dab0d6c38ee9214d626b709f55eb76aafbaca9afd22af473124f424 |
Close
Hashes for ltp_extension-0.1.3-cp38-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b7723991c4e49c711f01e61883d1342ea3a323baf396af32dbc4c6959b16af61 |
|
MD5 | b531dc1b59b3cd75be55c0415cc7fd47 |
|
BLAKE2b-256 | 3e6fe42fbe054314927bdd7bd838f5cf807d4fb965a7727447e45f4b74fc1622 |
Close
Hashes for ltp_extension-0.1.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 94f622604c5b67d7997384eacb5eff3b8fbd2b8903e33f305ff70de138ae50dc |
|
MD5 | e7bd5f2b1cc663e342d591d4043d6448 |
|
BLAKE2b-256 | 078f6f115271f060cba88a189a5b74ee8316bf269d4e748425750199fcff80e7 |
Close
Hashes for ltp_extension-0.1.3-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8b8d43554ffb85585d6088cc17a42df70ada7305450f9cf7e58e4bae940b0415 |
|
MD5 | baae389f467f6e19f09112d58a706181 |
|
BLAKE2b-256 | bd746ad58244778602cb637a1175216db2a91e910675768f688d780e4a3d6f69 |
Close
Hashes for ltp_extension-0.1.3-cp37-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 417c68377a1e28c4e2e4f3ac0bfe0d32924a8f0396669eedf0eed2d21fbcc528 |
|
MD5 | 405e2dd4a76863dab0a3515c923bf3c5 |
|
BLAKE2b-256 | 2d035c4fa691f6f8649cb6c6b80b78114c2efaf8303b03e0a71e1918a7f45376 |
Close
Hashes for ltp_extension-0.1.3-cp37-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ac408678fa2b75c749a9f4fbf5b6b6020ab16d74746ebbcde561d4ba7816914a |
|
MD5 | bc3d22d225070c8c7bf81c0c3f0deb48 |
|
BLAKE2b-256 | 37efce1cd9e1359c967a1e4eaa3117ec1ecc9dc8d7a14d183e1d143975b76fe6 |
Close
Hashes for ltp_extension-0.1.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 99a6097e2993504b0ed53915be5841b22c22561a57875f23cb45352549544e2f |
|
MD5 | 175c3754331876dbb131a6eda30ba833 |
|
BLAKE2b-256 | 6ab05aeebf9cf8ff6e0970701edf8d7cab9ead3cb65c36ff3b0c2d0a029e7cb4 |
Close
Hashes for ltp_extension-0.1.3-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9fe87467779997a5e5252bed64b900f3fa5fcfbd1fac944527cf58845c4828d9 |
|
MD5 | 1d55343476f58fc7873482398ded37d2 |
|
BLAKE2b-256 | 210a75b99ded24acddb89d7f71303abb4747019cf590a662f7877b93812ed9c8 |