Rust Extension For Language Technology Platform(Python).
Project description
LTP extension For Python
LTP for Rust 对 Python 的绑定,用于提升 LTP 的速度,以及加入传统机器学习算法实现的中文信息处理工具。
method | ltp 3.0(c++) | ap(1) | ap(8) | pa | pa-i(0.5) | pa-ii(0.5) |
---|---|---|---|---|---|---|
cws | 97.83 | 97.93 | 97.67 | 97.90 | 97.90 | 97.93 |
pos | 98.35 | 98.41 | 98.30 | 98.39 | 98.39 | 98.38 |
ner | 94.17 | 94.28 | 93.42 | 94.02 | 94.06 | 93.95 |
features
- 分句
- 任务
- 中文分词(cws)
- 对数字、英文、网址、邮件的处理
- 支持自定义词典
- 词性标注(pos)
- 支持自定义词典
- 命名实体识别(ner)
- 中文分词(cws)
- 算法
- 平均感知机(ap)
- 单线程平均感知机
- 多线程平均感知机
- 被动攻击算法(pa)
- 平均感知机(ap)
- 模型量化
- 在线学习
- 增量学习
Benchmark Compare with Jieba
- File Size: 33.85 MB
- Hard Ware:
- MacBook Pro (16-inch, 2019)
- 处理器: 2.6 GHz 六核Intel Core i7
- 内存: 16 GB 2667 MHz DDR4
- 图形卡: Intel UHD Graphics 630 1536 MB
Algorithm | Time(s) | Speed(KB/s) |
---|---|---|
Jieba cut | 35.29 | 982.49 |
LTP legacy(1) | 58.64 | 591.04 |
LTP legacy(2) | 30.64 | 1131.30 |
LTP legacy(4) | 17.14 | 2022.50 |
LTP legacy(8) | 11.39 | 3044.15 |
LTP legacy(16) | 9.88 | 3508.93 |
Benchmark Pipeline
- File Size: 33.85 MB
- Hard Ware:
- MacBook Pro (16-inch, 2019)
- 处理器: 2.6 GHz 六核Intel Core i7
- 内存: 16 GB 2667 MHz DDR4
- 图形卡: Intel UHD Graphics 630 1536 MB
Algorithm | Time(s) | Speed(KB/s) |
---|---|---|
LTP legacy(1) | 139.70 | 248.11 |
LTP legacy(2) | 75.18 | 461.04 |
LTP legacy(4) | 42.96 | 806.76 |
LTP legacy(8) | 29.34 | 1181.39 |
LTP legacy(16) | 26.28 | 1318.84 |
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ltp_extension-0.1.2.tar.gz
(85.1 kB
view hashes)
Built Distributions
Close
Hashes for ltp_extension-0.1.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 56fd38e0ae36e009f700341c68dc1fe44aa7f2b6e49e7be65030b2e233235c9c |
|
MD5 | f47046665d4b0e0ebc1717097f019350 |
|
BLAKE2b-256 | 15ce90c0f93c4f912a79607d547d9455898ed9cbf5e6d42635d4eb2c8c25b303 |
Close
Hashes for ltp_extension-0.1.2-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a21a9772ef1c723e57af7f60384fc9601082961e0fc53f11ed08d1db7955f555 |
|
MD5 | 06168024b780d6e6bd915502d480ff55 |
|
BLAKE2b-256 | b632d381530c89713242ba25bb0b9fcedb5e1d1a3c5df77ac015b9a64cb043a5 |
Close
Hashes for ltp_extension-0.1.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | da858686c7b91ee6303c43d0340297c5d4a7368e55d2e700b48eb5616016e932 |
|
MD5 | aa3e16d41f5c08423a2e0c33d041968d |
|
BLAKE2b-256 | e43e311195724bb4b09c85a0aec68a25197afa22004719fa1f631e702da93740 |
Close
Hashes for ltp_extension-0.1.2-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 88c5d2e018219d808ae90818376aafc4358a0e0c1606e20cfbb24ab9f221db9e |
|
MD5 | 988a11e0281f00182058652a2c79da25 |
|
BLAKE2b-256 | 7b02f936b1f5c8068443e1b124561902305c7a61a2ff0da2bc297546073b84d7 |
Close
Hashes for ltp_extension-0.1.2-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e2b9d05dbc42b6812c8cc938163861cb5729fe448f3ebe37b042913d5d1dd361 |
|
MD5 | f9ea0991be52bc251c47a7c9de404b5d |
|
BLAKE2b-256 | 5d0f8eabd422a9af898580c354c1fdc8a1289a7e488d6e8c9aa53e99fa59208b |
Close
Hashes for ltp_extension-0.1.2-cp310-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0e6f8fdae6415b27491e405ca4a3b9cb1724ee27717a33b2069d3f83bc9693d8 |
|
MD5 | 61688989de94e4bb23a7c9fabf249845 |
|
BLAKE2b-256 | 74ea847b13e112f72a0102ca931727a0057f500e477029133f66bee46c3f923a |
Close
Hashes for ltp_extension-0.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f09a0960a4dba5e70bb72de01ead4b41278ee0d91a85987ebc22f5671e83f344 |
|
MD5 | 10d558d56fca10fd0b31fee4d6e09c1e |
|
BLAKE2b-256 | 7d4dfa0ca633a2e5c9ab04cff4bcb17692570d25028c109adbac5aef1a38402e |
Close
Hashes for ltp_extension-0.1.2-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 05bc4e51619f22bc9ddac3c09cd93d3cffb0a8c4837f93927d508d4bafb56de2 |
|
MD5 | 3bd6a9861b04df3529940469db762969 |
|
BLAKE2b-256 | d4477dc67b01cb527cdd641abd6d12819380b8cedbe5086b8fd49a9e8d0384fd |
Close
Hashes for ltp_extension-0.1.2-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fd7f183bbc6f5c6322bebdead5323b2acd700f88f376f72c9cb58b646f9fd055 |
|
MD5 | be85d132471f3a85deca543cf8458f47 |
|
BLAKE2b-256 | 59beed83a063fe461a5d38f4cfd24b6ec388996c0a4ce4d79f76016619781efd |
Close
Hashes for ltp_extension-0.1.2-cp39-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7d11ecd3c567238c12074623934fc3d0f8a969e4db25914435126bceca400220 |
|
MD5 | 694d04198cbfb517eef9f7ca3fce53ce |
|
BLAKE2b-256 | 7775232d041060f85adc84c3ef8d64fe9eae1d89c7a836c6d65b7fa496ab70bd |
Close
Hashes for ltp_extension-0.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bd85dd00f2fc8386a89b61c11315d5e5d4439ddc2079b62d728a6d8c0cb21cfa |
|
MD5 | be314fec1000c5f2068ec96ffa77450c |
|
BLAKE2b-256 | 83a010bb467605d57d923b2f6f76dba8cf97ce905bbc412177c5d6bbfaf0bb56 |
Close
Hashes for ltp_extension-0.1.2-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 462115cc5a2a2fb2f8e6acd23906cc62e8fe07f93b149d949775b43dab813513 |
|
MD5 | 7e864633d6d52983c8636aa6690674fe |
|
BLAKE2b-256 | e80f03cf3c96a4a883367a67b35a629bf074c28060381a6ae4541b6094044b2e |
Close
Hashes for ltp_extension-0.1.2-cp39-cp39-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2cce88908645c048d21cc8ceedf0a716d1affb132dd55b80cd7e91ca0a02ea55 |
|
MD5 | 0213a278f87213cf0a87c7fccac06106 |
|
BLAKE2b-256 | 3caae5ed094633c033dd5e1eb4793d25225f4f0ad1273d53d1b05fba6eeefb4b |
Close
Hashes for ltp_extension-0.1.2-cp39-cp39-macosx_10_7_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d6ad5fa72d025cad27bf148e86c11431d74b1c9104bc5361fd1d5f7f6337304b |
|
MD5 | 549a8f1b3b6c64e6df82dfdc55d36b3f |
|
BLAKE2b-256 | 71714dc2f214e70ab71157e181561634127283287f70eb17f4f579cfb60340e8 |
Close
Hashes for ltp_extension-0.1.2-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bc197ea74230db61751533f49e0fcaf41f8c1ff3b96c4d40b136774c36b8d372 |
|
MD5 | 5b9865651a2ad262d38b24d38507b791 |
|
BLAKE2b-256 | f3f9f31195e6210c7f8519d214572c0a20c7a891eae73a08d52144f4f19ca560 |
Close
Hashes for ltp_extension-0.1.2-cp38-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 040c1111d9eee6b465d33a08df4e982ca4e41a75c20bffe19a24215c8b4c346f |
|
MD5 | c14fdeeb690aaf66da03646d672481ab |
|
BLAKE2b-256 | e65bf1df3939c7e9d4d04b9e5f2c4f0426d88ac7ee6866bf3c8a110d8f659032 |
Close
Hashes for ltp_extension-0.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1a71ed5527a5d335ce3afa80e59a986715e4e28a42560bd740029131f5a7e358 |
|
MD5 | 4f5305bccef996035b694959cacfe29a |
|
BLAKE2b-256 | 6dcfbe56b4eb71de547d96c06a37392a2fc3dd9d750450e57f25f67d33834f97 |
Close
Hashes for ltp_extension-0.1.2-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b17087c9d2541335186aff8f7af2db1fd586d9cf1600e4c59a32b49be24a1104 |
|
MD5 | ce14eea052221595c0bcbf5785dc1d07 |
|
BLAKE2b-256 | 62104a2af0e5ee08f6766e4d2d0513be1dd16a73fda705922be8c7743d43c594 |
Close
Hashes for ltp_extension-0.1.2-cp37-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e75708df2df7ea430833f904ad7d3e8aeda9efe58e60de38eb2735ae73605de3 |
|
MD5 | 735b6c1a536018bc8aa3df0fbb39560a |
|
BLAKE2b-256 | 67bfc96c9016d093d340b64b0ff48e2bfed9f80d313c7c551739b7015daa9acf |
Close
Hashes for ltp_extension-0.1.2-cp37-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7793abc654721db6642441f41f0b5cc58d3743d05f9083a680fa22fde1ff599b |
|
MD5 | 7851b55f7a8d2528048a777afd8df8f6 |
|
BLAKE2b-256 | cb5cb74ca00cb751d382c14d6027937014273d6017a52bc9bf178e4ead790082 |
Close
Hashes for ltp_extension-0.1.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e828bfe998931c0f3f03e9cf29387bf6b1b6734bc6af1eb278e1bee92ab68dd2 |
|
MD5 | 38c18dcbd4306fda5b5de0a9727b4f82 |
|
BLAKE2b-256 | 470e4337d714167ebc412de3bc48aceee6c56bbacfe3256dc64b91d8ed8495ee |
Close
Hashes for ltp_extension-0.1.2-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0882d381c3f5db3528479d211e26a801187aebfdd6e1e684c64cce1294c6c52c |
|
MD5 | 09b6a3dc23c8a80330060c193d49aa94 |
|
BLAKE2b-256 | a00c66d830910a91cffd23d85193518305de7c26034519ea709eadf5da241d06 |