Rust Extension For Language Technology Platform(Python).

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for SCIR from gravatar.com SCIR Avatar for ylfeng from gravatar.com ylfeng

Unverified details

These details have not been verified by PyPI
Project links
GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Meta

Author: ylfeng <ylfeng@ir.hit.edu.cn>

Tags ltp, nlp

Project description

LTP extension For Python

LTP for Rust 对 Python 的绑定，用于提升 LTP 的速度，以及加入传统机器学习算法实现的中文信息处理工具。

method ltp 3.0(c++) ap(1) ap(8) pa pa-i(0.5) pa-ii(0.5)
cws 97.83 97.93 97.67 97.90 97.90 97.93
pos 98.35 98.41 98.30 98.39 98.39 98.38
ner 94.17 94.28 93.42 94.02 94.06 93.95

features

  • 分句
  • 任务
    • 中文分词(cws)
      • 对数字、英文、网址、邮件的处理
      • 支持自定义词典
    • 词性标注(pos)
      • 支持自定义词典
    • 命名实体识别(ner)
  • 算法
    • 平均感知机(ap)
      • 单线程平均感知机
      • 多线程平均感知机
    • 被动攻击算法(pa)
  • 模型量化
  • 在线学习
  • 增量学习

Benchmark Compare with Jieba

  • File Size: 33.85 MB
  • Hard Ware:
    • MacBook Pro (16-inch, 2019)
    • 处理器: 2.6 GHz 六核Intel Core i7
    • 内存: 16 GB 2667 MHz DDR4
    • 图形卡: Intel UHD Graphics 630 1536 MB
Algorithm Time(s) Speed(KB/s)
Jieba cut 35.29 982.49
LTP legacy(1) 58.64 591.04
LTP legacy(2) 30.64 1131.30
LTP legacy(4) 17.14 2022.50
LTP legacy(8) 11.39 3044.15
LTP legacy(16) 9.88 3508.93

Benchmark Pipeline

  • File Size: 33.85 MB
  • Hard Ware:
    • MacBook Pro (16-inch, 2019)
    • 处理器: 2.6 GHz 六核Intel Core i7
    • 内存: 16 GB 2667 MHz DDR4
    • 图形卡: Intel UHD Graphics 630 1536 MB
Algorithm Time(s) Speed(KB/s)
LTP legacy(1) 139.70 248.11
LTP legacy(2) 75.18 461.04
LTP legacy(4) 42.96 806.76
LTP legacy(8) 29.34 1181.39
LTP legacy(16) 26.28 1318.84

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for SCIR from gravatar.com SCIR Avatar for ylfeng from gravatar.com ylfeng

Unverified details

These details have not been verified by PyPI
Project links
GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Meta

Author: ylfeng <ylfeng@ir.hit.edu.cn>

Tags ltp, nlp


Release history Release notifications | RSS feed

0.1.13

0.1.11

0.1.10

0.1.9

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

This version

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ltp_extension-0.1.0.tar.gz (82.2 kB view hashes)

Uploaded Source

Built Distributions

ltp_extension-0.1.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

ltp_extension-0.1.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl (2.2 MB view hashes)

Uploaded PyPy manylinux: glibc 2.12+ i686

ltp_extension-0.1.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

ltp_extension-0.1.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl (2.2 MB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.12+ i686

ltp_extension-0.1.0-cp310-none-win_amd64.whl (916.4 kB view hashes)

Uploaded CPython 3.10 Windows x86-64

ltp_extension-0.1.0-cp310-none-win32.whl (843.6 kB view hashes)

Uploaded CPython 3.10 Windows x86

ltp_extension-0.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

ltp_extension-0.1.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl (2.2 MB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.12+ i686

ltp_extension-0.1.0-cp310-cp310-macosx_10_7_x86_64.whl (1.1 MB view hashes)

Uploaded CPython 3.10 macOS 10.7+ x86-64

ltp_extension-0.1.0-cp39-none-win_amd64.whl (916.7 kB view hashes)

Uploaded CPython 3.9 Windows x86-64

ltp_extension-0.1.0-cp39-none-win32.whl (843.1 kB view hashes)

Uploaded CPython 3.9 Windows x86

ltp_extension-0.1.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

ltp_extension-0.1.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl (2.2 MB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.12+ i686

ltp_extension-0.1.0-cp39-cp39-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl (2.2 MB view hashes)

Uploaded CPython 3.9 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64

ltp_extension-0.1.0-cp39-cp39-macosx_10_7_x86_64.whl (1.1 MB view hashes)

Uploaded CPython 3.9 macOS 10.7+ x86-64

ltp_extension-0.1.0-cp38-none-win_amd64.whl (916.4 kB view hashes)

Uploaded CPython 3.8 Windows x86-64

ltp_extension-0.1.0-cp38-none-win32.whl (843.2 kB view hashes)

Uploaded CPython 3.8 Windows x86

ltp_extension-0.1.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

ltp_extension-0.1.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl (2.2 MB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.12+ i686

ltp_extension-0.1.0-cp37-none-win_amd64.whl (916.3 kB view hashes)

Uploaded CPython 3.7 Windows x86-64

ltp_extension-0.1.0-cp37-none-win32.whl (842.8 kB view hashes)

Uploaded CPython 3.7 Windows x86

ltp_extension-0.1.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

ltp_extension-0.1.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl (2.2 MB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.12+ i686

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page