五艺(WuYi)
五艺是一个简易的中文自然语言处理工具
主要包括的功能有:中文分词、词性标注、情感分析、命名实体识别、关系抽取、关键词抽取、文本摘要、新词发现、文本聚类。
当前还在开发中。
安装
使用pip安装
pip install WuYi
中文分词
from wuyi import BasicTokenizer
tokenizer = BasicTokenizer()
text = "测试中文分词效果。"
tokens = tokenizer.tokenize(text=text)
print(tokens)
评价指标
from wuyi import ROUGE, BLEU
rouge = ROUGE()
bleu = BLEU()
hyp = "简单测试一下五艺的效果。"
ref = "测试是否能够正确输出。"
rouge_score = rouge.get_scores(hyp, ref, avg=True)
print(rouge_score)
bleu_score = bleu.get_scores(hyp, ref)
print(bleu_score)
开发进度
中文分词【未开始】
词性标注【未开始】
情感分析【未开始】
命名实体识别【未开始】
关系抽取【未开始】
关键词抽取【未开始】
文本摘要【未开始】
新词发现【未开始】
文本聚类【8.17开始】
数据评测指标【8.30开始】
文档结构
\examples 示例代码
\wuyi
\clustering 聚类算法[未完成]
kmeans.py K-Means算法[未完成]
\core 核心部分代码[未完成]
\tokenizers 分词部分代码[未完成]
BasicTokenizer.py 基础分词[完成]
\metric 指标部分代码[未完成]
BLEU.py bleu评测指标[完成]
ROUGE.py rouge评测指标[完成]
Metadata
Release files for WuYi 0.0.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| WuYi-0.0.6.tar.gz | 11.0 kB | Without provenance | Details for WuYi-0.0.6.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| WuYi-0.0.6-py3-none-any.whl | Python 3 | none | any | Details for WuYi-0.0.6-py3-none-any.whl |
Total release size: 25.2 kB
Release files / WuYi-0.0.6.tar.gz
| Download URL | WuYi-0.0.6.tar.gz |
|---|---|
| Size | 11.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c2c76b5e4e3bdb55d19e6fa673d216d4042bd9efebb6467da515ed0a153f5ec9
|
|
BLAKE2b-256 checksum How to use checksums |
323f3337f62291a032b0629c4c7358f88cd840839a216dcf6503fff2d786e86a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.9.6
|
Release files / WuYi-0.0.6-py3-none-any.whl
| Download URL | WuYi-0.0.6-py3-none-any.whl |
|---|---|
| Size | 14.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
856ed4e8c763cb045089c7d101eed34b6a06235c11102e1dbe25f3a08608fc08
|
|
BLAKE2b-256 checksum How to use checksums |
741ee1a25f7114278bd46b627a0490c722d4d5318686db1442b12e3be53bd760
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.9.6
|
Security for WuYi 0.0.6
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.