📌 简介
nlhappy致力于复现自然语言处理各类任务的SOTA模型(不包含LLM相关任务)。
文档地址:
它主要的依赖有
- transformers: 下载预训练权重
- pytorch-lightning: 模型训练
- datasets: 构建数据集
- pydantic: 数据校验
📌 支持NLP任务
- 实体抽取
- 嵌套实体抽取
- 非连续实体抽取
- 关系抽取
- 事件抽取
- 文本单标签分类
- 文本多标签分类
- 阅读理解
- 文本对分类
- 文本对相似度(文本向量化)
📌 安装
安装nlhappy
推荐先去pytorch官网安装pytorch和对应cuda
# pip 安装
pip install --upgrade pip
pip install --upgrade nlhappy
其他可选
推荐安装wandb用于可视化训练日志
- 安装:
pip install wandb
- 注册: https://wandb.ai/
- 获取认证: https://wandb.ai/authorize
- 登陆:
wandb login
- 使用
# 命令行训练
nlhappy datamodule=xxx model=xxx trainer=xxx logger=wandb
模型训练开始后去官网查看训练实况
Metadata
Release files for nlhappy 2024.5.7
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| nlhappy-2024.5.7.tar.gz | 90.4 kB | Without provenance | Details for nlhappy-2024.5.7.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| nlhappy-2024.5.7-py3-none-any.whl | Python 3 | none | any | Details for nlhappy-2024.5.7-py3-none-any.whl |
Total release size: 246.1 kB
Release files / nlhappy-2024.5.7.tar.gz
| Download URL | nlhappy-2024.5.7.tar.gz |
|---|---|
| Size | 90.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e873705aaa62e24f83b011ce4cece722f413b5e85af9f25f404472ff4c5b617f
|
|
BLAKE2b-256 checksum How to use checksums |
9bd0d007cff6ecc55ef6ea057162cb8e47636481e8c2d365fe5d33f2a2e98b48
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.7.1 CPython/3.10.10 Linux/4.4.0-62-generic
|
Release files / nlhappy-2024.5.7-py3-none-any.whl
| Download URL | nlhappy-2024.5.7-py3-none-any.whl |
|---|---|
| Size | 155.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
72aff368fe6d7fb5ffadeff4650b88f7941b7967b9ca24fc36356481d5ae2410
|
|
BLAKE2b-256 checksum How to use checksums |
838392867138113bdf53720bc6d91f2dd27143f3a01abbd897d2cc3625de8055
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.7.1 CPython/3.10.10 Linux/4.4.0-62-generic
|
Security for nlhappy 2024.5.7
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.