a simple framework that can quickly build some basic NLP tasks
Project description
nlp-basictasks
nlp-basictasks是利用PyTorch深度学习框架所构建一个简单的库,旨在快速搭建模型完成一些基础的NLP任务,如分类、匹配、序列标注、语义相似度计算等。
整体架构
如上图,整体架构分为三个大模块:
- readers负责读取数据,不同的任务在readers中有不同的数据处理形式。不同任务的数据后处理代码也放在readers中。
- modules代表编码器,用来提取文本特征,主要包括BERT、LSTM、MLP。
- tasks根据任务的不同有相应的处理方式。(和readers中相应的数据处理方式对应)
安装
pip install --index-url https://pypi.org/project/ nlp-basictasks==0.2.2
or
git clone https://github.com/xianghuisun/nlp-basictasks.git
cd nlp-basictasks & python setup.py install
使用
notebooks中展示了用nlp-basictasks框架快速实现五个NLP常见任务,具体见:
参考
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
nlp-basictasks-0.2.2.tar.gz
(70.2 kB
view hashes)
Built Distributions
nlp_basictasks-0.2.2-py3.8.egg
(219.3 kB
view hashes)
nlp_basictasks-0.2.2-py3-none-any.whl
(101.0 kB
view hashes)
Close
Hashes for nlp_basictasks-0.2.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4db1a51535feb4af886cedcdc88e4e3c8d5d1ce9cb8842fb3b7b71be5dcae8db |
|
MD5 | 506b65c022feb5e239c8c3af7a8bd290 |
|
BLAKE2b-256 | eb0a4aa09017b83f321266123a99cf072c00307b724d0f79156606ab2cfc8e1e |