FERN
Fern用于NLP的模型开发结构控制。通过它可以控制文本预处理、模型搭建、训练器:
- 文本预处理:数据下载、数据清洗、数据转换和数据分割
- 模型搭建:模型保存与加载、模型架构打印
- 模型训练:单步/epoch训练与评估、评估函数设置、损失函数设置、label权重设置
Fern的设计目的主要为了解决不同NLP工程中重复代码过多问题,减少流程性代码,从而避免数据交互过程中的随机bug出现
安装
-
从
pypi安装$ pip install Fern2
-
从源码安装
$ pip install -e git+https://github.com/Jasonsey/Fern.git
使用教程
建议查看源码中函数的使用说明
变量命名规则
为了方便定义,对容易分歧变量命名做如下约定:
-
对于数据变量,同类型变量书写规则:
data_train,data_vallabel_train,label_val
-
对于指标变量,同类型变量书写规则:
val_loss,val_acc,val_binary_acctrain_loss,train_acc
-
对于其他变量,按照
首先它属于a, 其次它属于b规则命名变量名:a_bpath_dataset
TODO
- BERT预训练模型直接调用
- BERT重现训练代码直接调用
版本变更日志
Metadata
Release files for Fern2 1.4.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| Fern2-1.4.1.tar.gz | 27.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| Fern2-1.4.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 60.4 kB
Release files / Fern2-1.4.1.tar.gz
| Download URL | Fern2-1.4.1.tar.gz |
|---|---|
| Size | 27.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a851e6849fa4025169c551d0849f0c7fda63aa6512e70cc04aa8d34c39bbb746
|
|
BLAKE2b-256 checksum How to use checksums |
892577a290f3c85fc27a5cf610d33a47afab8fa4275331b65322d5f4f20d87ed
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.3
|
Release files / Fern2-1.4.1-py3-none-any.whl
| Download URL | Fern2-1.4.1-py3-none-any.whl |
|---|---|
| Size | 33.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
af1396cc1fe99cafe2b0ce1a3776f2a02948fae73b889902a01de1d172bed41a
|
|
BLAKE2b-256 checksum How to use checksums |
ca232407cd2d4db261571b9966da66ad1993c69e6a077ecf8ac8396f046f595f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.3
|