Skip to main content

NLP text processing toolkit for Deep Learning

Project description

FERN

Pypi

Fern用于NLP的模型开发结构控制。通过它可以控制文本预处理、模型搭建、训练器:

  1. 文本预处理:数据下载、数据清洗、数据转换和数据分割
  2. 模型搭建:模型保存与加载、模型架构打印
  3. 模型训练:单步/epoch训练与评估、评估函数设置、损失函数设置、label权重设置

Fern的设计目的主要为了解决不同NLP工程中重复代码过多问题,减少流程性代码,从而避免数据交互过程中的随机bug出现

安装

  1. pypi 安装

    $ pip install Fern2
    
  2. 从源码安装

    $ pip install -e git+https://github.com/Jasonsey/Fern.git
    

使用教程

建议查看源码中函数的使用说明

变量命名规则

为了方便定义,对容易分歧变量命名做如下约定:

  1. 对于数据变量,同类型变量书写规则:

    • data_train, data_val
    • label_train, label_val
  2. 对于指标变量,同类型变量书写规则:

    • val_loss, val_acc, val_binary_acc
    • train_loss, train_acc
  3. 对于其他变量,按照首先它属于a, 其次它属于b规则命名变量名:a_b

    • path_dataset

版本变更日志

CHANGE LOG

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Fern2-1.1.2.dev3.tar.gz (25.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

Fern2-1.1.2.dev3-py3-none-any.whl (30.3 kB view details)

Uploaded Python 3

File details

Details for the file Fern2-1.1.2.dev3.tar.gz.

File metadata

  • Download URL: Fern2-1.1.2.dev3.tar.gz
  • Upload date:
  • Size: 25.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.1 CPython/3.9.6

File hashes

Hashes for Fern2-1.1.2.dev3.tar.gz
Algorithm Hash digest
SHA256 c0cd52d4a4b8cfefd21aa629b0f4e990f71382214544009be927393d84295214
MD5 57d773bab9fb390b94e1f49bf8e1d1c2
BLAKE2b-256 4ca41b8943af4e3a30849be6a7557700d4d26d094098019e7a1405d03c7b33c7

See more details on using hashes here.

File details

Details for the file Fern2-1.1.2.dev3-py3-none-any.whl.

File metadata

  • Download URL: Fern2-1.1.2.dev3-py3-none-any.whl
  • Upload date:
  • Size: 30.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.1 CPython/3.9.6

File hashes

Hashes for Fern2-1.1.2.dev3-py3-none-any.whl
Algorithm Hash digest
SHA256 86600473fea5703977feaf46566bc20c99041fead11572b445cd021bace5a22b
MD5 2732007ab5c3ede8f0e9af42d5e276b5
BLAKE2b-256 12a5a01e4fbacfeebda0f59749e782d1a8045763eac659469728526bbb540073

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page