Skip to main content

dlk: Deep Learning Kit

Project description

A Deep Learning ToolKit

This project is WIP.

Read the Docs

Install

pip install dlk

or 
git clone this repo and do

python setup.py install

What's this?

  • Provide a templete for deep learning (especially for nlp) training and deploy.
  • Provide parameters search.
  • Provide basic architecture search.
  • Provide some basic modules and models.
  • Provide reuse the pretrained model for predict.

More Feature is Comming

  • Tasks support
    • NLP
      • Classification
      • Pair Classification
      • Regression
      • Pair Regression
      • Sequence Labeling
      • Span Classification
      • Relation Extraction
      • Token Rerank
      • MRC SQuAD
      • Translation
      • Summary
    • CV
      • Classification
  • Generate models.

  • Distill structure.

  • Ensemble models for NLU(and check how to do this in NLG)

  • Training Strategy

    • Adversarial Training(FGM/PGD/FreeLB)
    • Schedule Loss(you can control the loss schedule)
    • Schedule MultiTask Loss(you can control the loss schedule for each task)
    • Focal Loss
  • Online service by triton.

  • Data Augment.

  • Support LightGBM. Will split to another package.

  • Make most complexity modules like Beam Search, CRF to be scriptable.

  • Add UnitTest

    • Parser
    • Tokenizer
    • Config
    • Link

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dlk-0.0.16.tar.gz (150.0 kB view hashes)

Uploaded source

Built Distributions

dlk-0.0.16-py3.9.egg (599.6 kB view hashes)

Uploaded 0 0 16

dlk-0.0.16-py3.7.egg (599.5 kB view hashes)

Uploaded 0 0 16

dlk-0.0.16-py3-none-any.whl (315.1 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page