Skip to main content

A description of your project

Project description

FastHugs

Training HuggingFace models using fastai

Install

pip install git+git://github.com/aikindergarten/fasthugs.git

How to use

Pre-training

Masked Language modeling

Fine-tuning

  1. Sentiment classification: IMDB
  2. GLUE benchmark
  3. Machine Translation
  4. Summarization
  5. Multiple Choice
  6. Token Classification

Hyper-parameter search

W&B sweeps

And more coming soon...

Acknoledgements

This library is lightweight wrapper for this two awesome libraries: HuggingFace transformers and fastai and is inspired by other work in same direction namely earlier fasthugs by @morganmcg1 and blurr by @ohmeow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fasthugs-0.0.1.tar.gz (17.2 kB view hashes)

Uploaded Source

Built Distribution

fasthugs-0.0.1-py3-none-any.whl (15.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page