A friendly fork of Huggingface's Transformers, adding Adapters to PyTorch language models
Project description
adapter-transformers
A friendly fork of HuggingFace's Transformers, adding Adapters to PyTorch language models
adapter-transformers
is an extension of HuggingFace's Transformers library, integrating adapters into state-of-the-art language models by incorporating AdapterHub, a central repository for pre-trained adapter modules.
This library can be used as a drop-in replacement for HuggingFace Transformers and regularly synchronizes new upstream changes.
Installation
adapter-transformers currently supports Python 3.6+ and PyTorch 1.1.0+. After installing PyTorch, you can install adapter-transformers from PyPI ...
pip install -U adapter-transformers
... or from source by cloning the repository:
git clone https://github.com/adapter-hub/adapter-transformers.git
cd adapter-transformers
pip install .
Getting Started
HuggingFace's great documentation on getting started with Transformers can be found here. adapter-transformers is fully compatible with Transformers.
To get started with adapters, refer to these locations:
- https://docs.adapterhub.ml, our documentation on training and using adapters with adapter-transformers
- https://adapterhub.ml to explore available pre-trained adapter modules and share your own adapters
- Examples folder of this repository containing HuggingFace's example training scripts, many adapted for training adapters
Citation
If you find this library useful, please cite our paper AdapterHub: A Framework for Adapting Transformers:
@article{pfeiffer2020AdapterHub,
title={AdapterHub: A Framework for Adapting Transformers},
author={Jonas Pfeiffer and
Andreas R\"uckl\'{e} and
Clifton Poth and
Aishwarya Kamath and
Ivan Vuli\'{c} and
Sebastian Ruder and
Kyunghyun Cho and
Iryna Gurevych},
journal={arXiv preprint},
year={2020},
url={https://arxiv.org/abs/2007.07779}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for adapter-transformers-1.0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | fd980de5d1f4f1aa84b730451a37de2934f8dc832dd14394e0c6b06fba2e5fab |
|
MD5 | 390005f708c7cb7df40f8ca535e96d04 |
|
BLAKE2b-256 | 896bdc9ff7847fc8ed5e26b05ec312dac1b2414c61be68dd61e05aa949800c29 |
Hashes for adapter_transformers-1.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 41efe446050571a3108eccc428cc9cf564f208f0296e89f4a3e1b5152d7ccde1 |
|
MD5 | 55bf391924bbaba5204dcdcf1331753a |
|
BLAKE2b-256 | 97ec7a766374742566d209d63a18dc0533f2cb79def3b116b903ec7bad7ca4bf |