spacy-transformers: Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

This package provides spaCy components and architectures to use transformer models via Hugging Face's transformers in spaCy. The result is convenient access to state-of-the-art transformer architectures, such as BERT, GPT-2, XLNet, etc.

This release requires spaCy v3. For the previous version of this library, see the v0.6.x branch.

Features

Use pretrained transformer models like BERT, RoBERTa and XLNet to power your spaCy pipeline.
Easy multi-task learning: backprop to one transformer model from several pipeline components.
Train using spaCy v3's powerful and extensible config system.
Automatic alignment of transformer output to spaCy's tokenization.
Easily customize what transformer data is saved in the Doc object.
Easily customize how long documents are processed.
Out-of-the-box serialization and model packaging.

🚀 Installation

Installing the package from pip will automatically install all dependencies, including PyTorch and spaCy. Make sure you install this package before you install the models. Also note that this package requires Python 3.6+, PyTorch v1.5+ and spaCy v3.0+.

pip install spacy[transformers]

For GPU installation, find your CUDA version using nvcc --version and add the version in brackets, e.g. spacy[transformers,cuda92] for CUDA9.2 or spacy[transformers,cuda100] for CUDA10.0.

If you are having trouble installing PyTorch, follow the instructions on the official website for your specific operation system and requirements, or try the following:

pip install spacy-transformers -f https://download.pytorch.org/whl/torch_stable.html

📖 Documentation

⚠️ Important note: This package has been extensively refactored to take advantage of spaCy v3.0. Previous versions that were built for spaCy v2.x worked considerably differently. Please see previous tagged versions of this README for documentation on prior versions.

📘 Embeddings, Transformers and Transfer Learning: How to use transformers in spaCy
📘 Training Pipelines and Models: Train and update components on your own data and integrate custom models
📘 Layers and Model Architectures: Power spaCy components with custom neural networks
📗 Transformer: Pipeline component API reference
📗 Transformer architectures: Architectures and registered functions

Metadata

Release files for spacy-transformers 1.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for spacy-transformers 1.0.1
File	Size	Uploaded
spacy-transformers-1.0.1.tar.gz	32.6 kB	Feb 2, 2021	Details

Built distribution (wheel)

Table of built distributions (wheels) for spacy-transformers 1.0.1
File	Interpreter	ABI	Platform	Reset
spacy_transformers-1.0.1-py2.py3-none-any.whl 38.9 kB Feb 2, 2021	Python 3, Python 2	none	any	Details

Total release size: 71.5 kB

Release files / spacy-transformers-1.0.1.tar.gz

Download URL	spacy-transformers-1.0.1.tar.gz
Size	32.6 kB
Tags	Source
SHA-256 checksum How to use checksums	`787c6ade2e1b58886dea7dedc474924425a5d4d67355b4ea62a0d21c20d8ec97`
BLAKE2b-256 checksum How to use checksums	`06ab3bfaf66016ae8c692ad2fddf389705b5e27e49019095c925ca9ad821e0ed`
Upload date	Feb 2, 2021
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.7.9`

Release files / spacy_transformers-1.0.1-py2.py3-none-any.whl

Download URL	spacy_transformers-1.0.1-py2.py3-none-any.whl
Size	38.9 kB
Tags	Python 2 Python 3
SHA-256 checksum How to use checksums	`9eed1be43a45fcdd8cc58413dc810a496c925fea3d9b6d140b8e346b351c0a24`
BLAKE2b-256 checksum How to use checksums	`5b2251e9e59ebb0d914cf162201ca76f497a2fb1730e9fcf6cf5f5de3a2fbfc0`
Upload date	Feb 2, 2021
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.7.9`