Skip to main content

spaCy pipelines for pre-trained BERT and other transformers

Project description

spacy-transformers: Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

This package provides spaCy components and architectures to use transformer models via Hugging Face's transformers in spaCy. The result is convenient access to state-of-the-art transformer architectures, such as BERT, GPT-2, XLNet, etc.

This release requires spaCy v3. For the previous version of this library, see the v0.6.x branch.

Azure Pipelines PyPi GitHub Code style: black

Features

  • Use pretrained transformer models like BERT, RoBERTa and XLNet to power your spaCy pipeline.
  • Easy multi-task learning: backprop to one transformer model from several pipeline components.
  • Train using spaCy v3's powerful and extensible config system.
  • Automatic alignment of transformer output to spaCy's tokenization.
  • Easily customize what transformer data is saved in the Doc object.
  • Easily customize how long documents are processed.
  • Out-of-the-box serialization and model packaging.

🚀 Installation

Installing the package from pip will automatically install all dependencies, including PyTorch and spaCy. Make sure you install this package before you install the models. Also note that this package requires Python 3.6+, PyTorch v1.5+ and spaCy v3.0+.

pip install spacy[transformers]

For GPU installation, find your CUDA version using nvcc --version and add the version in brackets, e.g. spacy[transformers,cuda92] for CUDA9.2 or spacy[transformers,cuda100] for CUDA10.0.

If you are having trouble installing PyTorch, follow the instructions on the official website for your specific operating system and requirements, or try the following:

pip install spacy-transformers -f https://download.pytorch.org/whl/torch_stable.html

📖 Documentation

⚠️ Important note: This package has been extensively refactored to take advantage of spaCy v3.0. Previous versions that were built for spaCy v2.x worked considerably differently. Please see previous tagged versions of this README for documentation on prior versions.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

spacy-transformers-1.1.2.tar.gz (40.7 kB view details)

Uploaded Source

Built Distribution

spacy_transformers-1.1.2-py2.py3-none-any.whl (51.4 kB view details)

Uploaded Python 2Python 3

File details

Details for the file spacy-transformers-1.1.2.tar.gz.

File metadata

  • Download URL: spacy-transformers-1.1.2.tar.gz
  • Upload date:
  • Size: 40.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.9

File hashes

Hashes for spacy-transformers-1.1.2.tar.gz
Algorithm Hash digest
SHA256 b84c195dc21a28582579dea3f76c90222e29ee0d99b6adf38ade75646ed2746e
MD5 504f103899b52c87dec40eef8b3530d5
BLAKE2b-256 8c97b0c0c13e12c24e936e95dc4abdf0d57ba4cc062310cfb2fb9465769e0914

See more details on using hashes here.

File details

Details for the file spacy_transformers-1.1.2-py2.py3-none-any.whl.

File metadata

  • Download URL: spacy_transformers-1.1.2-py2.py3-none-any.whl
  • Upload date:
  • Size: 51.4 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.9

File hashes

Hashes for spacy_transformers-1.1.2-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 697d07a70246b05479742b1023556bd3d974be75edb605a21ee6a441a103f2a1
MD5 d769390df17e5bff2a61e8addbcb0ad7
BLAKE2b-256 ce7da95ca7ad0675842f8a39cb727ecf097ab4fa6a8c62defa39a1d041d937a7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page