Skip to main content

spacy-transformers: Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

This package provides spaCy components and architectures to use transformer models via Hugging Face's transformers in spaCy. The result is convenient access to state-of-the-art transformer architectures, such as BERT, GPT-2, XLNet, etc.

This release requires spaCy v3. For the previous version of this library, see the v0.6.x branch.

Azure Pipelines PyPi GitHub Code style: black

Features

  • Use pretrained transformer models like BERT, RoBERTa and XLNet to power your spaCy pipeline.
  • Easy multi-task learning: backprop to one transformer model from several pipeline components.
  • Train using spaCy v3's powerful and extensible config system.
  • Automatic alignment of transformer output to spaCy's tokenization.
  • Easily customize what transformer data is saved in the Doc object.
  • Easily customize how long documents are processed.
  • Out-of-the-box serialization and model packaging.

🚀 Installation

Installing the package from pip will automatically install all dependencies, including PyTorch and spaCy. Make sure you install this package before you install the models. Also note that this package requires Python 3.6+, PyTorch v1.5+ and spaCy v3.0+.

pip install spacy[transformers]

For GPU installation, find your CUDA version using nvcc --version and add the version in brackets, e.g. spacy[transformers,cuda92] for CUDA9.2 or spacy[transformers,cuda100] for CUDA10.0.

If you are having trouble installing PyTorch, follow the instructions on the official website for your specific operation system and requirements, or try the following:

pip install spacy-transformers -f https://download.pytorch.org/whl/torch_stable.html

📖 Documentation

⚠️ Important note: This package has been extensively refactored to take advantage of spaCy v3.0. Previous versions that were built for spaCy v2.x worked considerably differently. Please see previous tagged versions of this README for documentation on prior versions.

Metadata

Release files for spacy-transformers 1.0.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for spacy-transformers 1.0.4
File Size Uploaded Provenance Actions
spacy-transformers-1.0.4.tar.gz 32.9 kB Without provenance Details for spacy-transformers-1.0.4.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for spacy-transformers 1.0.4
File Interpreter ABI Platform Actions
spacy_transformers-1.0.4-py2.py3-none-any.whl Python 2, Python 3 none any Details for spacy_transformers-1.0.4-py2.py3-none-any.whl

Total release size: 73.0 kB

Release files / spacy-transformers-1.0.4.tar.gz

Download URL spacy-transformers-1.0.4.tar.gz
Size 32.9 kB
Tags Source
SHA-256 checksum
How to use checksums
6185da29a93ed02a76ff991aef211f42bc24d6d7cb93752b4d5b71a02d2c3cd4
BLAKE2b-256 checksum
How to use checksums
7af80e32e0ca1e61f1b3d9d8fabf10001eb2bf485e72711a91cb45c0ef4843f2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/4.6.3 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.0 CPython/3.7.9

Release files / spacy_transformers-1.0.4-py2.py3-none-any.whl

Download URL spacy_transformers-1.0.4-py2.py3-none-any.whl
Size 40.1 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
d635cb1a30411120c00ca6f63b67c1f307fdd51382103fb922658d4fb954b3d3
BLAKE2b-256 checksum
How to use checksums
770d5865759ed30cd84eabdbde031668653dd538d3fbfe28254e12928d988532
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/4.6.3 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.0 CPython/3.7.9

Security for spacy-transformers 1.0.4

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

1.0.4 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page