Skip to main content

Industrial-strength Natural Language Processing (NLP) in Python

Project description

spaCy: Industrial-strength NLP

spaCy is a library for advanced Natural Language Processing in Python and Cython. It's built on the very latest research, and was designed from day one to be used in real products.

spaCy comes with pretrained pipelines and currently supports tokenization and training for 60+ languages. It features state-of-the-art speed and neural network models for tagging, parsing, named entity recognition, text classification and more, multi-task learning with pretrained transformers like BERT, as well as a production-ready training system and easy model packaging, deployment and workflow management. spaCy is commercial open-source software, released under the MIT license.

💫 Version 3.0 out now! Check out the release notes here.

Azure Pipelines Current Release Version pypi Version conda Version Python wheels Code style: black
PyPi downloads Conda downloads spaCy on Twitter

📖 Documentation

Documentation
⭐️ spaCy 101 New to spaCy? Here's everything you need to know!
📚 Usage Guides How to use spaCy and its features.
🚀 New in v3.0 New features, backwards incompatibilities and migration guide.
🪐 Project Templates End-to-end workflows you can clone, modify and run.
🎛 API Reference The detailed reference for spaCy's API.
📦 Models Download trained pipelines for spaCy.
🌌 Universe Plugins, extensions, demos and books from the spaCy ecosystem.
👩‍🏫 Online Course Learn spaCy in this free and interactive online course.
📺 Videos Our YouTube channel with video tutorials, talks and more.
🛠 Changelog Changes and version history.
💝 Contribute How to contribute to the spaCy project and code base.

💬 Where to ask questions

The spaCy project is maintained by @honnibal, @ines, @svlandeg and @adrianeboyd. Please understand that we won't be able to provide individual support via email. We also believe that help is much more valuable if it's shared publicly, so that more people can benefit from it.

Type Platforms
🚨 Bug Reports GitHub Issue Tracker
🎁 Feature Requests & Ideas GitHub Discussions
👩‍💻 Usage Questions GitHub Discussions · Stack Overflow
🗯 General Discussion GitHub Discussions

Features

  • Support for 60+ languages
  • Trained pipelines for different languages and tasks
  • Multi-task learning with pretrained transformers like BERT
  • Support for pretrained word vectors and embeddings
  • State-of-the-art speed
  • Production-ready training system
  • Linguistically-motivated tokenization
  • Components for named entity recognition, part-of-speech-tagging, dependency parsing, sentence segmentation, text classification, lemmatization, morphological analysis, entity linking and more
  • Easily extensible with custom components and attributes
  • Support for custom models in PyTorch, TensorFlow and other frameworks
  • Built in visualizers for syntax and NER
  • Easy model packaging, deployment and workflow management
  • Robust, rigorously evaluated accuracy

📖 For more details, see the facts, figures and benchmarks.

⏳ Install spaCy

For detailed installation instructions, see the documentation.

  • Operating system: macOS / OS X · Linux · Windows (Cygwin, MinGW, Visual Studio)
  • Python version: Python 3.6+ (only 64 bit)
  • Package managers: pip · conda (via conda-forge)

pip

Using pip, spaCy releases are available as source packages and binary wheels. Before you install spaCy and its dependencies, make sure that your pip, setuptools and wheel are up to date.

pip install -U pip setuptools wheel
pip install spacy

To install additional data tables for lemmatization and normalization you can run pip install spacy[lookups] or install spacy-lookups-data separately. The lookups package is needed to create blank models with lemmatization data, and to lemmatize in languages that don't yet come with pretrained models and aren't powered by third-party libraries.

When using pip it is generally recommended to install packages in a virtual environment to avoid modifying system state:

python -m venv .env
source .env/bin/activate
pip install -U pip setuptools wheel
pip install spacy

conda

You can also install spaCy from conda via the conda-forge channel. For the feedstock including the build recipe and configuration, check out this repository.

conda install -c conda-forge spacy

Updating spaCy

Some updates to spaCy may require downloading new statistical models. If you're running spaCy v2.0 or higher, you can use the validate command to check if your installed models are compatible and if not, print details on how to update them:

pip install -U spacy
python -m spacy validate

If you've trained your own models, keep in mind that your training and runtime inputs must match. After updating spaCy, we recommend retraining your models with the new version.

📖 For details on upgrading from spaCy 2.x to spaCy 3.x, see the migration guide.

📦 Download model packages

Trained pipelines for spaCy can be installed as Python packages. This means that they're a component of your application, just like any other module. Models can be installed using spaCy's download command, or manually by pointing pip to a path or URL.

Documentation
Available Pipelines Detailed pipeline descriptions, accuracy figures and benchmarks.
Models Documentation Detailed usage and installation instructions.
Training How to train your own pipelines on your data.
# Download best-matching version of specific model for your spaCy installation
python -m spacy download en_core_web_sm

# pip install .tar.gz archive or .whl from path or URL
pip install /Users/you/en_core_web_sm-3.0.0.tar.gz
pip install /Users/you/en_core_web_sm-3.0.0-py3-none-any.whl
pip install https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-3.0.0/en_core_web_sm-3.0.0.tar.gz

Loading and using models

To load a model, use spacy.load() with the model name or a path to the model data directory.

import spacy
nlp = spacy.load("en_core_web_sm")
doc = nlp("This is a sentence.")

You can also import a model directly via its full name and then call its load() method with no arguments.

import spacy
import en_core_web_sm

nlp = en_core_web_sm.load()
doc = nlp("This is a sentence.")

📖 For more info and examples, check out the models documentation.

⚒ Compile from source

The other way to install spaCy is to clone its GitHub repository and build it from source. That is the common way if you want to make changes to the code base. You'll need to make sure that you have a development environment consisting of a Python distribution including header files, a compiler, pip, virtualenv and git installed. The compiler part is the trickiest. How to do that depends on your system.

Platform
Ubuntu Install system-level dependencies via apt-get: sudo apt-get install build-essential python-dev git .
Mac Install a recent version of XCode, including the so-called "Command Line Tools". macOS and OS X ship with Python and git preinstalled.
Windows Install a version of the Visual C++ Build Tools or Visual Studio Express that matches the version that was used to compile your Python interpreter.

For more details and instructions, see the documentation on compiling spaCy from source and the quickstart widget to get the right commands for your platform and Python version.

git clone https://github.com/explosion/spaCy
cd spaCy

python -m venv .env
source .env/bin/activate

# make sure you are using the latest pip
python -m pip install -U pip setuptools wheel

pip install -r requirements.txt
pip install --no-build-isolation --editable .

To install with extras:

pip install --no-build-isolation --editable .[lookups,cuda102]

🚦 Run tests

spaCy comes with an extensive test suite. In order to run the tests, you'll usually want to clone the repository and build spaCy from source. This will also install the required development dependencies and test utilities defined in the requirements.txt.

Alternatively, you can run pytest on the tests from within the installed spacy package. Don't forget to also install the test utilities via spaCy's requirements.txt:

pip install -r requirements.txt
python -m pytest --pyargs spacy

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

spacy-3.0.6.tar.gz (7.1 MB view details)

Uploaded Source

Built Distributions

spacy-3.0.6-cp39-cp39-win_amd64.whl (11.5 MB view details)

Uploaded CPython 3.9Windows x86-64

spacy-3.0.6-cp39-cp39-manylinux2014_x86_64.whl (12.6 MB view details)

Uploaded CPython 3.9

spacy-3.0.6-cp39-cp39-macosx_10_9_x86_64.whl (12.3 MB view details)

Uploaded CPython 3.9macOS 10.9+ x86-64

spacy-3.0.6-cp38-cp38-win_amd64.whl (11.9 MB view details)

Uploaded CPython 3.8Windows x86-64

spacy-3.0.6-cp38-cp38-manylinux2014_x86_64.whl (13.0 MB view details)

Uploaded CPython 3.8

spacy-3.0.6-cp38-cp38-macosx_10_9_x86_64.whl (12.5 MB view details)

Uploaded CPython 3.8macOS 10.9+ x86-64

spacy-3.0.6-cp37-cp37m-win_amd64.whl (11.7 MB view details)

Uploaded CPython 3.7mWindows x86-64

spacy-3.0.6-cp37-cp37m-manylinux2014_x86_64.whl (12.8 MB view details)

Uploaded CPython 3.7m

spacy-3.0.6-cp37-cp37m-macosx_10_9_x86_64.whl (12.4 MB view details)

Uploaded CPython 3.7mmacOS 10.9+ x86-64

spacy-3.0.6-cp36-cp36m-win_amd64.whl (11.7 MB view details)

Uploaded CPython 3.6mWindows x86-64

spacy-3.0.6-cp36-cp36m-manylinux2014_x86_64.whl (12.9 MB view details)

Uploaded CPython 3.6m

spacy-3.0.6-cp36-cp36m-macosx_10_9_x86_64.whl (12.4 MB view details)

Uploaded CPython 3.6mmacOS 10.9+ x86-64

File details

Details for the file spacy-3.0.6.tar.gz.

File metadata

  • Download URL: spacy-3.0.6.tar.gz
  • Upload date:
  • Size: 7.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6.tar.gz
Algorithm Hash digest
SHA256 5628ab89f1f568099c880b12a9c37f4ece29ab89260660cfdf728c02711879c5
MD5 27cf41d2fae6d15bfc347b0fd8ba3912
BLAKE2b-256 6d0d4379e9aa35a444b6440ffe1af4c612533460e0d5ac5c7dca1f96ff6f2e23

See more details on using hashes here.

File details

Details for the file spacy-3.0.6-cp39-cp39-win_amd64.whl.

File metadata

  • Download URL: spacy-3.0.6-cp39-cp39-win_amd64.whl
  • Upload date:
  • Size: 11.5 MB
  • Tags: CPython 3.9, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6-cp39-cp39-win_amd64.whl
Algorithm Hash digest
SHA256 dad95d94b7c3263e364170d397e9a83c1ec2b64f6bc771e2511a662d537649b3
MD5 6f5ba6aaa7041fc7c66c39d9eac806ea
BLAKE2b-256 d52c7253c41eaedab0435beb5bc408a3944d14da4175485a59dfc81f5e00a565

See more details on using hashes here.

File details

Details for the file spacy-3.0.6-cp39-cp39-manylinux2014_x86_64.whl.

File metadata

  • Download URL: spacy-3.0.6-cp39-cp39-manylinux2014_x86_64.whl
  • Upload date:
  • Size: 12.6 MB
  • Tags: CPython 3.9
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6-cp39-cp39-manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 0d688674128a281fb5022a3ff736b635168b4489622731d013779662872bb18f
MD5 caf7883ed94c58371922b527cdb9997e
BLAKE2b-256 2ffdb40e28037001d19356c320d32f9b6172fa1d20546eeed78bda5b8713a5b0

See more details on using hashes here.

File details

Details for the file spacy-3.0.6-cp39-cp39-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: spacy-3.0.6-cp39-cp39-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 12.3 MB
  • Tags: CPython 3.9, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6-cp39-cp39-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 0827b0a5f4a0ed30d20945c040a53fb167abb5182ee2e0bde11dbb78b238955e
MD5 49c6d83ed6c209cfd500e995546b396f
BLAKE2b-256 24f5622365550b73dea1d6796d290442dba2f8742189d8a4d57be17d4a24e4e6

See more details on using hashes here.

File details

Details for the file spacy-3.0.6-cp38-cp38-win_amd64.whl.

File metadata

  • Download URL: spacy-3.0.6-cp38-cp38-win_amd64.whl
  • Upload date:
  • Size: 11.9 MB
  • Tags: CPython 3.8, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6-cp38-cp38-win_amd64.whl
Algorithm Hash digest
SHA256 1b76137ed28a0bd5935de5d56e421e197616403f8f5cc8ece4afea2e1543c22f
MD5 59409596530475cc281749753a5c90b4
BLAKE2b-256 e50b88be00b3770ca3a18d436ad84a4a1193c9dc110b9a89d079c5a3bfb7ceee

See more details on using hashes here.

File details

Details for the file spacy-3.0.6-cp38-cp38-manylinux2014_x86_64.whl.

File metadata

  • Download URL: spacy-3.0.6-cp38-cp38-manylinux2014_x86_64.whl
  • Upload date:
  • Size: 13.0 MB
  • Tags: CPython 3.8
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6-cp38-cp38-manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 ac0b01a6c00a2ddf63bac9d7db50424bf6ecea68036d9cf915432552c47f1660
MD5 a636835bf681e37e8f7d396b2e7702e3
BLAKE2b-256 65255403425f8b5b7be555d73c975907c905c9bb7fc021f16906da87dc6a09b8

See more details on using hashes here.

File details

Details for the file spacy-3.0.6-cp38-cp38-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: spacy-3.0.6-cp38-cp38-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 12.5 MB
  • Tags: CPython 3.8, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6-cp38-cp38-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 9a35a27476534fcc40823140df578279b2b35f34892f5e81552ef59ed021f0a2
MD5 e3fc44c8098bb15b9f57eb0452122102
BLAKE2b-256 9a974cac1c4ac95af031b627968120bf273193e2f2134ff01b069cf630414272

See more details on using hashes here.

File details

Details for the file spacy-3.0.6-cp37-cp37m-win_amd64.whl.

File metadata

  • Download URL: spacy-3.0.6-cp37-cp37m-win_amd64.whl
  • Upload date:
  • Size: 11.7 MB
  • Tags: CPython 3.7m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6-cp37-cp37m-win_amd64.whl
Algorithm Hash digest
SHA256 6ac13f2fd24403de00c6ba2222533c4dcf679d1aafa7d812803006922d49234e
MD5 d1ccc064a11eb209b51001130139ed6a
BLAKE2b-256 99c935d94c73e26b194c07a3d3adb82c06c38f76bebd3e1ba1e7195fb6f5a7cc

See more details on using hashes here.

File details

Details for the file spacy-3.0.6-cp37-cp37m-manylinux2014_x86_64.whl.

File metadata

  • Download URL: spacy-3.0.6-cp37-cp37m-manylinux2014_x86_64.whl
  • Upload date:
  • Size: 12.8 MB
  • Tags: CPython 3.7m
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6-cp37-cp37m-manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 d29571e1170070cbfec676d52df785998ae92dbb965eb96099c4666824a740bf
MD5 4a10b1ebe37c9dfcdd0f5b6631817f91
BLAKE2b-256 1bd80361bbaf7a1ff56b44dca04dace54c82d63dad7475b7d25ea1baefafafb2

See more details on using hashes here.

File details

Details for the file spacy-3.0.6-cp37-cp37m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: spacy-3.0.6-cp37-cp37m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 12.4 MB
  • Tags: CPython 3.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 651c773c78a18c51665ba9ee407e4a055f8f8b67b282761011027b9172cc4b7f
MD5 a81bc55dff3ba718959eba24bd9e5349
BLAKE2b-256 2972dbc540ce5b6c9eb51b6c66d3b2969dc25ad0ae33e5dd235e381d88efdee1

See more details on using hashes here.

File details

Details for the file spacy-3.0.6-cp36-cp36m-win_amd64.whl.

File metadata

  • Download URL: spacy-3.0.6-cp36-cp36m-win_amd64.whl
  • Upload date:
  • Size: 11.7 MB
  • Tags: CPython 3.6m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6-cp36-cp36m-win_amd64.whl
Algorithm Hash digest
SHA256 96fc271f0da340e89a7357747b475169ad455c727671b6a853f6b722d617dd3b
MD5 3e3174cba3b3ea5d1b0c6e3a1f5ebd58
BLAKE2b-256 de81998500a22d7558f281929778c4f455aae9aab53a78c30f57765a1b861b55

See more details on using hashes here.

File details

Details for the file spacy-3.0.6-cp36-cp36m-manylinux2014_x86_64.whl.

File metadata

  • Download URL: spacy-3.0.6-cp36-cp36m-manylinux2014_x86_64.whl
  • Upload date:
  • Size: 12.9 MB
  • Tags: CPython 3.6m
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6-cp36-cp36m-manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 1648f6da017c237e1b1a5cbb88ba74a3f2036a496a60009324a0b2951de4fc00
MD5 93856a6797f4859720a578b9f301e798
BLAKE2b-256 fc5c865d9cebb2a03fda322f8028491578e982cef256596b8f16ef28aaf29cc4

See more details on using hashes here.

File details

Details for the file spacy-3.0.6-cp36-cp36m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: spacy-3.0.6-cp36-cp36m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 12.4 MB
  • Tags: CPython 3.6m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.9

File hashes

Hashes for spacy-3.0.6-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 8bd6f2d21545f6e790de0c191d28c88eca301c563f46adef9865394dc7ed880f
MD5 f35d05de2188cb1513786d02db1d57a2
BLAKE2b-256 837011c565028d7efe1cbea99b7e4d92f1b3afcadaec20c792c69fc92b3098ca

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page