Skip to main content

A Danish pipeline trained in SpaCy that has achieved State-of-the-Art performance on all dependency parsing, NER and POS-tagging for Danish

Project description

DaCy: An efficient NLP Pipeline for Danish

PyPI version pip downloads python version Code style: black github actions pytest github actions docs

Demo

DaCy is a Danish natural language preprocessing framework made with SpaCy. Its largest pipeline has achieved State-of-the-Art performance on Named entity recognition, part-of-speech tagging and dependency parsing for Danish. Feel free to try out the demo. This repository contains material for using DaCy, reproducing the results and guides on usage of the package. Furthermore, it also contains behavioural tests for biases and robustness of Danish NLP pipelines.

🔧 Installation

To get started using DaCy simply install it using pip by running the following line in your terminal:

pip install dacy

👩‍💻 Usage

To use the model you first have to download either the small, medium, or large model. To see a list of all available models:

import dacy
for model in dacy.models():
    print(model)
# ...
# da_dacy_small_trf-0.1.0
# da_dacy_medium_trf-0.1.0
# da_dacy_large_trf-0.1.0

To download and load a model simply execute:

nlp = dacy.load("da_dacy_medium_tfrf-0.1.0")
# or equivalently
nlp = dacy.load("medium")

Which will download the model to the .dacy directory in your home directory.

To download the model to a specific directory:

dacy.download_model("da_dacy_medium_trf-0.1.0", your_save_path)
nlp = dacy.load_model("da_dacy_medium_trf-0.1.0", your_save_path)

📖 Documentation

DaCy includes detailed documentation as well as a series of Jupyter notebook tutorials. If you do not have Jupyter Notebook installed, instructions for installing and running it can be found here. All the tutorials are located in the tutorials folder.

Documentation
📚 Getting started Guides and instructions on how to use DaCy and its features.
🦾 Performance A detailed description of the performance of DaCy and comparison with similar Danish models
😎 Demo A simple Streamlit demo to try out the augmenters.
📰 News and changelog New additions, changes and version history.
🎛 API References The detailed reference for DaCy's API. Including function documentation
🙋 FAQ Frequently asked questions

Training and reproduction

the folder training contains a SpaCy project which will allow for reproduction of the results. This folder also includes the evaluation metrics on DaNE and scripts for downloading the required data. For more information, please see the training readme.

Want to learn more about how DaCy initially came to be, check out this blog post.


💬 Where to ask questions

To ask report issues or request features, please use the GitHub Issue Tracker. Questions related to SpaCy are kindly referred to the SpaCy GitHub or forum. Otherwise, please use the discussion Forums.

Type
🚨 Bug Reports GitHub Issue Tracker
🎁 Feature Requests & Ideas GitHub Issue Tracker
👩‍💻 Usage Questions GitHub Discussions
🗯 General Discussion GitHub Discussions

Acknowledgements

DaCy is a result of great open-source software and contributors. It wouldn't have been possible without the work by the SpaCy team which developed and integrated the software. Huggingface for developing Transformers and making model sharing convenient. Multiple parties including Certainly.io and Malte Hojmark-Bertelsen for making their models publicly available. Alexandra Institute for developing and maintaining DaNLP which has made it easy to get access to Danish resources and even supplied some of the tagged data themselves.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dacy-2.2.7.tar.gz (4.7 MB view details)

Uploaded Source

Built Distribution

dacy-2.2.7-py3-none-any.whl (53.6 kB view details)

Uploaded Python 3

File details

Details for the file dacy-2.2.7.tar.gz.

File metadata

  • Download URL: dacy-2.2.7.tar.gz
  • Upload date:
  • Size: 4.7 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.9.2 readme-renderer/37.3 requests/2.28.1 requests-toolbelt/0.10.1 urllib3/1.26.13 tqdm/4.64.1 importlib-metadata/6.0.0 keyring/23.13.1 rfc3986/2.0.0 colorama/0.4.6 CPython/3.9.16

File hashes

Hashes for dacy-2.2.7.tar.gz
Algorithm Hash digest
SHA256 8039001206eeb5a2f4fe2c40daa109a4e6e862c9399dc20c2c703a08a601dcce
MD5 cc0c847a00b14e70576feb4946405786
BLAKE2b-256 3205b11b3b3d3cf045c525a6222442b4db1ba8c8651e9d4d0275b380c993ebe5

See more details on using hashes here.

File details

Details for the file dacy-2.2.7-py3-none-any.whl.

File metadata

  • Download URL: dacy-2.2.7-py3-none-any.whl
  • Upload date:
  • Size: 53.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.9.2 readme-renderer/37.3 requests/2.28.1 requests-toolbelt/0.10.1 urllib3/1.26.13 tqdm/4.64.1 importlib-metadata/6.0.0 keyring/23.13.1 rfc3986/2.0.0 colorama/0.4.6 CPython/3.9.16

File hashes

Hashes for dacy-2.2.7-py3-none-any.whl
Algorithm Hash digest
SHA256 0537f2ad8700f2154a772d811fd9b74a59734eba340ba26fcded5fda0cf94064
MD5 838bfb142e3368fc08340d67e489acc2
BLAKE2b-256 c3c7b169a7dc3391815c5e7af1c1275b8a57fd2dc1a46cb96fcfd9d016c38dbb

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page