Skip to main content

Converters between two formats for linguistic annotation: FoLiA and NAF

Project description

Python library and command-line tools for converting between FoLiA and NAF.

Installation

To clone this repository and install, do:

  • $ git clone https://github.com/cltl/NAFFoLiAPy.git
  • $ cd NAFFoLiAPy
  • $ python3 install setup.py

You may want to use python2 for Python 2.7 and you may need to include sudo if you want to install the package globally. We recommend using a Python virtualenv though. Create and activate one as follows prior to executing the above steps:

  • $ virtualenv --python=python3 naffoliaenv
  • $ . naffoliaenv/bin/activate

Alternatively, use a python distribution like Anaconda.

NAF to FoLiA

The following conversions are currently supported by naf2folia:

  • Raw text
  • Token and terms
    • No support yet for multi-token terms!
    • Offset information is preserved in the conversion
  • Part-of-Speech
    • NAF’s morphosyntactic feature (morphofeat) is converted as a second type of part-of-speech (different set).
  • Lemmas
  • Lexical semantic senses (wordnet external references in NAF)
    • In NAF these are external references on the terms
    • Conversion to FoLiA senses is only supported for known resources.
    • Nested external references are expressed using FoLiA’s feature mechanism.
  • Named Entities
    • External references in NAF’s entities layer are converted as FoLiA alignments.
  • Markables
    • Are converted to FoLiA entities
    • External references in NAF’s markables layer are converted as FoLiA alignments
  • Co-references and events as co-references
  • Chunks
  • Semantic roles and predicates
    • External references on predicate level (usually to framenet) are converted to FoLiA senses
  • Dependency relations
  • Time expressions
    • Time expressions are converted to FoLiA entities
  • Sentiment analysis (opinion layer)
  • Metadata
    • FoLiA’s native metadata scheme is used to convert the information in NAF’s fileDesc and public element.
    • Information from the linguistic preprocessors is not converted yet.

Anything not listed is not yet supported. The tool attempts to warn whenever it encounters something it can not (yet) convert as much as possible, but this is not guaranteed.

FoLiA to NAF

The following conversions are currently supported by folia2naf:

  • Raw text (created from tokens)
  • Words to text and terms
    • NAF’s possibility of capturing multi-tokens not taken into account
    • offset and length are derived from string and space information
    • Part-of-speech:
      • taken from pos element: NAF’s morphofeat = FoLiA’s pos class, NAF’s pos = FoLiA’s pos head
    • Lemmas
    • Chunks
    • Entities
    • Dependencies

Anything not listed is not yet supported

Project details


Release history Release notifications

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for NAFFoLiAPy, version 0.1.1
Filename, size File type Python version Upload date Hashes
Filename, size NAFFoLiAPy-0.1.1.tar.gz (264.4 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page