Skip to main content

A simple lemmatizer based on Unitex word lists

Project description

This is a simple module for lemmatization based on the Unitex inflected word list. As such, it needs a Unitex vocabulary file in order to work properly.

So far, I’ve only worked with Portuguese, with the DELAF_PB file provided by NILC.

Installing

You can either clone the repository and install with

$ python setup.py install

or install through pip

$ pip install unitexlemmatizer

Usage

In order to use the Unitex Lemmatizer, you need to tell it where the word list is:

>>> import unitexlemmatizer as ul
>>> ul.load_unitex_dictionary('/path/to/delaf.dic')

Then, you can call the get_lemma function passing the inflected word and its part of speech tag (from the Universal Dependencies tagset).

>>> ul.get_lemma('corpora', 'noun')
'corpus'

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

unitexlemmatizer-1.0.0.tar.gz (3.0 kB view hashes)

Uploaded source

Built Distributions

unitexlemmatizer-1.0.0-py2.py3-none-any.whl (4.9 kB view hashes)

Uploaded py2 py3

unitexlemmatizer-1.0.0-py2.7.egg (5.1 kB view hashes)

Uploaded 2 7

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page