Skip to main content

Method to get part-of-speech tags from universal dependencies data.

Project description

# ud2pos

[![CircleCI](https://circleci.com/gh/tpimentelms/ud2pos.svg?style=svg&circle-token=d3f2433d9576bb5413356b1ef77c50272d22de8d)](https://circleci.com/gh/tpimentelms/ud2pos)

This code creates a map from wordform to part-of-speech using UD data.

## Using this simple part-of-speech tagger

To use the ud2pos tagger, first install this repository and then instantiate the UdTagger class.

### Install Repository

To install the code in this repository run: `bash $ pip install -e . `

### Use code

To use the ud2pos tagger, add the following to your script: `python import ud2pos language = 'english' tagger = ud2pos.UdTagger(language) print('Pos tag is: %s' % tagger('Hi')) ` This pos tagger will return ‘UNK’ for words not in the universal dependencies.

## Adding new languages

To process ud data for new languages, run the following commands:

### Install Dependencies

Create a conda environment with `bash $ conda env create -f environment.yml `

### Download and parse universal dependencies (UD) data

You can easily download UD data with the following command `bash $ make get_ud `

You can then get the embeddings for a language with command `bash $ make process LANGUAGE=<language> ` As languages, you should be able to experiment on any in UD. For instance: ‘english’; ‘czech’; ‘basque’; ‘finnish’; ‘turkish’; ‘arabic’; ‘japanese’; ‘tamil’; ‘korean’; ‘marathi’; ‘urdu’; ‘telugu’; ‘indonesian’.

## Extra Information

#### Contact

To ask questions or report problems, please open an [issue](https://github.com/tpimentelms/ud2pos/issues).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ud2pos-0.11.tar.gz (14.5 kB view details)

Uploaded Source

File details

Details for the file ud2pos-0.11.tar.gz.

File metadata

  • Download URL: ud2pos-0.11.tar.gz
  • Upload date:
  • Size: 14.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.0 importlib_metadata/4.8.2 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.11

File hashes

Hashes for ud2pos-0.11.tar.gz
Algorithm Hash digest
SHA256 0ce7921a5ef8440ae8ccdbe91a75694f0c020ec1983672c315f183afe78fb146
MD5 ee79fcd221037d9b7670ed8053cf1dff
BLAKE2b-256 39d358e947a5965bb790615cfd687caa19d7dd786322b8fd1f6019522a3135af

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page