Skip to main content

Method to get part-of-speech tags from universal dependencies data.

Project description

# ud2pos

[![CircleCI](https://circleci.com/gh/tpimentelms/ud2pos.svg?style=svg&circle-token=d3f2433d9576bb5413356b1ef77c50272d22de8d)](https://circleci.com/gh/tpimentelms/ud2pos)

This code creates a map from wordform to part-of-speech using UD data.

## Using this simple part-of-speech tagger

To use the ud2pos tagger, first install this repository and then instantiate the UdTagger class.

### Install Repository

To install the code in this repository run: `bash $ pip install -e . `

### Use code

To use the ud2pos tagger, add the following to your script: `python import ud2pos language = 'english' tagger = ud2pos.UdTagger(language) print('Pos tag is: %s' % tagger('Hi')) ` This pos tagger will return ‘UNK’ for words not in the universal dependencies.

## Adding new languages

To process ud data for new languages, run the following commands:

### Install Dependencies

Create a conda environment with `bash $ conda env create -f environment.yml `

### Download and parse universal dependencies (UD) data

You can easily download UD data with the following command `bash $ make get_ud `

You can then get the embeddings for a language with command `bash $ make process LANGUAGE=<language> ` As languages, you should be able to experiment on any in UD. For instance: ‘english’; ‘czech’; ‘basque’; ‘finnish’; ‘turkish’; ‘arabic’; ‘japanese’; ‘tamil’; ‘korean’; ‘marathi’; ‘urdu’; ‘telugu’; ‘indonesian’.

## Extra Information

#### Contact

To ask questions or report problems, please open an [issue](https://github.com/tpimentelms/ud2pos/issues).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ud2pos-0.111.tar.gz (14.5 kB view details)

Uploaded Source

File details

Details for the file ud2pos-0.111.tar.gz.

File metadata

  • Download URL: ud2pos-0.111.tar.gz
  • Upload date:
  • Size: 14.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.0 importlib_metadata/4.8.2 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.11

File hashes

Hashes for ud2pos-0.111.tar.gz
Algorithm Hash digest
SHA256 c799cd70488e3d23a7a06455c6588332c24c515bc3df0d354b39af80949a02f4
MD5 0dbb48d02006776d90a2ed649b62792b
BLAKE2b-256 abbe55de65efec5d1defb241ff16ffe68e78e049c6eed03cd9e85b5d800bd26e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page