Skip to main content

Method to get part-of-speech tags from universal dependencies data.

Project description

# ud2pos

[![CircleCI](https://circleci.com/gh/tpimentelms/ud2pos.svg?style=svg&circle-token=d3f2433d9576bb5413356b1ef77c50272d22de8d)](https://circleci.com/gh/tpimentelms/ud2pos)

This code creates a map from wordform to part-of-speech using UD data.

## Using this simple part-of-speech tagger

To use the ud2pos tagger, first install this repository and then instantiate the UdTagger class.

### Install Repository

To install the code in this repository run: `bash $ pip install -e . `

### Use code

To use the ud2pos tagger, add the following to your script: `python import ud2pos language = 'english' tagger = ud2pos.UdTagger(language) print('Pos tag is: %s' % tagger('Hi')) ` This pos tagger will return ‘UNK’ for words not in the universal dependencies.

## Adding new languages

To process ud data for new languages, run the following commands:

### Install Dependencies

Create a conda environment with `bash $ conda env create -f environment.yml `

### Download and parse universal dependencies (UD) data

You can easily download UD data with the following command `bash $ make get_ud `

You can then get the embeddings for a language with command `bash $ make process LANGUAGE=<language> ` As languages, you should be able to experiment on any in UD. For instance: ‘english’; ‘czech’; ‘basque’; ‘finnish’; ‘turkish’; ‘arabic’; ‘japanese’; ‘tamil’; ‘korean’; ‘marathi’; ‘urdu’; ‘telugu’; ‘indonesian’.

## Extra Information

#### Contact

To ask questions or report problems, please open an [issue](https://github.com/tpimentelms/ud2pos/issues).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ud2pos-0.112.tar.gz (785.8 kB view details)

Uploaded Source

File details

Details for the file ud2pos-0.112.tar.gz.

File metadata

  • Download URL: ud2pos-0.112.tar.gz
  • Upload date:
  • Size: 785.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.0 importlib_metadata/4.8.2 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.11

File hashes

Hashes for ud2pos-0.112.tar.gz
Algorithm Hash digest
SHA256 242b6ea3e9a48c168c1427b1df61093b9c7a8914acdbe8795e94150118874ecf
MD5 5f5f2dac44c48e5e667302e219db2253
BLAKE2b-256 653bc8f884db9a1da3d213243c5114c354021a1158dc4323f1809c8e6bf71a1e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page