Skip to main content

A part of speech tagger based on Hidden Markov models

Project description

PyPOS - Python POS tagger

This is  a  project, which allows its  users to assign part of speech tags to words in a  sentence .
dt   vbz dt nn     , wdt   vbz    prp$ nns   to vb     nn   in nn     nns  to nns   in dt nn       .

PyPOS uses Hidden Markov Models and Viterbi decoding to determine the most likely sequence of POS tags for a given sequence of words.

Usage

Installation

Requires Python 3.6 or higher

pip3 install pypos

Training

from pypos import PartOfSpeechTagger
tagger = PartOfSpeechTagger()
ds = tagger.load_pos_dataset('train.txt')
tagger.fit(ds).save('tagger.p')

Tagging

from pypos import PartOfSpeechTagger
tagger = PartOfSpeechTagger.load('tagger.p')

# Reproducing the results shown above:
sentence = 'This is a project, which allows its users to assign part of speech tags to words in a sentence.'
tokens = tagger.tokenize(sentence)
tags = tagger.tag(sentence, human_readable=False)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pypos-0.1.1.tar.gz (3.8 kB view hashes)

Uploaded Source

Built Distribution

pypos-0.1.1-py3-none-any.whl (5.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page