Skip to main content

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

Project description

https://travis-ci.org/proycon/pynlpl.svg?branch=master http://applejack.science.ru.nl/lamabadge.php/pynlpl

PyNLPl, pronounced as ‘pineapple’, is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotatation).

The library is a divided into several packages and modules. It works on Python 2.7, as well as Python 3.

The following modules are available:

  • pynlpl.datatypes - Extra datatypes (priority queues, patterns, tries)

  • pynlpl.evaluation - Evaluation & experiment classes (parameter search, wrapped progressive sampling, class evaluation (precision/recall/f-score/auc), sampler, confusion matrix, multithreaded experiment pool)

  • pynlpl.formats.cgn - Module for parsing CGN (Corpus Gesproken Nederlands) part-of-speech tags

  • pynlpl.formats.folia - Extensive library for reading and manipulating the documents in FoLiA format (Format for Linguistic Annotation).

  • pynlpl.formats.fql - Extensive library for the FoLiA Query Language (FQL), built on top of pynlpl.formats.folia. FQL is currently documented here.

  • pynlpl.formats.cql - Parser for the Corpus Query Language (CQL), as also used by Corpus Workbench and Sketch Engine. Contains a convertor to FQL.

  • pynlpl.formats.giza - Module for reading GIZA++ word alignment data

  • pynlpl.formats.moses - Module for reading Moses phrase-translation tables.

  • pynlpl.formats.sonar - Largely obsolete module for pre-releases of the SoNaR corpus, use pynlpl.formats.folia instead.

  • pynlpl.formats.timbl - Module for reading Timbl output (consider using python-timbl instead though)

  • pynlpl.lm.lm - Module for simple language model and reader for ARPA language model data as well (used by SRILM).

  • pynlpl.search - Various search algorithms (Breadth-first, depth-first, beam-search, hill climbing, A star, various variants of each)

  • pynlpl.statistics - Frequency lists, Levenshtein, common statistics and information theory functions

  • pynlpl.textprocessors - Simple tokeniser, n-gram extraction

API Documentation can be found here.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

PyNLPl-0.9.0.tar.gz (154.9 kB view details)

Uploaded Source

File details

Details for the file PyNLPl-0.9.0.tar.gz.

File metadata

  • Download URL: PyNLPl-0.9.0.tar.gz
  • Upload date:
  • Size: 154.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for PyNLPl-0.9.0.tar.gz
Algorithm Hash digest
SHA256 e59f57e5ce101b9216e1bcc6bcbe90a370c696f78068c6ef3002fffd0742f43b
MD5 ea877ce7d853fa88657362e53302c945
BLAKE2b-256 4fe4a5e85620a09806bc3f6978615bf12f12b97d0853be51f93a0475696b2bfa

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page