Python wrapper for the Yandex MyStem 3
Project description
Introduction
This module contains a wrapper for an excellent morphological analyzer for Russian language Yandex Mystem 3.0 released in June 2014. A morphological analyzer can perform lemmatization of text and derive a set of morphological attributes for each token. For more details about the algorithm see I. Segalovich «A fast morphological algorithm with unknown word guessing induced by a dictionary for a web search engine», MLMTA-2003, Las Vegas, Nevada, USA.
Python is the language of choice for many computational linguists, including those working with Russian language. The main motivation for this development was absence of any Python wrapper for the Mystem, a one of the most popular morphological analyzers for Russian language along with the PyMorphy2, the TreeTagger and AOT.
The third version of Mystem introduces several importaint improvements, most importaintly part-of-speech disambiguation. Our wrapper runs the Mystem in the mode which performs POS disambiguation.
This wrapper is open sources under MIT license. However, please consider that the Yandex Mystem is not open source and licensed under conditions of the Yandex License.
System Requrements
The wrapper works with CPython 2.6+/3.3+ and PyPy 1.9+.
The wrapper was tested on Ubuntu Linux 12.04+, Mac OSX 10.9+ and Windows 7+.
Installation
Stable version: https://pypi.python.org/pypi/pymystem3. You can install it using pip:
pip install pymystem3
Latest version: https://github.com/Digsolab/pymystem3
A Quick Example
>>> from pymystem3 import Mystem >>> text = "Красивая мама красиво мыла раму" >>> m = Mystem() >>> lemmas = m.lemmatize(text) >>> print(''.join(lemmas)) красивый мама красиво мыть рама
Issues
The current version can be considered as an alpha version, so please let us know if something does not work as expected. Please report any bugs or requests that you have using the GitHub issue tracker (https://github.com/Digsolab/pymystem3/issues)!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file pymystem3-0.1.1.tar.gz
.
File metadata
- Download URL: pymystem3-0.1.1.tar.gz
- Upload date:
- Size: 18.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6e764b7ded44fbdc2b5ded61d88d478b990c826627108a0ccfa73284a71de218 |
|
MD5 | 1d7779902af1cf8585cc71864532058c |
|
BLAKE2b-256 | 62466823584c3ec102da12b5ee00f36d2f46ae51c116557d5b359fb93fb3dd11 |
File details
Details for the file pymystem3-0.1.1-py2.7.egg
.
File metadata
- Download URL: pymystem3-0.1.1-py2.7.egg
- Upload date:
- Size: 19.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f35e262ef4600d24d2c7e054fedf05901ccf7d2e9cf7aad06be39c9d32d0097a |
|
MD5 | 40972f1faf491712092155a201cef009 |
|
BLAKE2b-256 | cae0aaf12239d0e5f7a7a551e822d611970840a849280568fd47d18c0f5e28ff |