Janome 0.2.5

Japanese morphological analysis engine.

janome is a Japanese morphological analysis engine written in pure Python.

General documentation: http://mocobeta.github.io/janome/ (for Japanese)

Requirements

Python 2.7 or 3.4+ is required.

Install

[Note] This consumes about 3 to 4 GB memory for building.

(venv) $ python setup.py install

Run

(env) $ python
>>> from janome.tokenizer import Tokenizer
>>> t = Tokenizer()
>>> for token in t.tokenize(u'すもももももももものうち'):
...     print(token)
...
すもも 名詞,一般,*,*,*,*,すもも,スモモ,スモモ
も    助詞,係助詞,*,*,*,*,も,モ,モ
もも  名詞,一般,*,*,*,*,もも,モモ,モモ
も    助詞,係助詞,*,*,*,*,も,モ,モ
もも  名詞,一般,*,*,*,*,もも,モモ,モモ
の    助詞,連体化,*,*,*,*,の,ノ,ノ
うち  名詞,非自立,副詞可能,*,*,*,うち,ウチ,ウチ

License

Licensed under Apache License 2.0 and uses the MeCab-IPADIC dictionary/statistical model.

See LICENSE.txt and NOTICE.txt for license details.

Copyright

Copyright(C) 2015, moco_beta. All rights reserved.