wordsegmentation 0.3.4

English word segmentation.

Features

• Pure-Python

• Segmentation Algorithm Using Divide and Conquer so that there is NO max length limit set to input text.

• Segmentation Algotrithm used Dynamic Programming to achieve a polynomial time complexity.

• Used Google Trillion Corpus to do scoring for the word segmentation.

• Developed on Python 2.7

• Tested on CPython 2.6, 2.7, 3.4.

Quickstart

Installing WordSegment is simple with pip:

$ pip install wordsegmentation

Tutorial

In your own Python programs, you’ll mostly want to use segment to divide a phrase into a list of its parts:

>>> from wordsegmentation import Wordsegment
>>> ws = WordSegment(use_google_corpus=True)

>>> ws.segment('universityofwashington')
['university', 'of', 'washington']
>>> ws.segment('thisisatest')
['this', 'is', 'a', 'test']
>>> segment('thisisatest')
['this', 'is', 'a', 'test']