scikit-sequitur 0.0.2

Sequitur algorithm for inferring hierarchies

SciKit Sequitur is an Apache2 licensed Python module for inferring compositional hierarchies from sequences.

Sequitur detects repetition and factors it out by forming rules in a grammar. The rules can be composed of non-terminals, giving rise to a hierarchy. It is useful for recognizing lexical structure in strings, and excels at very long sequences. The Sequitur algorithm was originally developed by Craig Nevill-Manning and Ian Witten.

>>> from sksequitur import Parser
>>> parser = Parser()
>>> parser.parse('hello hello')
>>> print(parser.grammar())
0 -> 1 _ 1
1 -> hello

SciKit Sequitur works on strings, lines, or any sequence of Python objects.

Features

• Pure-Python

• Developed on Python 3.8

• Tested on CPython 3.6, 3.7, 3.8

• Tested using GitHub Actions on Linux, Mac, and Windows

Quickstart

Installing scikit-sequitur is simple with pip:

$ pip install scikit-sequitur

You can access documentation in the interpreter with Python’s built-in help function:

>>> import sksequitur
>>> help(sksequitur)                         # doctest: +SKIP

Tutorial

The scikit-sequitur module provides utilities for parsing and interacting with grammars.

>>> from sksequitur import Parser
>>> parser = Parser()
>>> parser.parse('hello hello')
>>> print(parser.grammar())
0 → 1 ␣ 1
1 → hello

Reference

• scikit-sequitur Documentation

• scikit-sequitur at PyPI

• scikit-sequitur at GitHub

• scikit-sequitur Issue Tracker

License

Copyright 2020 Grant Jenks

Licensed under the Apache License, Version 2.0 (the “License”); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.