pawpaw 1.0.0a4

High Performance Text Processing & Segmentation Framework

Pawpaw

Pawpaw is a high performance text segmentation framework that allows you you to quickly create parsers whose outputs are tree graphs. The resulting trees can be serialized, traversed, and searched using a powerful structured query language.

• Indexed str and substr representation
  • Efficient memory utilization
  • Fast processing
  • Pythonic relative indexing and slicing
  • Runtime & polymorphic value extraction
• Rules Pipelining Engine
  • Develop complex lexical parsers with just a few lines of code
  • Quickly and easily convert unstructured text into structured, indexed, & searchable tree graphs
  • Pre-process text for downstream NLP/AI/ML consumers
• Search and Query
  • Hierarchical data structure for all indexed text
  • Search using extensive structured query language
  • Optionally pre-compile queries for reuse to improvement performance
• XML Processing
  • Features a drop-in replacement for ElementTree.XmlParser
  • Full text indexes for all Elements, Attributes, Tags, Text, etc.
  • Search XML using both XPATH and the included, structured query language
• Efficient pickling and JSON persistance
  • Security option enables persistance of index-only data, with refrence strings re-injected during de-serialziation
• Stable
  • Over 2,100 unit tests and counting!

Explore the docs   •   Report Bug   •   Request Feature

Getting Started

Prerequisites

Pawpaw has been written and tested using Python 3.10. The only dependency is regex, which will be fetched and installed automatically if you install Pawpaw with pip or conda.

Installation

1. Install with pip from pypi:

   pip install pawpaw
   

2. Install with pip from github:

   pip install git+https://github.com/rlayers/pawpaw.git
   

3. Install with conda

   source activate myenv
   conda install git pip
   pip install git+https://github.com/rlayers/pawpaw.git
   

4. Clone the repo with git

   git clone https://github.com/rlayers/pawpaw
   

Verify

Open and python prompt and type:

>>> from pawpaw import Ito
>>> Ito('Hello, World!')
Ito('Hello, World!', 0, 13, None)

If your last line looks like this, you are up and running with Pawpaw!

(back to top)

Contributing

Contributions to Pawpaw are greatly appreciated - please refer to the contributing guildelines for details.

(back to top)

License

Distributed under the MIT License. See LICENSE for more information.

(back to top)

Contacts

Robert L. Ayers:  [e-mail]

(back to top)