IUExtract 1.0.5

Rule-based Idea Unit segmentation algorithm for the English language.

IUExtract

Rule-based Idea Unit segmentation algorithm for the English language.

Installation

First of all, you need to install the dependencies:

pip install spacy
python -m spacy download en_core_web_lg

To install the package with the command line tool install pipx and run the following command:

pipx install iuextract --python 3.9

Note: on first run, the program will download the Spacy model en_core_web_lg. This could take some time. A custom Spacy model can be selected when importing the module into your python projects.

If you only wish to use the package in your python projects you can install without executable via

pip install iuextract

Command Line Interface (CLI) Usage

Once installed via pipx, you can run iuextract via

iuextract -i input_file.txt 

to segment file.txt into Idea Units. The segmented file will be printed on the console as standard output. You can specify an output file with the -o parameter.

iuextract -i input_file.txt -o output_file.txt

For more options you can call the help argument.

iuextract -h