pie-modules

⚠️ DEPRECATED This repository is no longer actively maintained.
No further releases will be published to PyPI for this package.
Please see the following alternatives:
• For document & annotation type definitions and document processing utilities & metrics, use the pie-documents repo.
• For model and taskmodule implementations (torch-based), use pytorch-ie.

Model-, taskmodule-, and metric-implementations as well as document processing utilities for PyTorch-IE.

Available models:

• SimpleSequenceClassificationModel
• SequenceClassificationModelWithPooler
• SequencePairSimilarityModelWithPooler
• SimpleTokenClassificationModel
• TokenClassificationModelWithSeq2SeqEncoderAndCrf
• SimpleExtractiveQuestionAnsweringModel
• SimpleGenerativeModel
• SpanTupleClassificationModel

Available taskmodules:

• RETextClassificationWithIndicesTaskModule
• CrossTextBinaryCorefTaskModule
• LabeledSpanExtractionByTokenClassificationTaskModule
• ExtractiveQuestionAnsweringTaskModule
• TextToTextTaskModule
• PointerNetworkTaskModuleForEnd2EndRE
• RESpanPairClassificationTaskModule

Available metrics:

• SpanLengthCollector
• RelationArgumentDistanceCollector
• SpanCoverageCollector
• SQuADF1

Document processing utilities:

• MultiSpanMerger
• SpansViaRelationMerger
• RegexPartitioner
• RelationArgumentSorter
• SentenceSplitter
• TextSpanTrimmer
• tokenize_document

Important Notice

This repository is deprecated and will receive no major updates. For ongoing maintenance and new features, please refer to:

• pie-documents — for document & annotation type definitions, and for document-processing utilities
• pytorch-ie — for model & taskmodule implementations using PyTorch

Setup

pip install pie-modules

To install the latest version from GitHub:

pip install git+https://git@github.com/ArneBinder/pie-modules.git

Development

Setup

1. This project is build with Poetry. See here for installation instructions.
2. Get the code and switch into the project directory:

   git clone https://github.com/ArneBinder/pie-modules
   cd pie-modules
   

3. Create a virtual environment and install the dependencies (including development dependencies):

   poetry install --with dev
   

Finally, to run any of the below commands, you need to activate the virtual environment:

poetry shell

Note: You can also run commands in the virtual environment without activating it first: poetry run <command>.

Code Formatting, Linting and Static Type Checking

pre-commit run -a

Testing

run all tests with coverage:

pytest --cov --cov-report term-missing

Releasing

1. Create the release branch: git switch --create release main
2. Increase the version: poetry version <PATCH|MINOR|MAJOR>, e.g. poetry version patch for a patch release. If the release contains new features, or breaking changes, bump the minor version (this project has no main release yet). If the release contains only bugfixes, bump the patch version. See Semantic Versioning for more information.
3. Commit the changes: git commit --message="release <NEW VERSION>" pyproject.toml, e.g. git commit --message="release 0.13.0" pyproject.toml
4. Push the changes to GitHub: git push origin release
5. Create a PR for that release branch on GitHub.
6. Wait until checks passed successfully.
7. Merge the PR into the main branch. This triggers the GitHub Action that creates all relevant release artefacts and also uploads them to PyPI.
8. Cleanup: Delete the release branch. This is important, because otherwise the next release will fail.