pysegmenters-pysdb 1.6.21

Rule-based segmenter

pysegmenters_pysdb

Rule based segmenter based on Spacy and PySBD (Python Sentence Boundary Disambiguation).

Installation

You can simply pip install pysegmenters_pysdb.

Developing

Pre-requesites

You will need to install uv (for building and managing the package):

pip install uv

Clone the repository:

git clone https://github.com/oterrier/pysegmenters_pysdb

Install development dependencies:

uv sync --extra test

Running the test suite

You can run the full test suite with:

uv run pytest

Linting and formatting

uv run ruff check .
uv run ruff format .

Building the documentation

You can build the HTML documentation with:

uv run --extra docs sphinx-build docs docs/_build

The built documentation is available at docs/_build/index.html.

SBOM & vulnerability check

Install the SBOM dependencies:

uv sync --extra sbom

Generate a CycloneDX SBOM from the current environment:

uv run cyclonedx-py environment -o sbom.cdx.json --output-format json

Audit dependencies for known vulnerabilities:

uv run pip-audit --format json --output audit-report.json

To fail on any known vulnerability (useful in CI):

uv run pip-audit --strict