pysegmenters-md_splitter 1.8.49

Markdown splitter segmenter

pysegmenters_md_splitter

Rule based segmenter based on Spacy

Installation

You can simply pip install pysegmenters_md_splitter.

Developing

Pre-requesites

You will need to install flit (for building the package) and tox (for orchestrating testing and documentation building):

python3 -m pip install flit tox

Clone the repository:

git clone https://github.com/oterrier/pysegmenters_md_splitter

Running the test suite

You can run the full test suite against all supported versions of Python (3.8) with:

tox

Building the documentation

You can build the HTML documentation with:

tox -e docs

The built documentation is available at `docs/_build/index.html.

SBOM & vulnerability check

Install the SBOM dependencies:

uv sync --extra sbom

Generate a CycloneDX SBOM from the current environment:

uv run cyclonedx-py environment -o sbom.cdx.json --output-format json

Audit dependencies for known vulnerabilities:

uv run pip-audit --format json --output audit-report.json

To fail on any known vulnerability (useful in CI):

uv run pip-audit --strict