Skip to main content

A fundamental sentence splitter based on spacy.

Project description

Fun Sentence Splitter

A fundamental sentence splitter based on spacy.

Requirements

Python 3.10 or higher and poetry.

Local Dev Setup

Download the Spacy language model used in the tests:

python -m spacy download de_core_news_sm

Run static checks and tests:

ruff check .
mypy .
pytest --cov=fun_sentence_splitter

Run Evaluation

./evaluate.sh path/to/splits_dir

path/to/splits_dir: directory containing pairs of *.split and *.txt files. .split files contain the expected sentences, each on a separate line. .txt files contain the original text to split.

The evaluation script will automatically update the spacy dependency and download the required language models.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fun_sentence_splitter-0.3.3811.20260219.tar.gz (3.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file fun_sentence_splitter-0.3.3811.20260219.tar.gz.

File metadata

File hashes

Hashes for fun_sentence_splitter-0.3.3811.20260219.tar.gz
Algorithm Hash digest
SHA256 cb9ddfdbd71f9315ffe9547fc1cd6bf7e60fb47ac6817bb6f2326a04c4fcdbc4
MD5 5ee0f6652b8be61dc08eb3562e5f86c6
BLAKE2b-256 566fc12f7526ea51eeeb52d2362286b046f08ffd2abff29f62bbd035b6afd623

See more details on using hashes here.

File details

Details for the file fun_sentence_splitter-0.3.3811.20260219-py3-none-any.whl.

File metadata

File hashes

Hashes for fun_sentence_splitter-0.3.3811.20260219-py3-none-any.whl
Algorithm Hash digest
SHA256 11458db4e0a899c6b04f9b745b0b5220916080670eb19a5e8e885d5c41778366
MD5 25901abb1e80e1b7492d768c40eb09ca
BLAKE2b-256 bd652ecdc92e6dbe1cf784a01188c3b4ca68b6031e935f67d263c77f0b301831

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page