Skip to main content

A fundamental sentence splitter based on spacy.

Project description

Fun Sentence Splitter

A fundamental sentence splitter based on spacy.

Requirements

Python 3.10 or higher and poetry.

Local Dev Setup

Download the Spacy language model used in the tests:

python -m spacy download de_core_news_sm

Run static checks and tests:

ruff check .
mypy .
pytest --cov=fun_sentence_splitter

Run Evaluation

./evaluate.sh path/to/splits_dir

path/to/splits_dir: directory containing pairs of *.split and *.txt files. .split files contain the expected sentences, each on a separate line. .txt files contain the original text to split.

The evaluation script will automatically update the spacy dependency and download the required language models.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fun_sentence_splitter-0.4.3811.20260724.tar.gz (3.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file fun_sentence_splitter-0.4.3811.20260724.tar.gz.

File metadata

File hashes

Hashes for fun_sentence_splitter-0.4.3811.20260724.tar.gz
Algorithm Hash digest
SHA256 086bfe5989ab2ebb53cf098fda50fb5e16e1f972320b4f9745e688155e9ef9bb
MD5 8e9589e9ef0f0776721e7305672d253d
BLAKE2b-256 8718b32a9b6ee96c0803809109c4c14d217ee6d3a5d28e81b1ba0791fac8d8f6

See more details on using hashes here.

File details

Details for the file fun_sentence_splitter-0.4.3811.20260724-py3-none-any.whl.

File metadata

File hashes

Hashes for fun_sentence_splitter-0.4.3811.20260724-py3-none-any.whl
Algorithm Hash digest
SHA256 bb869721febf557a4d1fa8bd35a2ac8a768f904605a720436337c23d7aa55ba3
MD5 87836f7803fddb1973e799c10be4174c
BLAKE2b-256 bc447c85b8ba2b0b75c4426110ca7ddea8f308e1d221318df3ea93b27bcb4260

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page