Skip to main content

A fundamental sentence splitter based on spacy.

Project description

Fun Sentence Splitter

A fundamental sentence splitter based on spacy.

Requirements

uv.

Local Dev Setup

Install dependencies and download the Spacy language model used in the tests:

uv sync
uv run python -m spacy download de_core_news_sm

Run static checks and tests:

uv run ruff check .
uv run mypy .
uv run pytest --cov=fun_sentence_splitter

Run Evaluation

./evaluate.sh path/to/splits_dir

path/to/splits_dir: directory containing pairs of *.split and *.txt files. .split files contain the expected sentences, each on a separate line. .txt files contain the original text to split.

The evaluation script will automatically update the spacy dependency and download the required language models.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fun_sentence_splitter-0.5.3814.20260724.tar.gz (59.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file fun_sentence_splitter-0.5.3814.20260724.tar.gz.

File metadata

  • Download URL: fun_sentence_splitter-0.5.3814.20260724.tar.gz
  • Upload date:
  • Size: 59.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for fun_sentence_splitter-0.5.3814.20260724.tar.gz
Algorithm Hash digest
SHA256 4ad50a1e3b2be9c692f2de784c8aa05763f308fa4634441eb486e63d0a1f8430
MD5 88a95d408a77e6b8105cf8525d04b7c5
BLAKE2b-256 5b24a66fc5c5c58239b609d42fc06c2e86f4dfb0020d25934bcce63f353e81cc

See more details on using hashes here.

File details

Details for the file fun_sentence_splitter-0.5.3814.20260724-py3-none-any.whl.

File metadata

  • Download URL: fun_sentence_splitter-0.5.3814.20260724-py3-none-any.whl
  • Upload date:
  • Size: 4.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for fun_sentence_splitter-0.5.3814.20260724-py3-none-any.whl
Algorithm Hash digest
SHA256 46101e6f7af5f8d3879a00f3152e2bb9803d53d7a1e69e9ab4e2b603cd2dcb21
MD5 9c4100c4182e0d25227f19ce98e2f461
BLAKE2b-256 233d1c2b46ccaf0a53cea20282d4932d8e69752e2f21a8deb15dd84cf3c6e213

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page