A fundamental sentence splitter based on spacy.
Project description
Fun Sentence Splitter
A fundamental sentence splitter based on spacy.
Requirements
Python 3.10 or higher and poetry.
Local Dev Setup
Download the Spacy language model used in the tests:
python -m spacy download de_core_news_sm
Run static checks and tests:
ruff .
mypy .
pytest --cov=fun_sentence_splitter
Run Evaluation
./evaluate.sh path/to/splits_dir
path/to/splits_dir
: directory containing pairs of *.split and *.txt files. .split files contain the expected
sentences, each on a separate line. .txt files contain the original text to split.
The evaluation script will automatically update the spacy dependency and download the required language models.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for fun_sentence_splitter-0.3.372.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5bbccc593fccdefcdabbf6dbf03a14e33f305ae06301847ae914af719d750c8d |
|
MD5 | 5a55eacc267cb3cb2f568e02272838b0 |
|
BLAKE2b-256 | 067576a2e0efe8b75b93d0b52d96520ed221c151821963ebf76dc627650a0296 |
Close
Hashes for fun_sentence_splitter-0.3.372-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 23fa64fede578f2b8e33e556eca8e46102ac5f91b05a4271a5706d2e2da70019 |
|
MD5 | 5c8275199811c20e6189ef9e92d0df05 |
|
BLAKE2b-256 | 0cacf5ea7a885606626ee63dc16d3892c2b0ef3592e8d50df8d5d62299f3634c |