Preprocess German texts for serious NLP.
Project description
German Preprocessing

Preprocess German texts to do some serious natural-language processing.
- clean texts
- remove stopwords (as defined by spaCy)
- lemmatize
- lower-case, and remove all punctions, digits are replaced with "0"
Installation
pip install german
Usage
from german import preprocess preprocess(['Johannes war einer von vielen guten Schülern.', 'Julia trinkt gern Tee.'], remove_stop=True) # ['johannes gut schüler', 'julia trinken tee']
License
MIT.
Sponsoring
This work was created as part of a project that was funded by the German Federal Ministry of Education and Research.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Filename, size | File type | Python version | Upload date | Hashes |
---|---|---|---|---|
Filename, size german-0.1.0-py2-none-any.whl (3.3 kB) | File type Wheel | Python version py2 | Upload date | Hashes View |
Filename, size german-0.1.0-py3-none-any.whl (3.3 kB) | File type Wheel | Python version py3 | Upload date | Hashes View |
Filename, size german-0.1.0.tar.gz (2.1 kB) | File type Source | Python version None | Upload date | Hashes View |