German Preprocessing

Preprocess German texts to do some serious natural-language processing.
- clean texts
- remove stopwords (as defined by spaCy)
- lemmatize
- lower-case, and remove all punctions, digits are replaced with "0"
Installation
pip install german
Usage
from german import preprocess
preprocess(['Johannes war einer von vielen guten Schülern.', 'Julia trinkt gern Tee.'], remove_stop=True)
# ['johannes gut schüler', 'julia trinken tee']
License
MIT.
Sponsoring
This work was created as part of a project that was funded by the German Federal Ministry of Education and Research.
Release files for german 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| german-0.1.0.tar.gz | 2.1 kB | Details |
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| german-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
| german-0.1.0-py2-none-any.whl | Python 2 | none | any | Details |
Total release size: 8.7 kB
Release files / german-0.1.0.tar.gz
| Download URL | german-0.1.0.tar.gz |
|---|---|
| Size | 2.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a078711a05b8207e22e3f8c1f58eefa0c155a07df1275a5b1c3e38029efaf14c
|
|
BLAKE2b-256 checksum How to use checksums |
3c01a7837bdbb47b59101d5468d9b1a6c6143a378df03b03144e963041c669fd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.3
|
Release files / german-0.1.0-py3-none-any.whl
| Download URL | german-0.1.0-py3-none-any.whl |
|---|---|
| Size | 3.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
547635261f1bf1a338052034f177c5d5f6dfffe9aad10ef152d60a4de8ff58ba
|
|
BLAKE2b-256 checksum How to use checksums |
bedda5a6e235538d803fbe39468a897196b38dcaa8dc6aba8902e2f658ac2ddf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.3
|
Release files / german-0.1.0-py2-none-any.whl
| Download URL | german-0.1.0-py2-none-any.whl |
|---|---|
| Size | 3.3 kB |
| Tags | Python 2 |
|
SHA-256 checksum How to use checksums |
028fb365a9e8b1c5f57f957f0fe1c39dc7df386081572f9fabe2a34c9929c823
|
|
BLAKE2b-256 checksum How to use checksums |
904dafc3a979b4a395fc647ec98bda92a7f1843b35a3be9f94940c0b14aae37b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.3
|