Skip to main content

German Preprocessing Build Status PyPI PyPI - Python Version

Preprocess German texts to do some serious natural-language processing.

  • clean texts
  • remove stopwords (as defined by spaCy)
  • lemmatize
  • lower-case, and remove all punctions, digits are replaced with "0"

Installation

pip install german

Usage

from german import preprocess

preprocess(['Johannes war einer von vielen guten Schülern.', 'Julia trinkt gern Tee.'], remove_stop=True)
# ['johannes gut schüler', 'julia trinken tee']

License

MIT.

Sponsoring

This work was created as part of a project that was funded by the German Federal Ministry of Education and Research.

Release files for german 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for german 0.1.0
File Size Uploaded
german-0.1.0.tar.gz 2.1 kB Details

Built distributions (wheels)

Table of built distributions (wheels) for german 0.1.0
File Interpreter ABI Platform
german-0.1.0-py3-none-any.whl Python 3 none any Details
german-0.1.0-py2-none-any.whl Python 2 none any Details

Total release size: 8.7 kB

Release files / german-0.1.0.tar.gz

Download URL german-0.1.0.tar.gz
Size 2.1 kB
Tags Source
SHA-256 checksum
How to use checksums
a078711a05b8207e22e3f8c1f58eefa0c155a07df1275a5b1c3e38029efaf14c
BLAKE2b-256 checksum
How to use checksums
3c01a7837bdbb47b59101d5468d9b1a6c6143a378df03b03144e963041c669fd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.3

Release files / german-0.1.0-py3-none-any.whl

Download URL german-0.1.0-py3-none-any.whl
Size 3.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
547635261f1bf1a338052034f177c5d5f6dfffe9aad10ef152d60a4de8ff58ba
BLAKE2b-256 checksum
How to use checksums
bedda5a6e235538d803fbe39468a897196b38dcaa8dc6aba8902e2f658ac2ddf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.3

Release files / german-0.1.0-py2-none-any.whl

Download URL german-0.1.0-py2-none-any.whl
Size 3.3 kB
Tags Python 2
SHA-256 checksum
How to use checksums
028fb365a9e8b1c5f57f957f0fe1c39dc7df386081572f9fabe2a34c9929c823
BLAKE2b-256 checksum
How to use checksums
904dafc3a979b4a395fc647ec98bda92a7f1843b35a3be9f94940c0b14aae37b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.3

Release history Release notifications | RSS feed

This release

0.1.0 This release

3 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page