language-detector

language-detector detects the language of text

Installation

pip install language-detector

Works with both Python 2 and 3

from language_detector import detect_language
text = "I arrived in that city on January 4, 1937"
language = detect_language(text)
# prints English

To test the package run

python -m unittest language_detector.tests.test

Test is a comparison of how well language-detector and langid identify languages in the data sources.

package	language-detector	langid
test-duration (in seconds)	0.10	3.83
accuracy	96.77%	67.74%

If you don't want language-detector to look for certain languages, you can monkey-patch the code. For example, in order to exclude English:

import language_detector
language_detector.char_language = [cl for cl in char_language if cl[1] != "English"]

# proceed as normal

The following is a list of datasets used for each language:

If you'd like to contribute a new language, please consult CONTRIBUTING.md

Contact the package author, Daniel J. Dufour, at daniel.j.dufour@gmail.com

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

language-detector-5.0.2.tar.gz (6.6 kB view details)

Uploaded Mar 29, 2020 Source

Details for the file language-detector-5.0.2.tar.gz.

Download URL: language-detector-5.0.2.tar.gz
Upload date: Mar 29, 2020
Size: 6.6 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/44.1.0 requests-toolbelt/0.9.1 tqdm/4.44.0 CPython/2.7.17