Skip to main content
Archived

This project has been archived by its maintainers, and is no longer receiving any updates.

pycld3

Python bindings to the Compact Language Detector v3 (CLD3).

This package contains Python bindings (via Cython) to Google's CLD3 library.

Installation

Install via Pip:

$ python -m pip installa pycld3

Building from Source

To build this extension, you will need:

  • Cython
  • Protobuf, including the protoc Protobuf compiler available as an executable

Building the extension does not require the Chromium repository.

Usage

cld3 exports two module-level functions, get_language() and get_frequent_languages():

>>> import cld3

>>> cld3.get_language("影響包含對氣候的變化以及自然資源的枯竭程度")
LanguagePrediction(language='zh', probability=0.999969482421875, is_reliable=True, proportion=1.0)

>>> cld3.get_language("This is a test")
LanguagePrediction(language='en', probability=0.9999980926513672, is_reliable=True, proportion=1.0)

>>> for lang in cld3.get_frequent_languages(
...     "This piece of text is in English. Този текст е на Български.",
...     num_langs=3
... ):
...     print(lang)
...
LanguagePrediction(language='bg', probability=0.9173890948295593, is_reliable=True, proportion=0.5853658318519592)
LanguagePrediction(language='en', probability=0.9999790191650391, is_reliable=True, proportion=0.4146341383457184)
LanguagePrediction(language='und', probability=0.0, is_reliable=False, proportion=0.0)

FAQ

cld3 incorrectly detects my input, how can I fix this?

In some cases, you cannot. Language detection algorithms in general may perform poorly with very short inputs. Rarely should you trust the output of something like detect("hi"). Keep this limitation in mind regardless of what library you are using.

How do I fix an error telling me "The Protobuf compiler, protoc, could not be found"?

The Protobuf compiler, protoc, is required for building this package. (However, if you are installing from PyPI with pip, then the .h and .cc files generated with protoc will already be included.)

Below are some quick install commands, but please consult the official protobuf repository for information on installing Protobuf.

Ubuntu Linux:

$ sudo apt-get update
$ sudo apt-get install protobuf-compiler

Mac OSX:

$ brew update && brew install protobuf

Authors

This repository contains a fork of google/cld3 at commit 06f695f. The license for google/cld3 can be found at LICENSES/CLD3_LICENSE.

This repository is a combination of changes introduced by various forks of google/cld3 by the following people:

Metadata

Release files for pycld3 0.5

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pycld3 0.5
File Size Uploaded Provenance Actions
pycld3-0.5.tar.gz 684.0 kB Without provenance Details for pycld3-0.5.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for pycld3 0.5
File Interpreter ABI Platform Actions
pycld3-0.5-cp37-cp37m-macosx_10_14_x86_64.whl CPython 3.7 CPython 3.7 pymalloc macOS 10.14+ x86-64 Details for pycld3-0.5-cp37-cp37m-macosx_10_14_x86_64.whl

Total release size: 1.2 MB

Release files / pycld3-0.5.tar.gz

Download URL pycld3-0.5.tar.gz
Size 684.0 kB
Tags Source
SHA-256 checksum
How to use checksums
6a6bcd405e381da9bf3e18b83fafdaf13552a4c3c83e729fd445178ffcd2ccbd
BLAKE2b-256 checksum
How to use checksums
6a539c81791dd64dc3debba68fa7eddddb5afc26d3e15b74c8aa5092d0ad85be
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.4

Release files / pycld3-0.5-cp37-cp37m-macosx_10_14_x86_64.whl

Download URL pycld3-0.5-cp37-cp37m-macosx_10_14_x86_64.whl
Size 513.5 kB
Tags CPython 3.7 CPython 3.7 pymalloc macOS 10.14+ x86-64
SHA-256 checksum
How to use checksums
3de6a597a03d5b1c5f15408aff5b87e60d4641cccbcd9f73cd3ff44d6d3e0d83
BLAKE2b-256 checksum
How to use checksums
2b0098ae2962eb5d96c94704802cf639214fa36596f04fc1463cea7bc9ab3aa4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.4

Security for pycld3 0.5

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page