hlwy-lsh
LSH is a Python implementation of locality sensitive hashing with minhash. It is very useful for detecting near duplicate documents.
The implementation uses the MurmurHash v3 library to create document finger prints.
Cython is needed if you want to regenerate the .cpp files for the hashing and shingling code. By default the setup script uses the pregenerated .cpp sources, you can change this with the USE_CYTHON flag in setup.py
NumPy is needed to run the code.
The MurmurHash3 library is distributed under the MIT license. More information https://github.com/aappleby/smhasher
Installation
$ pip install hlwy-lsh
…
✨🍰✨
1 maintainer
Release files for hlwy-lsh 0.3.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| hlwy-lsh-0.3.6.tar.gz | 126.4 kB | Details |
Release files / hlwy-lsh-0.3.6.tar.gz
| Download URL | hlwy-lsh-0.3.6.tar.gz |
|---|---|
| Size | 126.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
b845bc7f74979bf4a0a8b02b747c68508e3c73a205827e737a3f370c2ef879d7
|
|
BLAKE2b-256 checksum How to use checksums |
bbd49e298f081e84d8af940e35c8e7684ec54b5b4cf5388479a6fb5e5e7340ab
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.14.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.35.0 CPython/3.7.4
|
