dedupe is a library that uses machine learning to perform de-duplication and entity resolution quickly on structured data.
dedupe will help you:
remove duplicate entries from a spreadsheet of names and addresses
link a list with customer information to another with order history, even without unique customer id’s
take a database of campaign contributions and figure out which ones were made by the same person, even if the names were entered slightly differently for each record
dedupe takes in human training data and comes up with the best rules for your dataset to quickly and automatically find similar records, even with very large databases.
Important links:
Documentation: https://dedupe.readthedocs.io/
Repository: https://github.com/datamade/dedupe
Mailing list: https://groups.google.com/forum/#!forum/open-source-deduplication
IRC channel, #dedupe on irc.freenode.net
2 maintainers
Release files for dedupe 1.6.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| dedupe-1.6.5.tar.gz | 47.3 kB | Details |
Built distributions (wheels)
| File | Reset | |||
|---|---|---|---|---|
| dedupe-1.6.5-cp35-cp35m-manylinux1_x86_64.whl | CPython 3.5 | CPython 3.5 pymalloc | Linux glibc 2.5+ x86-64 | Details |
| dedupe-1.6.5-cp35-cp35m-manylinux1_i686.whl | CPython 3.5 | CPython 3.5 pymalloc | Linux glibc 2.5+ x86-32 | Details |
| dedupe-1.6.5-cp35-cp35m-macosx_10_11_x86_64.whl | CPython 3.5 | CPython 3.5 pymalloc | macOS 10.11+ x86-64 | Details |
| dedupe-1.6.5-cp34-cp34m-win_amd64.whl | CPython 3.4 | CPython 3.4 pymalloc | Windows x86-64 | Details |
| dedupe-1.6.5-cp34-cp34m-win32.whl | CPython 3.4 | CPython 3.4 pymalloc | Windows x86-32 | Details |
| dedupe-1.6.5-cp34-cp34m-manylinux1_x86_64.whl | CPython 3.4 | CPython 3.4 pymalloc | Linux glibc 2.5+ x86-64 | Details |
| dedupe-1.6.5-cp34-cp34m-manylinux1_i686.whl | CPython 3.4 | CPython 3.4 pymalloc | Linux glibc 2.5+ x86-32 | Details |
| dedupe-1.6.5-cp27-cp27mu-manylinux1_x86_64.whl | CPython 2.7 | CPython 2.7 pymalloc wide-unicode | Linux glibc 2.5+ x86-64 | Details |
| dedupe-1.6.5-cp27-cp27mu-manylinux1_i686.whl | CPython 2.7 | CPython 2.7 pymalloc wide-unicode | Linux glibc 2.5+ x86-32 | Details |
| dedupe-1.6.5-cp27-cp27m-win_amd64.whl | CPython 2.7 | CPython 2.7 pymalloc | Windows x86-64 | Details |
| dedupe-1.6.5-cp27-cp27m-win32.whl | CPython 2.7 | CPython 2.7 pymalloc | Windows x86-32 | Details |
| dedupe-1.6.5-cp27-cp27m-manylinux1_x86_64.whl | CPython 2.7 | CPython 2.7 pymalloc | Linux glibc 2.5+ x86-64 | Details |
| dedupe-1.6.5-cp27-cp27m-manylinux1_i686.whl | CPython 2.7 | CPython 2.7 pymalloc | Linux glibc 2.5+ x86-32 | Details |
| dedupe-1.6.5-cp27-cp27m-macosx_10_11_x86_64.whl | CPython 2.7 | CPython 2.7 pymalloc | macOS 10.11+ x86-64 | Details |
Total release size: 914.7 kB
Release files / dedupe-1.6.5.tar.gz
| Download URL | dedupe-1.6.5.tar.gz |
|---|---|
| Size | 47.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
cae7fc92501c0884c85b69b9d1281c693c7268b3b9277b38aaf507dd5d72a51a
|
|
BLAKE2b-256 checksum How to use checksums |
64f6974787b9f5eb8f22fd887a400a24bb1d3ef522a8add8831560838cde9267
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp35-cp35m-manylinux1_x86_64.whl
| Download URL | dedupe-1.6.5-cp35-cp35m-manylinux1_x86_64.whl |
|---|---|
| Size | 73.7 kB |
| Tags | CPython 3.5 CPython 3.5 pymalloc Linux glibc 2.5+ x86-64 |
|
SHA-256 checksum How to use checksums |
cd0034ac455ee281a57a9028d58ee663d1e12ced0048eb4095caacef5c66d501
|
|
BLAKE2b-256 checksum How to use checksums |
5e66e391038a169ed5ba204172f0d7b2e52b3dbb791c5ae100a884f297e91458
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp35-cp35m-manylinux1_i686.whl
| Download URL | dedupe-1.6.5-cp35-cp35m-manylinux1_i686.whl |
|---|---|
| Size | 70.4 kB |
| Tags | CPython 3.5 CPython 3.5 pymalloc Linux glibc 2.5+ x86-32 |
|
SHA-256 checksum How to use checksums |
ce598a853a68442d323203b49c07f5bf12360107c0919c64ff52acde55a4155e
|
|
BLAKE2b-256 checksum How to use checksums |
d05fe95ea1b77e2452d0007ba40da5bc8f078bb45832de87164f88b056b0a41a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp35-cp35m-macosx_10_11_x86_64.whl
| Download URL | dedupe-1.6.5-cp35-cp35m-macosx_10_11_x86_64.whl |
|---|---|
| Size | 49.5 kB |
| Tags | CPython 3.5 CPython 3.5 pymalloc macOS 10.11+ x86-64 |
|
SHA-256 checksum How to use checksums |
36d5eafd0535fdaa5f58ec579c6c9e57121dca8a4a6c661607aaaa67e55ccc86
|
|
BLAKE2b-256 checksum How to use checksums |
86946eebf0c200d2cffe57563ae0a32ecbc5d30d43ffa027932cf9f54df9446d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp34-cp34m-win_amd64.whl
| Download URL | dedupe-1.6.5-cp34-cp34m-win_amd64.whl |
|---|---|
| Size | 50.2 kB |
| Tags | CPython 3.4 CPython 3.4 pymalloc Windows x86-64 |
|
SHA-256 checksum How to use checksums |
7eec6cf477a90f689920615f1fbc1962e3189897419d8f2ce86118090fba4389
|
|
BLAKE2b-256 checksum How to use checksums |
0d7b32a1de1bd98b2a333228f9b7a638aa4784aff1813ab68e1226165a8c6d06
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp34-cp34m-win32.whl
| Download URL | dedupe-1.6.5-cp34-cp34m-win32.whl |
|---|---|
| Size | 49.5 kB |
| Tags | CPython 3.4 CPython 3.4 pymalloc Windows x86-32 |
|
SHA-256 checksum How to use checksums |
acb79d95bcbfbd9718ec3203a0438b24898b5de01d52e5df0215637c77a5f29d
|
|
BLAKE2b-256 checksum How to use checksums |
f7a60768852dbf9e3e221484806fe378e15d848adc775bf7719bf1f3cc490d78
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp34-cp34m-manylinux1_x86_64.whl
| Download URL | dedupe-1.6.5-cp34-cp34m-manylinux1_x86_64.whl |
|---|---|
| Size | 73.8 kB |
| Tags | CPython 3.4 CPython 3.4 pymalloc Linux glibc 2.5+ x86-64 |
|
SHA-256 checksum How to use checksums |
f6089318834610724fe959d4434ff17e5a27167bef84292321383149c06c546c
|
|
BLAKE2b-256 checksum How to use checksums |
9737072b5c180789c37b72442c4d6ae5aa03ebd94f85d5d2221f64f0568bd899
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp34-cp34m-manylinux1_i686.whl
| Download URL | dedupe-1.6.5-cp34-cp34m-manylinux1_i686.whl |
|---|---|
| Size | 70.5 kB |
| Tags | CPython 3.4 CPython 3.4 pymalloc Linux glibc 2.5+ x86-32 |
|
SHA-256 checksum How to use checksums |
bdbbfebe758ef64ef1ba66900547e04e5d9e889bd9f817e86b55329cfbdf7e42
|
|
BLAKE2b-256 checksum How to use checksums |
86a85d118c43493c79e670f89a7ed38cc83de997fcf6316d229ce5bc3dc59d39
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp27-cp27mu-manylinux1_x86_64.whl
| Download URL | dedupe-1.6.5-cp27-cp27mu-manylinux1_x86_64.whl |
|---|---|
| Size | 71.5 kB |
| Tags | CPython 2.7 CPython 2.7 pymalloc wide-unicode Linux glibc 2.5+ x86-64 |
|
SHA-256 checksum How to use checksums |
3603afd5653e776db290c4c9bb3b87de6ae07ff092dd3800582483a0e4b2f3ff
|
|
BLAKE2b-256 checksum How to use checksums |
6cd663518c72a15b35a65955eccf84c56475e4753a94d029f0a1977ea84ad64c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp27-cp27mu-manylinux1_i686.whl
| Download URL | dedupe-1.6.5-cp27-cp27mu-manylinux1_i686.whl |
|---|---|
| Size | 68.9 kB |
| Tags | CPython 2.7 CPython 2.7 pymalloc wide-unicode Linux glibc 2.5+ x86-32 |
|
SHA-256 checksum How to use checksums |
0410b4c0768cf22710d08985f783456f486b460633341022b65b6a13bb860986
|
|
BLAKE2b-256 checksum How to use checksums |
2957d38a9deb24bfe8fc6e49b5d45ef84cd2d59ab2bc721ece1da84e106d3fef
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp27-cp27m-win_amd64.whl
| Download URL | dedupe-1.6.5-cp27-cp27m-win_amd64.whl |
|---|---|
| Size | 50.3 kB |
| Tags | CPython 2.7 CPython 2.7 pymalloc Windows x86-64 |
|
SHA-256 checksum How to use checksums |
1b37d31efdf1f50ab5f454347d37fd013da4974ddcba8e91959002e9f1160ac2
|
|
BLAKE2b-256 checksum How to use checksums |
93d7d61afc52ca21045118ea6a7a1ee12a91b8e7698e5bd92e922505481cc25b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp27-cp27m-win32.whl
| Download URL | dedupe-1.6.5-cp27-cp27m-win32.whl |
|---|---|
| Size | 49.5 kB |
| Tags | CPython 2.7 CPython 2.7 pymalloc Windows x86-32 |
|
SHA-256 checksum How to use checksums |
584cc3926c0936499f5afc7a4eb09b28f60a4e35a96cb74616ab235be4500949
|
|
BLAKE2b-256 checksum How to use checksums |
d68d8dd63aba00ed2e82e6ca06cc1758ccc0af57e294d6380c777e2623a3b56d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp27-cp27m-manylinux1_x86_64.whl
| Download URL | dedupe-1.6.5-cp27-cp27m-manylinux1_x86_64.whl |
|---|---|
| Size | 71.5 kB |
| Tags | CPython 2.7 CPython 2.7 pymalloc Linux glibc 2.5+ x86-64 |
|
SHA-256 checksum How to use checksums |
d25c355373dc581c6f7317d9f943809b837e71ad1fbc3b4e0b72c6eb93e88b28
|
|
BLAKE2b-256 checksum How to use checksums |
b000dd6a9ada04ba2beec9661cee653fab34a9cbff923d522e1b744f37a67b61
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp27-cp27m-manylinux1_i686.whl
| Download URL | dedupe-1.6.5-cp27-cp27m-manylinux1_i686.whl |
|---|---|
| Size | 68.9 kB |
| Tags | CPython 2.7 CPython 2.7 pymalloc Linux glibc 2.5+ x86-32 |
|
SHA-256 checksum How to use checksums |
b432ae0e85ba5eaa5da6f374af54f1b62e568e4bf2cbc7fde7299f6c42d59966
|
|
BLAKE2b-256 checksum How to use checksums |
b707ff09360e4af827eef283bc54e275b85c8cd44a9f593c1e661adcf07d7937
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / dedupe-1.6.5-cp27-cp27m-macosx_10_11_x86_64.whl
| Download URL | dedupe-1.6.5-cp27-cp27m-macosx_10_11_x86_64.whl |
|---|---|
| Size | 49.1 kB |
| Tags | CPython 2.7 CPython 2.7 pymalloc macOS 10.11+ x86-64 |
|
SHA-256 checksum How to use checksums |
3e9aff6f86d693467ca2c5561b9b8a5073d46273e53ec260efb52baba84bdbb3
|
|
BLAKE2b-256 checksum How to use checksums |
9235b1a87192fd4868ee0ff804776680dbbc83df2b643f625cfabcbdc9bcce04
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
