Fastdup Tool
Copyright (C) 2024 by Dr. Amir Alush and Dr. Danny Bickson.
fastdup is a tool for gaining insights from a large image/video collection. It can find anomalies, duplicate and near duplicate images/videos, clusters of similarity, learn the normal behavior and temporal interactions between images/videos. It can be used for smart subsampling of a higher quality dataset, outlier removal, novelty detection of new information to be sent for tagging.
fastdup is:
- Unsupervised: fits any dataset
- Scalable : handles 400M images on a single machine
- Efficient: works on CPU only
- Low Cost: can process 12M images on a $1 cloud machine budget
System Requirements
Supported Platforms:
- Linux
- macOS
Windows Support: Windows is not directly supported. However, Windows users can use fastdup via Windows Subsystem for Linux 2 (WSL2) by installing Ubuntu and following the Linux installation instructions.
3 maintainers
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distributions
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file fastdup-2.54-cp312-cp312-manylinux_2_31_x86_64.whl.
File metadata
- Download URL: fastdup-2.54-cp312-cp312-manylinux_2_31_x86_64.whl
- Upload date:
- Size: 87.4 MB
- Tags: CPython 3.12, manylinux: glibc 2.31+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
767f76f1bd4394c4d5c2536e20edde308ace066142a2a0288bf5d46d2e0a3f9a
|
|
| MD5 |
6f8df9e00cffbef705585e244c9a6aee
|
|
| BLAKE2b-256 |
8e29b8b8a1d07e8420b0075123bee5f5dbb5e9fada2254a1686c8eac9a8ca198
|
File details
Details for the file fastdup-2.54-cp312-cp312-macosx_11_0_arm64.whl.
File metadata
- Download URL: fastdup-2.54-cp312-cp312-macosx_11_0_arm64.whl
- Upload date:
- Size: 48.9 MB
- Tags: CPython 3.12, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.8.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
db35363999eae835d973e0d7019f13f20bcfc376edc4dcee25b8f961d63d94cc
|
|
| MD5 |
a36f626f66444cd3d2baf7dee6a93803
|
|
| BLAKE2b-256 |
04bbb94f39895b534e43e712b6e1622e003dec7330bd7e635be268f0d89575d4
|
File details
Details for the file fastdup-2.54-cp311-cp311-manylinux_2_31_x86_64.whl.
File metadata
- Download URL: fastdup-2.54-cp311-cp311-manylinux_2_31_x86_64.whl
- Upload date:
- Size: 87.4 MB
- Tags: CPython 3.11, manylinux: glibc 2.31+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
841679961bc074c809559094eca6e2d263fcf3a43570216a11aed57a3a30350f
|
|
| MD5 |
068648446bca5a68ebefb390c65bf627
|
|
| BLAKE2b-256 |
698c4c150d1582244ce91ec4822b90ccee55764db6ea2d7b67633467759750e9
|
File details
Details for the file fastdup-2.54-cp311-cp311-macosx_11_0_arm64.whl.
File metadata
- Download URL: fastdup-2.54-cp311-cp311-macosx_11_0_arm64.whl
- Upload date:
- Size: 48.9 MB
- Tags: CPython 3.11, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.8.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f450f2945f9b9006816b6424e7f261e75d7e52a68f6a6a383d9b414d5714b71e
|
|
| MD5 |
bbee5bda7c985f06f3094092e96f7239
|
|
| BLAKE2b-256 |
433008174fa3a2a7ffd4c8dbf2869f8cf07be02785e010383f590fa1d5ae8c7b
|
File details
Details for the file fastdup-2.54-cp310-cp310-manylinux_2_31_x86_64.whl.
File metadata
- Download URL: fastdup-2.54-cp310-cp310-manylinux_2_31_x86_64.whl
- Upload date:
- Size: 87.4 MB
- Tags: CPython 3.10, manylinux: glibc 2.31+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9fd1c8e06de14787531cb0ac29195226a1e2b8ca1bcafd817771cf926fd13133
|
|
| MD5 |
a25954546d8578ca4a905637ffee5324
|
|
| BLAKE2b-256 |
92fcfe6d2fe2fe820c8354001780691edd54e47de008e269c936d363a0b44474
|
File details
Details for the file fastdup-2.54-cp310-cp310-macosx_11_0_arm64.whl.
File metadata
- Download URL: fastdup-2.54-cp310-cp310-macosx_11_0_arm64.whl
- Upload date:
- Size: 48.9 MB
- Tags: CPython 3.10, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.8.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3e9f8fe1b3c2767d14ad33b1be564980645665b3c72757d0df2ca02234dfa998
|
|
| MD5 |
f126d44356402ec5ba595bc0e38b8bcd
|
|
| BLAKE2b-256 |
07725e58d67ff1c9016947340095f88b0decbc4b6cb801e5b6019e430d3dd13e
|
File details
Details for the file fastdup-2.54-cp39-cp39-manylinux_2_31_x86_64.whl.
File metadata
- Download URL: fastdup-2.54-cp39-cp39-manylinux_2_31_x86_64.whl
- Upload date:
- Size: 87.4 MB
- Tags: CPython 3.9, manylinux: glibc 2.31+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
584742d1add10a755e47941eaa39d4606e1d12bd8a425cf37734f3dbd1cb0e7f
|
|
| MD5 |
96fbcfaa791f8ed78845d84317cad38c
|
|
| BLAKE2b-256 |
ace5026660be163a7e7349905a1668f4f9eef9ae308bde1d0a0b884da2141108
|
File details
Details for the file fastdup-2.54-cp39-cp39-macosx_11_0_arm64.whl.
File metadata
- Download URL: fastdup-2.54-cp39-cp39-macosx_11_0_arm64.whl
- Upload date:
- Size: 48.9 MB
- Tags: CPython 3.9, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.8.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
cf248f5b6d9e5564999766eae3d7350966113a05b97d06fdb12e6a5f9beffe58
|
|
| MD5 |
ace7860c5b3eb025871c4030cdd97b35
|
|
| BLAKE2b-256 |
913a2b8debf499bcaff86260a49c7be0ee9b010b37c2b777ec69a30556e950f3
|
