Fastdup Tool
Copyright (C) 2024 by Dr. Amir Alush and Dr. Danny Bickson.
fastdup is a tool for gaining insights from a large image/video collection. It can find anomalies, duplicate and near duplicate images/videos, clusters of similarity, learn the normal behavior and temporal interactions between images/videos. It can be used for smart subsampling of a higher quality dataset, outlier removal, novelty detection of new information to be sent for tagging.
fastdup is:
- Unsupervised: fits any dataset
- Scalable : handles 400M images on a single machine
- Efficient: works on CPU only
- Low Cost: can process 12M images on a $1 cloud machine budget
System Requirements
Supported Platforms:
- Linux
- macOS
Windows Support: Windows is not directly supported. However, Windows users can use fastdup via Windows Subsystem for Linux 2 (WSL2) by installing Ubuntu and following the Linux installation instructions.
3 maintainers
Release files for fastdup 2.54
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Reset | |||
|---|---|---|---|---|
| fastdup-2.54-cp312-cp312-manylinux_2_31_x86_64.whl | CPython 3.12 | CPython 3.12 | Linux glibc 2.31+ x86-64 | Details |
| fastdup-2.54-cp312-cp312-macosx_11_0_arm64.whl | CPython 3.12 | CPython 3.12 | macOS 11.0+ ARM64 | Details |
| fastdup-2.54-cp311-cp311-manylinux_2_31_x86_64.whl | CPython 3.11 | CPython 3.11 | Linux glibc 2.31+ x86-64 | Details |
| fastdup-2.54-cp311-cp311-macosx_11_0_arm64.whl | CPython 3.11 | CPython 3.11 | macOS 11.0+ ARM64 | Details |
| fastdup-2.54-cp310-cp310-manylinux_2_31_x86_64.whl | CPython 3.10 | CPython 3.10 | Linux glibc 2.31+ x86-64 | Details |
| fastdup-2.54-cp310-cp310-macosx_11_0_arm64.whl | CPython 3.10 | CPython 3.10 | macOS 11.0+ ARM64 | Details |
| fastdup-2.54-cp39-cp39-manylinux_2_31_x86_64.whl | CPython 3.9 | CPython 3.9 | Linux glibc 2.31+ x86-64 | Details |
| fastdup-2.54-cp39-cp39-macosx_11_0_arm64.whl | CPython 3.9 | CPython 3.9 | macOS 11.0+ ARM64 | Details |
Total release size: 545.2 MB
Release files / fastdup-2.54-cp312-cp312-manylinux_2_31_x86_64.whl
| Download URL | fastdup-2.54-cp312-cp312-manylinux_2_31_x86_64.whl |
|---|---|
| Size | 87.4 MB |
| Tags | CPython 3.12 Linux glibc 2.31+ x86-64 |
|
SHA-256 checksum How to use checksums |
767f76f1bd4394c4d5c2536e20edde308ace066142a2a0288bf5d46d2e0a3f9a
|
|
BLAKE2b-256 checksum How to use checksums |
8e29b8b8a1d07e8420b0075123bee5f5dbb5e9fada2254a1686c8eac9a8ca198
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.8
|
Release files / fastdup-2.54-cp312-cp312-macosx_11_0_arm64.whl
| Download URL | fastdup-2.54-cp312-cp312-macosx_11_0_arm64.whl |
|---|---|
| Size | 48.9 MB |
| Tags | CPython 3.12 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
db35363999eae835d973e0d7019f13f20bcfc376edc4dcee25b8f961d63d94cc
|
|
BLAKE2b-256 checksum How to use checksums |
04bbb94f39895b534e43e712b6e1622e003dec7330bd7e635be268f0d89575d4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.8.16
|
Release files / fastdup-2.54-cp311-cp311-manylinux_2_31_x86_64.whl
| Download URL | fastdup-2.54-cp311-cp311-manylinux_2_31_x86_64.whl |
|---|---|
| Size | 87.4 MB |
| Tags | CPython 3.11 Linux glibc 2.31+ x86-64 |
|
SHA-256 checksum How to use checksums |
841679961bc074c809559094eca6e2d263fcf3a43570216a11aed57a3a30350f
|
|
BLAKE2b-256 checksum How to use checksums |
698c4c150d1582244ce91ec4822b90ccee55764db6ea2d7b67633467759750e9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.8
|
Release files / fastdup-2.54-cp311-cp311-macosx_11_0_arm64.whl
| Download URL | fastdup-2.54-cp311-cp311-macosx_11_0_arm64.whl |
|---|---|
| Size | 48.9 MB |
| Tags | CPython 3.11 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
f450f2945f9b9006816b6424e7f261e75d7e52a68f6a6a383d9b414d5714b71e
|
|
BLAKE2b-256 checksum How to use checksums |
433008174fa3a2a7ffd4c8dbf2869f8cf07be02785e010383f590fa1d5ae8c7b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.8.16
|
Release files / fastdup-2.54-cp310-cp310-manylinux_2_31_x86_64.whl
| Download URL | fastdup-2.54-cp310-cp310-manylinux_2_31_x86_64.whl |
|---|---|
| Size | 87.4 MB |
| Tags | CPython 3.10 Linux glibc 2.31+ x86-64 |
|
SHA-256 checksum How to use checksums |
9fd1c8e06de14787531cb0ac29195226a1e2b8ca1bcafd817771cf926fd13133
|
|
BLAKE2b-256 checksum How to use checksums |
92fcfe6d2fe2fe820c8354001780691edd54e47de008e269c936d363a0b44474
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.8
|
Release files / fastdup-2.54-cp310-cp310-macosx_11_0_arm64.whl
| Download URL | fastdup-2.54-cp310-cp310-macosx_11_0_arm64.whl |
|---|---|
| Size | 48.9 MB |
| Tags | CPython 3.10 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
3e9f8fe1b3c2767d14ad33b1be564980645665b3c72757d0df2ca02234dfa998
|
|
BLAKE2b-256 checksum How to use checksums |
07725e58d67ff1c9016947340095f88b0decbc4b6cb801e5b6019e430d3dd13e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.8.16
|
Release files / fastdup-2.54-cp39-cp39-manylinux_2_31_x86_64.whl
| Download URL | fastdup-2.54-cp39-cp39-manylinux_2_31_x86_64.whl |
|---|---|
| Size | 87.4 MB |
| Tags | CPython 3.9 Linux glibc 2.31+ x86-64 |
|
SHA-256 checksum How to use checksums |
584742d1add10a755e47941eaa39d4606e1d12bd8a425cf37734f3dbd1cb0e7f
|
|
BLAKE2b-256 checksum How to use checksums |
ace5026660be163a7e7349905a1668f4f9eef9ae308bde1d0a0b884da2141108
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.8
|
Release files / fastdup-2.54-cp39-cp39-macosx_11_0_arm64.whl
| Download URL | fastdup-2.54-cp39-cp39-macosx_11_0_arm64.whl |
|---|---|
| Size | 48.9 MB |
| Tags | CPython 3.9 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
cf248f5b6d9e5564999766eae3d7350966113a05b97d06fdb12e6a5f9beffe58
|
|
BLAKE2b-256 checksum How to use checksums |
913a2b8debf499bcaff86260a49c7be0ee9b010b37c2b777ec69a30556e950f3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.8.16
|
