Skip to main content

Fastdup Tool

Copyright (C) 2024 by Dr. Amir Alush and Dr. Danny Bickson.

fastdup is a tool for gaining insights from a large image/video collection. It can find anomalies, duplicate and near duplicate images/videos, clusters of similarity, learn the normal behavior and temporal interactions between images/videos. It can be used for smart subsampling of a higher quality dataset, outlier removal, novelty detection of new information to be sent for tagging.

fastdup is:

  • Unsupervised: fits any dataset
  • Scalable : handles 400M images on a single machine
  • Efficient: works on CPU only
  • Low Cost: can process 12M images on a $1 cloud machine budget

Non Commercial License

Github Project Page

System Requirements

Supported Platforms:

  • Linux
  • macOS

Windows Support: Windows is not directly supported. However, Windows users can use fastdup via Windows Subsystem for Linux 2 (WSL2) by installing Ubuntu and following the Linux installation instructions.

Metadata

Release files for fastdup 2.39

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for fastdup 2.39
File Actions
fastdup-2.39-cp312-cp312-manylinux_2_31_x86_64.whl CPython 3.12 CPython 3.12 Linux glibc 2.31+ x86-64 Details for fastdup-2.39-cp312-cp312-manylinux_2_31_x86_64.whl
fastdup-2.39-cp311-cp311-manylinux_2_31_x86_64.whl CPython 3.11 CPython 3.11 Linux glibc 2.31+ x86-64 Details for fastdup-2.39-cp311-cp311-manylinux_2_31_x86_64.whl
fastdup-2.39-cp310-cp310-manylinux_2_31_x86_64.whl CPython 3.10 CPython 3.10 Linux glibc 2.31+ x86-64 Details for fastdup-2.39-cp310-cp310-manylinux_2_31_x86_64.whl
fastdup-2.39-cp39-cp39-manylinux_2_31_x86_64.whl CPython 3.9 CPython 3.9 Linux glibc 2.31+ x86-64 Details for fastdup-2.39-cp39-cp39-manylinux_2_31_x86_64.whl

Total release size: 370.6 MB

Release files / fastdup-2.39-cp312-cp312-manylinux_2_31_x86_64.whl

Download URL fastdup-2.39-cp312-cp312-manylinux_2_31_x86_64.whl
Size 92.9 MB
Tags CPython 3.12 Linux glibc 2.31+ x86-64
SHA-256 checksum
How to use checksums
d1cec21063a199c8552745e326fa9b1691be15267bf7c660401eb4195b90b35e
BLAKE2b-256 checksum
How to use checksums
ba43894d059463193462ecaef30460fff2e5c929a36c0c99a66b9c2f5c902013
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.12.5

Release files / fastdup-2.39-cp311-cp311-manylinux_2_31_x86_64.whl

Download URL fastdup-2.39-cp311-cp311-manylinux_2_31_x86_64.whl
Size 93.1 MB
Tags CPython 3.11 Linux glibc 2.31+ x86-64
SHA-256 checksum
How to use checksums
f80969756f4c4750932dadfb1866be3a6df7f7aa26fd0843afd3478cc4e5285b
BLAKE2b-256 checksum
How to use checksums
489e080bb95817584f07bbccd2ca6bc8b73944bd9a045e339f31b8ac45a2611a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.12.5

Release files / fastdup-2.39-cp310-cp310-manylinux_2_31_x86_64.whl

Download URL fastdup-2.39-cp310-cp310-manylinux_2_31_x86_64.whl
Size 92.3 MB
Tags CPython 3.10 Linux glibc 2.31+ x86-64
SHA-256 checksum
How to use checksums
83daf12f3a19745bbdb65546019baa71c7ebabe6941da40bef72663d96079fb5
BLAKE2b-256 checksum
How to use checksums
cea4fdd5ae3e40735f9a388a9fb9f9c0dbfc6acbd589ae077f6f42b1d54bf156
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.12.5

Release files / fastdup-2.39-cp39-cp39-manylinux_2_31_x86_64.whl

Download URL fastdup-2.39-cp39-cp39-manylinux_2_31_x86_64.whl
Size 92.3 MB
Tags CPython 3.9 Linux glibc 2.31+ x86-64
SHA-256 checksum
How to use checksums
97758296dc2727ec2bdb98dcacffd8e4b1222653bc6b06db529924c3a5f8f799
BLAKE2b-256 checksum
How to use checksums
60b3658b74bb53054f037847344bf0fc6fdbcb8cff4242b05a9986f4281f5731
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.12.5

Security for fastdup 2.39

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page