Skip to main content

Fast tool for gaining insights from large image repositories.

Project description

Fastdup Tool

Copyright (C) 2024 by Dr. Amir Alush and Dr. Danny Bickson.

fastdup is a tool for gaining insights from a large image/video collection. It can find anomalies, duplicate and near duplicate images/videos, clusters of similarity, learn the normal behavior and temporal interactions between images/videos. It can be used for smart subsampling of a higher quality dataset, outlier removal, novelty detection of new information to be sent for tagging.

fastdup is:

  • Unsupervised: fits any dataset
  • Scalable : handles 400M images on a single machine
  • Efficient: works on CPU only
  • Low Cost: can process 12M images on a $1 cloud machine budget

Non Commercial License

Github Project Page

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

fastdup-2.29-cp311-cp311-manylinux_2_31_x86_64.whl (93.1 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

fastdup-2.29-cp311-cp311-manylinux_2_31_aarch64.whl (66.9 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ ARM64

fastdup-2.29-cp311-cp311-macosx_11_0_arm64.whl (50.7 MB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

fastdup-2.29-cp310-cp310-manylinux_2_31_x86_64.whl (92.3 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.31+ x86-64

fastdup-2.29-cp310-cp310-manylinux_2_31_aarch64.whl (66.0 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.31+ ARM64

fastdup-2.29-cp310-cp310-macosx_11_0_arm64.whl (49.9 MB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

fastdup-2.29-cp39-cp39-manylinux_2_31_x86_64.whl (92.3 MB view details)

Uploaded CPython 3.9manylinux: glibc 2.31+ x86-64

fastdup-2.29-cp39-cp39-manylinux_2_31_aarch64.whl (66.0 MB view details)

Uploaded CPython 3.9manylinux: glibc 2.31+ ARM64

fastdup-2.29-cp39-cp39-macosx_11_0_arm64.whl (49.9 MB view details)

Uploaded CPython 3.9macOS 11.0+ ARM64

File details

Details for the file fastdup-2.29-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for fastdup-2.29-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 9994dece4a1762ddbadf482d453d6eb72b971f0d068f7200426e7f64b9e77009
MD5 eb3ed69c1def2d02348a68e0918e0c47
BLAKE2b-256 d3610dd45357be80934141453931a8fde2bcd6a3684fdc34bcea0ca169272abe

See more details on using hashes here.

File details

Details for the file fastdup-2.29-cp311-cp311-manylinux_2_31_aarch64.whl.

File metadata

File hashes

Hashes for fastdup-2.29-cp311-cp311-manylinux_2_31_aarch64.whl
Algorithm Hash digest
SHA256 19e777510785cc8708b2febb52ca89e3d452daebf0e03f4edbcbffd3696b02a6
MD5 af002eb1bbe882bdfb4e20b5e5b1f90a
BLAKE2b-256 f4b20893ed4f74e9e4bb7c0117b7f51bac5171aca41931ac40768c2d8cab3757

See more details on using hashes here.

File details

Details for the file fastdup-2.29-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for fastdup-2.29-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 56d13fec37fa6f23286a3a86c1f7313d4ce056edd6c2366a52507b7a47bed868
MD5 6be718a78176093e2ecda3f08ac46630
BLAKE2b-256 1f3ac0ae27c6f551bbd91441787f4f6a6081177d5987e7f21b95f328b393e60e

See more details on using hashes here.

File details

Details for the file fastdup-2.29-cp310-cp310-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for fastdup-2.29-cp310-cp310-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 5970673e91eedcadbc613afc29e18e07ccb8a036f8096816038fdfc23cad598b
MD5 4a483306f2d85c20c532745b69c1e5f0
BLAKE2b-256 c2e56311b1da96c72b4300f139a88549dcf10271e214acf54320b652a94c64f7

See more details on using hashes here.

File details

Details for the file fastdup-2.29-cp310-cp310-manylinux_2_31_aarch64.whl.

File metadata

File hashes

Hashes for fastdup-2.29-cp310-cp310-manylinux_2_31_aarch64.whl
Algorithm Hash digest
SHA256 9008c678c7815cf8adbe311e71e98ae80f48ad0fee64058e9aeacd1870db2d8e
MD5 066e9e8a904283907174e52d23c980f7
BLAKE2b-256 423e311d95d9ea9212226508c19a50c7851d438f2b448df84f8ecc2e5d8f818b

See more details on using hashes here.

File details

Details for the file fastdup-2.29-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for fastdup-2.29-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 dfd82842e0ced04130ebdd5f008e8636d6859a92cb1b3122972a969fa9a6eb43
MD5 91d7b3b7db93b9b8ef29b1b95fe51ea5
BLAKE2b-256 65b5d501cf2f9d0c58b126d6a32ec0d12dc52b529b1d1c91bb0907006b82793b

See more details on using hashes here.

File details

Details for the file fastdup-2.29-cp39-cp39-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for fastdup-2.29-cp39-cp39-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 a3d8e34436e16c049aa609ed8b9fa6289ed3f8194efb191b4eb69233f0a9222a
MD5 fa5764bd65a0fd1eb20c84b69b8f337a
BLAKE2b-256 019ed55e666058d237a8e961b4222df0f42297d079446b41a55d0df632549350

See more details on using hashes here.

File details

Details for the file fastdup-2.29-cp39-cp39-manylinux_2_31_aarch64.whl.

File metadata

File hashes

Hashes for fastdup-2.29-cp39-cp39-manylinux_2_31_aarch64.whl
Algorithm Hash digest
SHA256 5c21e831e04abd735e98e0fb10e48effbe91c5cf364e5e0dbba5617a3cd94894
MD5 1814c804e8105fab066f3e8992e6ae04
BLAKE2b-256 39c52e381f949bfffaac18d8b04b0e5c04325944c8306600dd9e2a682c1172bc

See more details on using hashes here.

File details

Details for the file fastdup-2.29-cp39-cp39-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for fastdup-2.29-cp39-cp39-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 a848b02f727ae797bc370e6475aae3b1891b9a37cd3bf43cc9c26baff6d3117a
MD5 6f3e6a4888789409e3da03b6bdbbc2f4
BLAKE2b-256 15e907d6e3b50d2016baf0ad6528bb58cf861438a93c82cca6d999ec6cb95c5c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page