Skip to main content

Fast tool for gaining insights from large image repositories.

Project description

Fastdup Tool

Copyright (C) 2022 by Dr. Amir Alush and Dr. Danny Bickson.

fastdup is a tool for gaining insights from a large image/video collection. It can find anomalies, duplicate and near duplicate images/videos, clusters of similarity, learn the normal behavior and temporal interactions between images/videos. It can be used for smart subsampling of a higher quality dataset, outlier removal, novelty detection of new information to be sent for tagging.

fastdup is:

  • Unsupervised: fits any dataset
  • Scalable : handles 400M images on a single machine
  • Efficient: works on CPU only
  • Low Cost: can process 12M images on a $1 cloud machine budget

Non Commercial License

Github Project Page

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

fastdup-2.13-cp312-cp312-manylinux_2_35_aarch64.whl (66.7 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.35+ ARM64

fastdup-2.13-cp312-cp312-manylinux_2_31_x86_64.whl (92.9 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.31+ x86-64

fastdup-2.13-cp312-cp312-manylinux_2_31_aarch64.whl (66.7 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.31+ ARM64

fastdup-2.13-cp312-cp312-macosx_11_0_arm64.whl (54.6 MB view details)

Uploaded CPython 3.12 macOS 11.0+ ARM64

fastdup-2.13-cp311-cp311-manylinux_2_35_aarch64.whl (66.9 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.35+ ARM64

fastdup-2.13-cp311-cp311-manylinux_2_31_x86_64.whl (93.1 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.31+ x86-64

fastdup-2.13-cp311-cp311-manylinux_2_31_aarch64.whl (66.9 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.31+ ARM64

fastdup-2.13-cp311-cp311-macosx_11_0_arm64.whl (54.9 MB view details)

Uploaded CPython 3.11 macOS 11.0+ ARM64

fastdup-2.13-cp310-cp310-manylinux_2_35_aarch64.whl (66.1 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.35+ ARM64

fastdup-2.13-cp310-cp310-manylinux_2_31_x86_64.whl (92.3 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.31+ x86-64

fastdup-2.13-cp310-cp310-manylinux_2_31_aarch64.whl (66.1 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.31+ ARM64

fastdup-2.13-cp310-cp310-macosx_11_0_arm64.whl (54.0 MB view details)

Uploaded CPython 3.10 macOS 11.0+ ARM64

fastdup-2.13-cp39-cp39-manylinux_2_35_aarch64.whl (66.1 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.35+ ARM64

fastdup-2.13-cp39-cp39-manylinux_2_31_x86_64.whl (92.3 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.31+ x86-64

fastdup-2.13-cp39-cp39-manylinux_2_31_aarch64.whl (66.1 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.31+ ARM64

fastdup-2.13-cp39-cp39-macosx_11_0_arm64.whl (54.0 MB view details)

Uploaded CPython 3.9 macOS 11.0+ ARM64

File details

Details for the file fastdup-2.13-cp312-cp312-manylinux_2_35_aarch64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp312-cp312-manylinux_2_35_aarch64.whl
Algorithm Hash digest
SHA256 4b4fb8572338763284da68a769f76036f06cd944ecb77ca72c6efe04b25a748c
MD5 4cdf96704810d4a5ba6e33a3642811b1
BLAKE2b-256 ca58e314c740a3b28ab347f19bd9b87d6e9a38f29d4cbcf9e35532b9ccfecc59

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 3850bfdfa75d806d955f01921783b65dd0a4dca9e8c1fb051934e471b9a93e92
MD5 3c964c560f5a43c163a636a59177585b
BLAKE2b-256 bf8bd87ab6fe1c6c7819333878ef4e6abcc1b9d96f8210ef9c7d0d03f69f7bfa

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp312-cp312-manylinux_2_31_aarch64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp312-cp312-manylinux_2_31_aarch64.whl
Algorithm Hash digest
SHA256 e83da4e6a3405120fbd6dea01a666739f7d3422b4c387b17902e686e5ddef04c
MD5 fa0acb8946a70bb71b8e2b55161acd00
BLAKE2b-256 90765ab58ee9dbf944e3b22a42f496d76a6a6f810bd55dd7ce1fd7a4ff110a7c

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 b0865ef4816bb28edd419c9f3bf996235f986750a16cdc3cf002997f22042f3a
MD5 962fea0387a929c236c1d0bb7266c430
BLAKE2b-256 082cc395c086076caf7b08697d74722c0f565bfa0d2a98dcbf3351015ebaba0a

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp311-cp311-manylinux_2_35_aarch64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp311-cp311-manylinux_2_35_aarch64.whl
Algorithm Hash digest
SHA256 4b0bd8ecab6fe164b92cffa51597a8cc768a11985b464e7e497e786e4f73fecd
MD5 f04334cc79cd4c158880b30d901d0379
BLAKE2b-256 f47816bf4612d881d4d555fee48237dd83962dbbcdd054f03043b9577c620668

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 ba345c0cd5267d243d68f2f8a82579408bd2a6b4dc4e9dbe704c30285f895e0c
MD5 7965696b5164f37021018f1f788153f1
BLAKE2b-256 46c5cce6b141fbf98091376f8851d8c26e739d6fb962e99ced27a59f698e4361

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp311-cp311-manylinux_2_31_aarch64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp311-cp311-manylinux_2_31_aarch64.whl
Algorithm Hash digest
SHA256 16a570966f4640a8f1382fd3a824cc22c254136f67b0ccf1ccdcc3ce347c6546
MD5 17bfd383107f05fb1f45f68a8474cab1
BLAKE2b-256 fce28cc5b522e7b3aba4fb7876217b9d804248706649a6bfbd9406736a0314db

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 e52b40694eec5d26dcd5765f0aa754211c5550447bf155d3c91e6f7c678d4ead
MD5 0e377b428cee685fd69373b953fb035b
BLAKE2b-256 bb7de9de584048c850965698c3fe81843697239a8f2b9aa61db4f875240e642c

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp310-cp310-manylinux_2_35_aarch64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp310-cp310-manylinux_2_35_aarch64.whl
Algorithm Hash digest
SHA256 827abbcd4d47fe9d3e75abcbdd5efdc69986a9e590a165c1140f08afc24f385c
MD5 568f38c6d43f1aeb5e9d6513d0f80a57
BLAKE2b-256 fa3c6bd52bea829d4a8d4bf9e20d052730d3e5a2a840e33336fd262d9e98ec46

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp310-cp310-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp310-cp310-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 8550c0a64ae19d479e1279202e773373784074dce18510f5d1602aab0192243b
MD5 cd39add7d68a81e599b190fe8985cd96
BLAKE2b-256 db2dc50e35198115c1761f7c752ff98913ea28a45d876aab0018f0fdc58a223f

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp310-cp310-manylinux_2_31_aarch64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp310-cp310-manylinux_2_31_aarch64.whl
Algorithm Hash digest
SHA256 7d8e1aa1550f9d80f6076e8cc15ec428ed740765faeadea69f35d4b4ef3b20a7
MD5 6bc535ce4873e8ab6ccc78f72a1b0b0b
BLAKE2b-256 62ac76915a1e94f79244436bb887d877de588ff7855059ae57b7a64964ecdf8c

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 d2a7c2046c13ff48e2ecc273423182b0771cfa3424fe5ed4bb29fca6d01156d7
MD5 4bd834e027d95ce3be6922711c98bd49
BLAKE2b-256 3af8b52b68366b663fbb03bfefce964474f8e2c2551a003ceb48e01af6d16f5d

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp39-cp39-manylinux_2_35_aarch64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp39-cp39-manylinux_2_35_aarch64.whl
Algorithm Hash digest
SHA256 783f55519866cec3701d47f4f71f0c170ef514872a4b6628565deffbe736e77d
MD5 8f8dfc7ba93242df3cdee1b547ddbd22
BLAKE2b-256 f75264f8813c89a7fdd2c00ece0e674937428b075d05f484ec6a2544cb7c36a0

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp39-cp39-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp39-cp39-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 d25ee21151a2c222f88733b7661ea91ca7625ddcc4e007f594b43dd93bea1c9c
MD5 dadaa1517be7a53b38f0ce9342957b0a
BLAKE2b-256 b428783a63eca5aaaef5bec1afd736c040d401ab318fbc4f0db7f9efed3e2ae3

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp39-cp39-manylinux_2_31_aarch64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp39-cp39-manylinux_2_31_aarch64.whl
Algorithm Hash digest
SHA256 b0658034d4c84a11234997c7fe2545a7e2d3b55d5b19cf3184fcf71894511738
MD5 470bfd7f4a81edda57656d386b7d1763
BLAKE2b-256 6ff56cc92ee9b526fc974d6e12bb074805fab10d1cf3cf2123122b6cafab9122

See more details on using hashes here.

File details

Details for the file fastdup-2.13-cp39-cp39-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for fastdup-2.13-cp39-cp39-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 b855e1758e112d96bfaf0cd56b1a910585be7785001f10fe2fc7d6d6b2e6f9e8
MD5 bf6fb824fcdb20897b076a5c348961f1
BLAKE2b-256 841f451798c19ad71dd36f2ec33c5c964d0bf241656d831938dca67b87d1fbf6

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page