Fast tool for gaining insights from large image repositories.

These details have been verified by PyPI

Maintainers

amiralush dbickson dimafrid dnth galbarnissan oh-srsly

Project description

Fastdup Tool

fastdup is a tool for gaining insights from a large image/video collection. It can find anomalies, duplicate and near duplicate images/videos, clusters of similarity, learn the normal behavior and temporal interactions between images/videos. It can be used for smart subsampling of a higher quality dataset, outlier removal, novelty detection of new information to be sent for tagging.

fastdup is:

Unsupervised: fits any dataset
Scalable : handles 400M images on a single machine
Efficient: works on CPU only
Low Cost: can process 12M images on a $1 cloud machine budget

Non Commercial License

Github Project Page

Project details

These details have been verified by PyPI

Maintainers

amiralush dbickson dimafrid dnth galbarnissan oh-srsly

Release history Release notifications | RSS feed

This version

2.13

Aug 29, 2024

2.12

Aug 26, 2024

2.11

Aug 25, 2024

2.10

Aug 19, 2024

2.9

Aug 5, 2024

2.7

Jul 13, 2024

2.6

Jul 11, 2024

2.5

Jun 26, 2024

2.4

Jun 18, 2024

2.3

Jun 14, 2024

2.2

Jun 13, 2024

2.1

Jun 13, 2024

2.0

Jun 13, 2024

1.132

Aug 11, 2024

1.131

Aug 7, 2024

1.128

Jul 22, 2024

1.123

May 6, 2024

1.85

Jan 15, 2024

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

fastdup-2.13-cp312-cp312-manylinux_2_35_aarch64.whl (66.7 MB view hashes)

Uploaded Sep 5, 2024 CPython 3.12 manylinux: glibc 2.35+ ARM64

fastdup-2.13-cp312-cp312-manylinux_2_31_x86_64.whl (92.9 MB view hashes)

Uploaded Sep 1, 2024 CPython 3.12 manylinux: glibc 2.31+ x86-64

fastdup-2.13-cp312-cp312-manylinux_2_31_aarch64.whl (66.7 MB view hashes)

Uploaded Sep 5, 2024 CPython 3.12 manylinux: glibc 2.31+ ARM64

fastdup-2.13-cp312-cp312-macosx_11_0_arm64.whl (54.6 MB view hashes)

Uploaded Aug 29, 2024 CPython 3.12 macOS 11.0+ ARM64

fastdup-2.13-cp311-cp311-manylinux_2_35_aarch64.whl (66.9 MB view hashes)

Uploaded Sep 5, 2024 CPython 3.11 manylinux: glibc 2.35+ ARM64

fastdup-2.13-cp311-cp311-manylinux_2_31_x86_64.whl (93.1 MB view hashes)

Uploaded Sep 1, 2024 CPython 3.11 manylinux: glibc 2.31+ x86-64

fastdup-2.13-cp311-cp311-manylinux_2_31_aarch64.whl (66.9 MB view hashes)

Uploaded Sep 5, 2024 CPython 3.11 manylinux: glibc 2.31+ ARM64

fastdup-2.13-cp311-cp311-macosx_11_0_arm64.whl (54.9 MB view hashes)

Uploaded Aug 29, 2024 CPython 3.11 macOS 11.0+ ARM64

fastdup-2.13-cp310-cp310-manylinux_2_35_aarch64.whl (66.1 MB view hashes)

Uploaded Sep 5, 2024 CPython 3.10 manylinux: glibc 2.35+ ARM64

fastdup-2.13-cp310-cp310-manylinux_2_31_x86_64.whl (92.3 MB view hashes)

Uploaded Sep 1, 2024 CPython 3.10 manylinux: glibc 2.31+ x86-64

fastdup-2.13-cp310-cp310-manylinux_2_31_aarch64.whl (66.1 MB view hashes)

Uploaded Sep 5, 2024 CPython 3.10 manylinux: glibc 2.31+ ARM64

fastdup-2.13-cp310-cp310-macosx_11_0_arm64.whl (54.0 MB view hashes)

Uploaded Aug 29, 2024 CPython 3.10 macOS 11.0+ ARM64

fastdup-2.13-cp39-cp39-manylinux_2_35_aarch64.whl (66.1 MB view hashes)

Uploaded Sep 5, 2024 CPython 3.9 manylinux: glibc 2.35+ ARM64

fastdup-2.13-cp39-cp39-manylinux_2_31_x86_64.whl (92.3 MB view hashes)

Uploaded Sep 1, 2024 CPython 3.9 manylinux: glibc 2.31+ x86-64

fastdup-2.13-cp39-cp39-manylinux_2_31_aarch64.whl (66.1 MB view hashes)

Uploaded Sep 5, 2024 CPython 3.9 manylinux: glibc 2.31+ ARM64

fastdup-2.13-cp39-cp39-macosx_11_0_arm64.whl (54.0 MB view hashes)

Uploaded Aug 29, 2024 CPython 3.9 macOS 11.0+ ARM64

Hashes for fastdup-2.13-cp312-cp312-manylinux_2_35_aarch64.whl

Hashes for fastdup-2.13-cp312-cp312-manylinux_2_35_aarch64.whl
Algorithm	Hash digest
SHA256	`4b4fb8572338763284da68a769f76036f06cd944ecb77ca72c6efe04b25a748c`
MD5	`4cdf96704810d4a5ba6e33a3642811b1`
BLAKE2b-256	`ca58e314c740a3b28ab347f19bd9b87d6e9a38f29d4cbcf9e35532b9ccfecc59`

Hashes for fastdup-2.13-cp312-cp312-manylinux_2_31_x86_64.whl

Hashes for fastdup-2.13-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm	Hash digest
SHA256	`3850bfdfa75d806d955f01921783b65dd0a4dca9e8c1fb051934e471b9a93e92`
MD5	`3c964c560f5a43c163a636a59177585b`
BLAKE2b-256	`bf8bd87ab6fe1c6c7819333878ef4e6abcc1b9d96f8210ef9c7d0d03f69f7bfa`

Hashes for fastdup-2.13-cp312-cp312-manylinux_2_31_aarch64.whl

Hashes for fastdup-2.13-cp312-cp312-manylinux_2_31_aarch64.whl
Algorithm	Hash digest
SHA256	`e83da4e6a3405120fbd6dea01a666739f7d3422b4c387b17902e686e5ddef04c`
MD5	`fa0acb8946a70bb71b8e2b55161acd00`
BLAKE2b-256	`90765ab58ee9dbf944e3b22a42f496d76a6a6f810bd55dd7ce1fd7a4ff110a7c`

Hashes for fastdup-2.13-cp312-cp312-macosx_11_0_arm64.whl

Hashes for fastdup-2.13-cp312-cp312-macosx_11_0_arm64.whl
Algorithm	Hash digest
SHA256	`b0865ef4816bb28edd419c9f3bf996235f986750a16cdc3cf002997f22042f3a`
MD5	`962fea0387a929c236c1d0bb7266c430`
BLAKE2b-256	`082cc395c086076caf7b08697d74722c0f565bfa0d2a98dcbf3351015ebaba0a`

Hashes for fastdup-2.13-cp311-cp311-manylinux_2_35_aarch64.whl

Hashes for fastdup-2.13-cp311-cp311-manylinux_2_35_aarch64.whl
Algorithm	Hash digest
SHA256	`4b0bd8ecab6fe164b92cffa51597a8cc768a11985b464e7e497e786e4f73fecd`
MD5	`f04334cc79cd4c158880b30d901d0379`
BLAKE2b-256	`f47816bf4612d881d4d555fee48237dd83962dbbcdd054f03043b9577c620668`

Hashes for fastdup-2.13-cp311-cp311-manylinux_2_31_x86_64.whl

Hashes for fastdup-2.13-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm	Hash digest
SHA256	`ba345c0cd5267d243d68f2f8a82579408bd2a6b4dc4e9dbe704c30285f895e0c`
MD5	`7965696b5164f37021018f1f788153f1`
BLAKE2b-256	`46c5cce6b141fbf98091376f8851d8c26e739d6fb962e99ced27a59f698e4361`

Hashes for fastdup-2.13-cp311-cp311-manylinux_2_31_aarch64.whl

Hashes for fastdup-2.13-cp311-cp311-manylinux_2_31_aarch64.whl
Algorithm	Hash digest
SHA256	`16a570966f4640a8f1382fd3a824cc22c254136f67b0ccf1ccdcc3ce347c6546`
MD5	`17bfd383107f05fb1f45f68a8474cab1`
BLAKE2b-256	`fce28cc5b522e7b3aba4fb7876217b9d804248706649a6bfbd9406736a0314db`

Hashes for fastdup-2.13-cp311-cp311-macosx_11_0_arm64.whl

Hashes for fastdup-2.13-cp311-cp311-macosx_11_0_arm64.whl
Algorithm	Hash digest
SHA256	`e52b40694eec5d26dcd5765f0aa754211c5550447bf155d3c91e6f7c678d4ead`
MD5	`0e377b428cee685fd69373b953fb035b`
BLAKE2b-256	`bb7de9de584048c850965698c3fe81843697239a8f2b9aa61db4f875240e642c`

Hashes for fastdup-2.13-cp310-cp310-manylinux_2_35_aarch64.whl

Hashes for fastdup-2.13-cp310-cp310-manylinux_2_35_aarch64.whl
Algorithm	Hash digest
SHA256	`827abbcd4d47fe9d3e75abcbdd5efdc69986a9e590a165c1140f08afc24f385c`
MD5	`568f38c6d43f1aeb5e9d6513d0f80a57`
BLAKE2b-256	`fa3c6bd52bea829d4a8d4bf9e20d052730d3e5a2a840e33336fd262d9e98ec46`

Hashes for fastdup-2.13-cp310-cp310-manylinux_2_31_x86_64.whl

Hashes for fastdup-2.13-cp310-cp310-manylinux_2_31_x86_64.whl
Algorithm	Hash digest
SHA256	`8550c0a64ae19d479e1279202e773373784074dce18510f5d1602aab0192243b`
MD5	`cd39add7d68a81e599b190fe8985cd96`
BLAKE2b-256	`db2dc50e35198115c1761f7c752ff98913ea28a45d876aab0018f0fdc58a223f`

Hashes for fastdup-2.13-cp310-cp310-manylinux_2_31_aarch64.whl

Hashes for fastdup-2.13-cp310-cp310-manylinux_2_31_aarch64.whl
Algorithm	Hash digest
SHA256	`7d8e1aa1550f9d80f6076e8cc15ec428ed740765faeadea69f35d4b4ef3b20a7`
MD5	`6bc535ce4873e8ab6ccc78f72a1b0b0b`
BLAKE2b-256	`62ac76915a1e94f79244436bb887d877de588ff7855059ae57b7a64964ecdf8c`

Hashes for fastdup-2.13-cp310-cp310-macosx_11_0_arm64.whl

Hashes for fastdup-2.13-cp310-cp310-macosx_11_0_arm64.whl
Algorithm	Hash digest
SHA256	`d2a7c2046c13ff48e2ecc273423182b0771cfa3424fe5ed4bb29fca6d01156d7`
MD5	`4bd834e027d95ce3be6922711c98bd49`
BLAKE2b-256	`3af8b52b68366b663fbb03bfefce964474f8e2c2551a003ceb48e01af6d16f5d`

Hashes for fastdup-2.13-cp39-cp39-manylinux_2_35_aarch64.whl

Hashes for fastdup-2.13-cp39-cp39-manylinux_2_35_aarch64.whl
Algorithm	Hash digest
SHA256	`783f55519866cec3701d47f4f71f0c170ef514872a4b6628565deffbe736e77d`
MD5	`8f8dfc7ba93242df3cdee1b547ddbd22`
BLAKE2b-256	`f75264f8813c89a7fdd2c00ece0e674937428b075d05f484ec6a2544cb7c36a0`

Hashes for fastdup-2.13-cp39-cp39-manylinux_2_31_x86_64.whl

Hashes for fastdup-2.13-cp39-cp39-manylinux_2_31_x86_64.whl
Algorithm	Hash digest
SHA256	`d25ee21151a2c222f88733b7661ea91ca7625ddcc4e007f594b43dd93bea1c9c`
MD5	`dadaa1517be7a53b38f0ce9342957b0a`
BLAKE2b-256	`b428783a63eca5aaaef5bec1afd736c040d401ab318fbc4f0db7f9efed3e2ae3`

Hashes for fastdup-2.13-cp39-cp39-manylinux_2_31_aarch64.whl

Hashes for fastdup-2.13-cp39-cp39-manylinux_2_31_aarch64.whl
Algorithm	Hash digest
SHA256	`b0658034d4c84a11234997c7fe2545a7e2d3b55d5b19cf3184fcf71894511738`
MD5	`470bfd7f4a81edda57656d386b7d1763`
BLAKE2b-256	`6ff56cc92ee9b526fc974d6e12bb074805fab10d1cf3cf2123122b6cafab9122`

Hashes for fastdup-2.13-cp39-cp39-macosx_11_0_arm64.whl

Hashes for fastdup-2.13-cp39-cp39-macosx_11_0_arm64.whl
Algorithm	Hash digest
SHA256	`b855e1758e112d96bfaf0cd56b1a910585be7785001f10fe2fc7d6d6b2e6f9e8`
MD5	`bf6fb824fcdb20897b076a5c348961f1`
BLAKE2b-256	`841f451798c19ad71dd36f2ec33c5c964d0bf241656d831938dca67b87d1fbf6`