Skip to main content

Remove duplicate files quickly with a simple command line tool

Project description

dupesearch

A fast and simple command line tool written in rust and python for finding duplicate files.

Should I use it?

Probably not, this is still a WIP, it's quite messy, I haven't tested most of it, and was my first time using Rust so I probably did some dodgy stuff.

How do I use it?

  1. Install the dupesearch package from pip using your preferred command.
  2. Run python -m dupesearch -i and follow the instructions.

Contributions

To set up locally:

  1. Clone the repository with git clone https://github.com/wookie184/dupesearch.git
  2. cd into the repository with cd dupesearch
  3. Create and activate a venv, and make sure to point your editor to the executable if necessary.
  4. Install the dev requirements with pip install -r requirements-dev.txt
  5. Install the pre-commit hooks with pre-commit install
  6. Install the rust crate as a module with maturin develop --release
  7. Finally, run the project with python -m dupesearch

If you'd like to make a contribution, feel free to and i'll try to merge it in. If it's not a tiny change please create an issue first, at least to ensure that i'm still active and able to review the changes.

Any issues suggesting improvements are also welcome, although this was just done as a practice project to get started with rust and packaging python projects, so I may not implement every suggestion.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dupesearch-0.1.13.tar.gz (12.4 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

dupesearch-0.1.13-cp310-none-win_amd64.whl (209.9 kB view details)

Uploaded CPython 3.10Windows x86-64

dupesearch-0.1.13-cp310-cp310-manylinux_2_24_x86_64.whl (277.4 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.24+ x86-64

dupesearch-0.1.13-cp310-cp310-macosx_10_7_x86_64.whl (249.7 kB view details)

Uploaded CPython 3.10macOS 10.7+ x86-64

dupesearch-0.1.13-cp39-none-win_amd64.whl (209.8 kB view details)

Uploaded CPython 3.9Windows x86-64

dupesearch-0.1.13-cp39-cp39-manylinux_2_24_x86_64.whl (277.5 kB view details)

Uploaded CPython 3.9manylinux: glibc 2.24+ x86-64

dupesearch-0.1.13-cp39-cp39-macosx_10_7_x86_64.whl (249.7 kB view details)

Uploaded CPython 3.9macOS 10.7+ x86-64

dupesearch-0.1.13-cp38-none-win_amd64.whl (210.3 kB view details)

Uploaded CPython 3.8Windows x86-64

dupesearch-0.1.13-cp38-cp38-manylinux_2_24_x86_64.whl (277.9 kB view details)

Uploaded CPython 3.8manylinux: glibc 2.24+ x86-64

dupesearch-0.1.13-cp38-cp38-macosx_10_7_x86_64.whl (250.1 kB view details)

Uploaded CPython 3.8macOS 10.7+ x86-64

dupesearch-0.1.13-cp37-none-win_amd64.whl (210.7 kB view details)

Uploaded CPython 3.7Windows x86-64

dupesearch-0.1.13-cp37-cp37m-manylinux_2_24_x86_64.whl (277.9 kB view details)

Uploaded CPython 3.7mmanylinux: glibc 2.24+ x86-64

dupesearch-0.1.13-cp37-cp37m-macosx_10_7_x86_64.whl (250.0 kB view details)

Uploaded CPython 3.7mmacOS 10.7+ x86-64

File details

Details for the file dupesearch-0.1.13.tar.gz.

File metadata

  • Download URL: dupesearch-0.1.13.tar.gz
  • Upload date:
  • Size: 12.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13.tar.gz
Algorithm Hash digest
SHA256 388e36641441eb3b78d69f4d9e53529103df3e7e478e310f0cbde0fb3e487569
MD5 4f356fba4bc874d3e9a3af36bf79f00b
BLAKE2b-256 3f12b1f2028661e221e9b3f59ad4a02c195de688d60b5e8c0cad898e92c609e4

See more details on using hashes here.

File details

Details for the file dupesearch-0.1.13-cp310-none-win_amd64.whl.

File metadata

  • Download URL: dupesearch-0.1.13-cp310-none-win_amd64.whl
  • Upload date:
  • Size: 209.9 kB
  • Tags: CPython 3.10, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13-cp310-none-win_amd64.whl
Algorithm Hash digest
SHA256 8479d65321a10601f4d25051dfdda26ebb0351d841f5901dbff84c7bc423d27b
MD5 3d5d11fe6053091523579101b5774111
BLAKE2b-256 6ab5a50c5c88f60b1e6556c89ebb308d997aea6f819ea2a868d3e8c153499dca

See more details on using hashes here.

File details

Details for the file dupesearch-0.1.13-cp310-cp310-manylinux_2_24_x86_64.whl.

File metadata

  • Download URL: dupesearch-0.1.13-cp310-cp310-manylinux_2_24_x86_64.whl
  • Upload date:
  • Size: 277.4 kB
  • Tags: CPython 3.10, manylinux: glibc 2.24+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13-cp310-cp310-manylinux_2_24_x86_64.whl
Algorithm Hash digest
SHA256 d9b8ce739ffe11aa65cb05a768e7617e2c52619d997af3306a6c2bb243511067
MD5 dc03943c346bff4addde108c70f006b5
BLAKE2b-256 8672b13c3441839ddf468fa401e9838788ccab715b90ac3b927c222f88c5bc40

See more details on using hashes here.

File details

Details for the file dupesearch-0.1.13-cp310-cp310-macosx_10_7_x86_64.whl.

File metadata

  • Download URL: dupesearch-0.1.13-cp310-cp310-macosx_10_7_x86_64.whl
  • Upload date:
  • Size: 249.7 kB
  • Tags: CPython 3.10, macOS 10.7+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13-cp310-cp310-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 f842496fa1d05613e9aa112e8e973b283f05c51dfe6f82eda5d9967424bcf008
MD5 97b65895ed67e73f69124a18b25a1108
BLAKE2b-256 56826e6db8562701fab257da3d6a4db0529a431542f12253fcccd9b2fc9f5c45

See more details on using hashes here.

File details

Details for the file dupesearch-0.1.13-cp39-none-win_amd64.whl.

File metadata

  • Download URL: dupesearch-0.1.13-cp39-none-win_amd64.whl
  • Upload date:
  • Size: 209.8 kB
  • Tags: CPython 3.9, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13-cp39-none-win_amd64.whl
Algorithm Hash digest
SHA256 761a4365f9a82af8bcf82439f5caf6351cdd0ed5913c045ed2d2916e0da4d97e
MD5 186e73d09959b2101971ac67148e44bc
BLAKE2b-256 65d9e3ad600cfefd3852770650374d2aa8126ef31dd143e41f0b6cd2157225fb

See more details on using hashes here.

File details

Details for the file dupesearch-0.1.13-cp39-cp39-manylinux_2_24_x86_64.whl.

File metadata

  • Download URL: dupesearch-0.1.13-cp39-cp39-manylinux_2_24_x86_64.whl
  • Upload date:
  • Size: 277.5 kB
  • Tags: CPython 3.9, manylinux: glibc 2.24+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13-cp39-cp39-manylinux_2_24_x86_64.whl
Algorithm Hash digest
SHA256 12fb3379e480efe69ef8d2ed504a146f9212084b3f79df4e8e28b6a3893f02cb
MD5 a892d02e7770c57a0a5ce6c25547416b
BLAKE2b-256 71414753d047497f52a7930d8a5cfe10c42ecd5a87fb94c3939e1d2c720e290d

See more details on using hashes here.

File details

Details for the file dupesearch-0.1.13-cp39-cp39-macosx_10_7_x86_64.whl.

File metadata

  • Download URL: dupesearch-0.1.13-cp39-cp39-macosx_10_7_x86_64.whl
  • Upload date:
  • Size: 249.7 kB
  • Tags: CPython 3.9, macOS 10.7+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13-cp39-cp39-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 1d3625ce816077221d77c4aa5c5a51182abd1a9bc7f8f2193b4dd4f0e37af4da
MD5 d0d39447fc291c899abdb4316733762a
BLAKE2b-256 df32d715c99b0c837b10390eb6c2ad2121a9f56bcaf98ec9922d425665961342

See more details on using hashes here.

File details

Details for the file dupesearch-0.1.13-cp38-none-win_amd64.whl.

File metadata

  • Download URL: dupesearch-0.1.13-cp38-none-win_amd64.whl
  • Upload date:
  • Size: 210.3 kB
  • Tags: CPython 3.8, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13-cp38-none-win_amd64.whl
Algorithm Hash digest
SHA256 947028c52a16aea691ff9d42f896b9d49b2e8ae11363f71e26852cc9c436f865
MD5 c04d3dd6a9dd48de0bfdab1c085f260c
BLAKE2b-256 3e27a228ded4c0f920c1d237c9546ca493b9293cf8f5ec6b87084802b505672f

See more details on using hashes here.

File details

Details for the file dupesearch-0.1.13-cp38-cp38-manylinux_2_24_x86_64.whl.

File metadata

  • Download URL: dupesearch-0.1.13-cp38-cp38-manylinux_2_24_x86_64.whl
  • Upload date:
  • Size: 277.9 kB
  • Tags: CPython 3.8, manylinux: glibc 2.24+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13-cp38-cp38-manylinux_2_24_x86_64.whl
Algorithm Hash digest
SHA256 8b8cff61dc7e1549853bdefeff37b5c0fb1d170bfc3448d2b8ca7472b1211b13
MD5 9f115937d470a454af6f3dd07c44d97e
BLAKE2b-256 616e3c7cc39a79704a5ee1293c83e387b840b36f7017b8d2625a7a0bb03ff02c

See more details on using hashes here.

File details

Details for the file dupesearch-0.1.13-cp38-cp38-macosx_10_7_x86_64.whl.

File metadata

  • Download URL: dupesearch-0.1.13-cp38-cp38-macosx_10_7_x86_64.whl
  • Upload date:
  • Size: 250.1 kB
  • Tags: CPython 3.8, macOS 10.7+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13-cp38-cp38-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 f065de85512d193739c42bf3e7d9c86ba6c34eb24ac9e95e3f64a63cb144138e
MD5 5cd7c41c1ff1d5be0e40eb4c55639200
BLAKE2b-256 9ab4f1ea92f0d8ef4049059af4443d3bdd9b8294ebcb004a3862e3b7d752d7f6

See more details on using hashes here.

File details

Details for the file dupesearch-0.1.13-cp37-none-win_amd64.whl.

File metadata

  • Download URL: dupesearch-0.1.13-cp37-none-win_amd64.whl
  • Upload date:
  • Size: 210.7 kB
  • Tags: CPython 3.7, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13-cp37-none-win_amd64.whl
Algorithm Hash digest
SHA256 3b481c6fa2ccc784907fd6b1602c88900d6405ac9aa3f8752216cdafcac832fe
MD5 e266af00f3b6c59973b9bace15babdca
BLAKE2b-256 0daae3d10f001315f08d91aa80bd5f9c2f6c9adf69b34adc58e6e139bb9bc62f

See more details on using hashes here.

File details

Details for the file dupesearch-0.1.13-cp37-cp37m-manylinux_2_24_x86_64.whl.

File metadata

  • Download URL: dupesearch-0.1.13-cp37-cp37m-manylinux_2_24_x86_64.whl
  • Upload date:
  • Size: 277.9 kB
  • Tags: CPython 3.7m, manylinux: glibc 2.24+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13-cp37-cp37m-manylinux_2_24_x86_64.whl
Algorithm Hash digest
SHA256 e9a2a1ed111d8afec35d23481f211dc3eed9c36a3037998883305f5c568955d9
MD5 c9597523d61928a54a0fbbe757273d69
BLAKE2b-256 ed9ef941dfc995645a351e6eb8a58a26fdc7283d6b9837178ce81ee06225596a

See more details on using hashes here.

File details

Details for the file dupesearch-0.1.13-cp37-cp37m-macosx_10_7_x86_64.whl.

File metadata

  • Download URL: dupesearch-0.1.13-cp37-cp37m-macosx_10_7_x86_64.whl
  • Upload date:
  • Size: 250.0 kB
  • Tags: CPython 3.7m, macOS 10.7+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for dupesearch-0.1.13-cp37-cp37m-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 8406649bcb01e23cc2fa887351d5ce45434b8e6d1c0594b2ade1d491ab7a2772
MD5 444c523eef97079d52e4761f7e411e70
BLAKE2b-256 721c34298c0bb479619a0daaa77204e8c046cd6ad73650d905309bcf48d323f6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page