Skip to main content

dupesearch

A fast and simple command line tool written in rust and python for finding duplicate files.

Should I use it?

Probably not, this is still a WIP, it's quite messy, I haven't tested most of it, and was my first time using Rust so I probably did some dodgy stuff.

How do I use it?

  1. Install the dupesearch package from pip using your preferred command.
  2. Run python -m dupesearch -i and follow the instructions.

Contributions

To set up locally:

  1. Clone the repository with git clone https://github.com/wookie184/dupesearch.git
  2. cd into the repository with cd dupesearch
  3. Create and activate a venv, and make sure to point your editor to the executable if necessary.
  4. Install the dev requirements with pip install -r requirements-dev.txt
  5. Install the pre-commit hooks with pre-commit install
  6. Install the rust crate as a module with maturin develop --release
  7. Finally, run the project with python -m dupesearch

If you'd like to make a contribution, feel free to and i'll try to merge it in. If it's not a tiny change please create an issue first, at least to ensure that i'm still active and able to review the changes.

Any issues suggesting improvements are also welcome, although this was just done as a practice project to get started with rust and packaging python projects, so I may not implement every suggestion.

Metadata

Release files for dupesearch 0.1.13

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dupesearch 0.1.13
File Size Uploaded
dupesearch-0.1.13.tar.gz 12.4 kB Details

Built distributions (wheels)

Table of built distributions (wheels) for dupesearch 0.1.13
File
dupesearch-0.1.13-cp310-none-win_amd64.whl CPython 3.10 none Windows x86-64 Details
dupesearch-0.1.13-cp310-cp310-manylinux_2_24_x86_64.whl CPython 3.10 CPython 3.10 Linux glibc 2.24+ x86-64 Details
dupesearch-0.1.13-cp310-cp310-macosx_10_7_x86_64.whl CPython 3.10 CPython 3.10 macOS 10.7+ x86-64 Details
dupesearch-0.1.13-cp39-none-win_amd64.whl CPython 3.9 none Windows x86-64 Details
dupesearch-0.1.13-cp39-cp39-manylinux_2_24_x86_64.whl CPython 3.9 CPython 3.9 Linux glibc 2.24+ x86-64 Details
dupesearch-0.1.13-cp39-cp39-macosx_10_7_x86_64.whl CPython 3.9 CPython 3.9 macOS 10.7+ x86-64 Details
dupesearch-0.1.13-cp38-none-win_amd64.whl CPython 3.8 none Windows x86-64 Details
dupesearch-0.1.13-cp38-cp38-manylinux_2_24_x86_64.whl CPython 3.8 CPython 3.8 Linux glibc 2.24+ x86-64 Details
dupesearch-0.1.13-cp38-cp38-macosx_10_7_x86_64.whl CPython 3.8 CPython 3.8 macOS 10.7+ x86-64 Details
dupesearch-0.1.13-cp37-none-win_amd64.whl CPython 3.7 none Windows x86-64 Details
dupesearch-0.1.13-cp37-cp37m-manylinux_2_24_x86_64.whl CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.24+ x86-64 Details
dupesearch-0.1.13-cp37-cp37m-macosx_10_7_x86_64.whl CPython 3.7 CPython 3.7 pymalloc macOS 10.7+ x86-64 Details

Total release size: 3.0 MB

Release files / dupesearch-0.1.13.tar.gz

Download URL dupesearch-0.1.13.tar.gz
Size 12.4 kB
Tags Source
SHA-256 checksum
How to use checksums
388e36641441eb3b78d69f4d9e53529103df3e7e478e310f0cbde0fb3e487569
BLAKE2b-256 checksum
How to use checksums
3f12b1f2028661e221e9b3f59ad4a02c195de688d60b5e8c0cad898e92c609e4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

Release files / dupesearch-0.1.13-cp310-none-win_amd64.whl

Download URL dupesearch-0.1.13-cp310-none-win_amd64.whl
Size 209.9 kB
Tags CPython 3.10 Windows x86-64
SHA-256 checksum
How to use checksums
8479d65321a10601f4d25051dfdda26ebb0351d841f5901dbff84c7bc423d27b
BLAKE2b-256 checksum
How to use checksums
6ab5a50c5c88f60b1e6556c89ebb308d997aea6f819ea2a868d3e8c153499dca
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

Release files / dupesearch-0.1.13-cp310-cp310-manylinux_2_24_x86_64.whl

Download URL dupesearch-0.1.13-cp310-cp310-manylinux_2_24_x86_64.whl
Size 277.4 kB
Tags CPython 3.10 Linux glibc 2.24+ x86-64
SHA-256 checksum
How to use checksums
d9b8ce739ffe11aa65cb05a768e7617e2c52619d997af3306a6c2bb243511067
BLAKE2b-256 checksum
How to use checksums
8672b13c3441839ddf468fa401e9838788ccab715b90ac3b927c222f88c5bc40
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

Release files / dupesearch-0.1.13-cp310-cp310-macosx_10_7_x86_64.whl

Download URL dupesearch-0.1.13-cp310-cp310-macosx_10_7_x86_64.whl
Size 249.7 kB
Tags CPython 3.10 macOS 10.7+ x86-64
SHA-256 checksum
How to use checksums
f842496fa1d05613e9aa112e8e973b283f05c51dfe6f82eda5d9967424bcf008
BLAKE2b-256 checksum
How to use checksums
56826e6db8562701fab257da3d6a4db0529a431542f12253fcccd9b2fc9f5c45
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

Release files / dupesearch-0.1.13-cp39-none-win_amd64.whl

Download URL dupesearch-0.1.13-cp39-none-win_amd64.whl
Size 209.8 kB
Tags CPython 3.9 Windows x86-64
SHA-256 checksum
How to use checksums
761a4365f9a82af8bcf82439f5caf6351cdd0ed5913c045ed2d2916e0da4d97e
BLAKE2b-256 checksum
How to use checksums
65d9e3ad600cfefd3852770650374d2aa8126ef31dd143e41f0b6cd2157225fb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

Release files / dupesearch-0.1.13-cp39-cp39-manylinux_2_24_x86_64.whl

Download URL dupesearch-0.1.13-cp39-cp39-manylinux_2_24_x86_64.whl
Size 277.5 kB
Tags CPython 3.9 Linux glibc 2.24+ x86-64
SHA-256 checksum
How to use checksums
12fb3379e480efe69ef8d2ed504a146f9212084b3f79df4e8e28b6a3893f02cb
BLAKE2b-256 checksum
How to use checksums
71414753d047497f52a7930d8a5cfe10c42ecd5a87fb94c3939e1d2c720e290d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

Release files / dupesearch-0.1.13-cp39-cp39-macosx_10_7_x86_64.whl

Download URL dupesearch-0.1.13-cp39-cp39-macosx_10_7_x86_64.whl
Size 249.7 kB
Tags CPython 3.9 macOS 10.7+ x86-64
SHA-256 checksum
How to use checksums
1d3625ce816077221d77c4aa5c5a51182abd1a9bc7f8f2193b4dd4f0e37af4da
BLAKE2b-256 checksum
How to use checksums
df32d715c99b0c837b10390eb6c2ad2121a9f56bcaf98ec9922d425665961342
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

Release files / dupesearch-0.1.13-cp38-none-win_amd64.whl

Download URL dupesearch-0.1.13-cp38-none-win_amd64.whl
Size 210.3 kB
Tags CPython 3.8 Windows x86-64
SHA-256 checksum
How to use checksums
947028c52a16aea691ff9d42f896b9d49b2e8ae11363f71e26852cc9c436f865
BLAKE2b-256 checksum
How to use checksums
3e27a228ded4c0f920c1d237c9546ca493b9293cf8f5ec6b87084802b505672f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

Release files / dupesearch-0.1.13-cp38-cp38-manylinux_2_24_x86_64.whl

Download URL dupesearch-0.1.13-cp38-cp38-manylinux_2_24_x86_64.whl
Size 277.9 kB
Tags CPython 3.8 Linux glibc 2.24+ x86-64
SHA-256 checksum
How to use checksums
8b8cff61dc7e1549853bdefeff37b5c0fb1d170bfc3448d2b8ca7472b1211b13
BLAKE2b-256 checksum
How to use checksums
616e3c7cc39a79704a5ee1293c83e387b840b36f7017b8d2625a7a0bb03ff02c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

Release files / dupesearch-0.1.13-cp38-cp38-macosx_10_7_x86_64.whl

Download URL dupesearch-0.1.13-cp38-cp38-macosx_10_7_x86_64.whl
Size 250.1 kB
Tags CPython 3.8 macOS 10.7+ x86-64
SHA-256 checksum
How to use checksums
f065de85512d193739c42bf3e7d9c86ba6c34eb24ac9e95e3f64a63cb144138e
BLAKE2b-256 checksum
How to use checksums
9ab4f1ea92f0d8ef4049059af4443d3bdd9b8294ebcb004a3862e3b7d752d7f6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

Release files / dupesearch-0.1.13-cp37-none-win_amd64.whl

Download URL dupesearch-0.1.13-cp37-none-win_amd64.whl
Size 210.7 kB
Tags CPython 3.7 Windows x86-64
SHA-256 checksum
How to use checksums
3b481c6fa2ccc784907fd6b1602c88900d6405ac9aa3f8752216cdafcac832fe
BLAKE2b-256 checksum
How to use checksums
0daae3d10f001315f08d91aa80bd5f9c2f6c9adf69b34adc58e6e139bb9bc62f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

Release files / dupesearch-0.1.13-cp37-cp37m-manylinux_2_24_x86_64.whl

Download URL dupesearch-0.1.13-cp37-cp37m-manylinux_2_24_x86_64.whl
Size 277.9 kB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.24+ x86-64
SHA-256 checksum
How to use checksums
e9a2a1ed111d8afec35d23481f211dc3eed9c36a3037998883305f5c568955d9
BLAKE2b-256 checksum
How to use checksums
ed9ef941dfc995645a351e6eb8a58a26fdc7283d6b9837178ce81ee06225596a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

Release files / dupesearch-0.1.13-cp37-cp37m-macosx_10_7_x86_64.whl

Download URL dupesearch-0.1.13-cp37-cp37m-macosx_10_7_x86_64.whl
Size 250.0 kB
Tags CPython 3.7 CPython 3.7 pymalloc macOS 10.7+ x86-64
SHA-256 checksum
How to use checksums
8406649bcb01e23cc2fa887351d5ce45434b8e6d1c0594b2ade1d491ab7a2772
BLAKE2b-256 checksum
How to use checksums
721c34298c0bb479619a0daaa77204e8c046cd6ad73650d905309bcf48d323f6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page