Searches for duplicate files in folders (recursively, if needed)
Project description
Search Duplicates (searchdups)
This is a simple application that searches for duplicate files in a set of folders. To check whether the files are identical or not, it makes use of md5
or sha256
algorithms, but the application calculates a smart hash to enhance performance: the idea is to calculate a partial hash and finalize the calculation only if needed.
Additionally, this application includes a pseudo hash that consists of checking whether the name of the files is the same. If using this "hash algorithm", if the name of two files is the same, they are considered to be the same even if the content is not the same.
The basic usage is
$ searchdups -r .
> 8f8db820d89c39029a0629094e0f18c9*
/Users/calfonso/Programacion/norepo/searchdups/a1.jpg
/Users/calfonso/Programacion/norepo/searchdups/a11.jpg
Some other features are:
- Select the hash algorithm (using parameter
-H
). - Searching in subfolders (using flag
-r
). - Considering hidden folders and files (using flag
-a
). - Show a progress bar during the process (using flag
-p
). - Selecting which files are processed (using
-f
parameter for sh-like filters, or-e
parameter for regular expressions). - Exclude the files to process (using
-F
parameter for sh-like filters, or-E
parameter for regular expressions). - Summarize the amount of files and folders considered (using flag
-s
). - Get the result in a file (using parameter
-o
).
Please check the CLI help to get updated information about the usage of this tool.
Installation
To install the tool you can clone the code and execute the next command inside the cloned folder
$ pip install .
or install it from the repositories:
$ pip install searchdups
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file searchdups-1.0.0.tar.gz
.
File metadata
- Download URL: searchdups-1.0.0.tar.gz
- Upload date:
- Size: 9.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/29.0 requests/2.28.0 requests-toolbelt/0.9.1 urllib3/1.26.9 tqdm/4.61.1 importlib-metadata/4.8.1 keyring/23.1.0 rfc3986/1.5.0 colorama/0.4.4 CPython/3.9.16
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 927f08cd832f801ff3e3f3b1f4f34f6639b4217f53127287c1a2ac41b224d1d5 |
|
MD5 | 6f80b9c4b23731db1904a4b0df052d63 |
|
BLAKE2b-256 | 911576c875a49a7c0ae21fce16b3f2d7b5f8e40ae5916cb80322ca175ac4c3a8 |