Cross-platform duplicate file finder and cleaner
Project description
dupegun
A fast, cross-platform command-line tool to find and eliminate duplicate files.
What is dupegun?
dupegun scans your folders, detects duplicate files using a fast 3-pass hashing engine, and lets you delete, move, or hard-link them — all from your terminal. It works on every file type and every major operating system.
No GUI. No bloat. Just fast, safe, and simple.
Install
# Core install
pip install dupegun
# With TUI browser
pip install "dupegun[tui]"
# With watch mode
pip install "dupegun[watch]"
# Everything
pip install "dupegun[all]"
Requires Python 3.9 or higher.
Quick Start
# Scan a folder and see all duplicates
dupegun scan ~/Downloads
# Interactive TUI browser
dupegun tui ~/Downloads
# Monitor a folder for new duplicates
dupegun watch ~/Downloads
# Preview what would be deleted with a per-group breakdown
dupegun delete ~/Downloads --strategy newest
# Actually delete duplicates and save a log
dupegun delete ~/Downloads --strategy newest --no-dry-run --log deleted.log
# Undo those deletions
dupegun restore deleted.log --no-dry-run
Commands
scan — find duplicates
dupegun scan <path> [options]
# Scan a single folder
dupegun scan ~/Downloads
# Scan multiple folders at once
dupegun scan ~/Downloads ~/Documents ~/Desktop
# Skip files smaller than 1 MB
dupegun scan ~/Downloads --min-size 1MB
# Scan specific size ranges
dupegun scan ~/Downloads --min-size 1MB --max-size 100MB
# Regex filename filter
dupegun scan ~/Downloads --pattern "Copy of.*"
# Only scan image files
dupegun scan ~/Downloads --type .jpg --type .png --type .gif
# Skip specific folders
dupegun scan C:\ --exclude Windows --exclude "Program Files"
# Just show total wasted space
dupegun scan ~/Downloads --summary
# Show count with colorized bar showing % of wasted space
dupegun scan ~/Downloads --count
# Export results
dupegun scan ~/Downloads --json results.json
dupegun scan ~/Downloads --csv results.csv
dupegun scan ~/Downloads --html report.html
restore — undo deletions
Reverse a previous dupegun delete --log run by copying the kept file
back to where each deleted duplicate used to live.
dupegun restore <log_file> [options]
# Preview what would be restored (dry-run ON by default)
dupegun restore deleted.log
# Actually restore
dupegun restore deleted.log --no-dry-run
The restore command reads the TSV log file, shows you exactly what it will do in a table, then copies the keeper to each deleted path.
tui — interactive terminal browser
# Requires: pip install "dupegun[tui]"
dupegun tui ~/Downloads
dupegun tui ~/Downloads --strategy newest
dupegun tui ~/Downloads --no-dry-run
Controls:
| Key | Action |
|---|---|
| Space | Toggle file for deletion |
| A | Mark all duplicates in group |
| U | Unmark all in group |
| D | Delete all marked files |
| S | Skip to next group |
| Q / Escape | Quit |
watch — monitor for new duplicates
# Requires: pip install "dupegun[watch]"
dupegun watch ~/Downloads
dupegun watch ~/Photos --type .jpg --type .png
Press Ctrl+C to stop.
config — manage your config file
dupegun config --init # create ~/.dupegun.toml
dupegun config --show # print current config
dupegun config --path # show config file path
Example ~/.dupegun.toml:
[defaults]
strategy = "newest"
min_size = "100KB"
exclude = ["node_modules", ".git", "Windows"]
[plugins]
load = ["~/my_plugin.py"]
stats — folder statistics
dupegun stats ~/Downloads
Output:
Scanned paths ~/Downloads
Total files 1,243
Total size 45.2 GB
Duplicate groups 87
Duplicate files 201
Wasted space 8.3 GB (18.4%)
compare — cross-directory duplicates
dupegun compare ~/Downloads ~/Backup
dupegun compare ~/Photos ~/Backup/Photos --type .jpg --type .png
delete — remove duplicates
# Preview with detailed per-group breakdown (dry-run ON by default)
dupegun delete ~/Downloads --strategy newest
# Actually delete
dupegun delete ~/Downloads --strategy newest --no-dry-run
# Delete with log so you can restore later
dupegun delete ~/Downloads --no-dry-run --log deleted.log
# Restore if you change your mind
dupegun restore deleted.log --no-dry-run
move — quarantine duplicates
dupegun move ~/Downloads --dest ~/quarantine --no-dry-run
hardlink — save space, keep all paths
dupegun hardlink ~/Photos --no-dry-run
Plugin system
# my_plugin.py
from dupegun.plugins import register_strategy
@register_strategy("by_name")
def keep_alphabetically(paths):
return min(paths, key=lambda p: p.name.lower())
dupegun delete ~/Downloads --plugin my_plugin.py --strategy by_name --no-dry-run
Options
| Option | Commands | Description | Default |
|---|---|---|---|
--strategy <name> |
delete, move, hardlink, tui | shortest, newest, oldest, or plugin name | shortest |
--dry-run |
delete, move, hardlink, tui | Preview with per-group breakdown | ON |
--no-dry-run |
delete, move, hardlink, tui | Actually perform the action | — |
--interactive |
delete | Confirm each group before acting | OFF |
--older-than <days> |
delete | Only delete copies older than N days | — |
--log <file> |
delete | Append a TSV log of every deleted file | — |
--plugin <file> |
delete, tui | Load a plugin .py file (repeatable) | — |
--config <file> |
all | Path to a TOML config file | ~/.dupegun.toml |
--min-size <size> |
all | Skip files smaller than this | 1 byte |
--max-size <size> |
all | Skip files larger than this | no limit |
--pattern <regex> |
all | Only scan filenames matching this regex | none |
--type <ext> |
all | Only include files with this extension (repeatable) | all |
--exclude <name> |
all | Skip folders with this name (repeatable) | none |
--summary |
scan | Total wasted space only, no file list | OFF |
--count |
scan | Group count with colorized wasted-space bar | OFF |
--json <file> |
scan | Export results to JSON | — |
--csv <file> |
scan | Export results to CSV | — |
--html <file> |
scan | Export self-contained HTML report | — |
How it works
Pass 1 — Group files by exact byte size
Pass 2 — Hash the first 4 KB of each size-match
Pass 3 — Full SHA-256 hash of remaining candidates
Safety
- Dry-run is ON by default on every destructive command.
- Dry-run now shows a per-group breakdown of exactly what would be freed.
- Use
--logto keep an audit trail, andrestoreto undo if needed. - Use
moveinstead ofdeleteif you want a safety net.
Platform support
| Platform | Supported |
|---|---|
| Windows | Yes |
| Linux | Yes |
| macOS | Yes |
Changelog
v2.1.0
restorecommand: Undo deletions recorded in a--logfile. Copies the kept file back to where each deleted duplicate used to live.- Dry-run summary:
deletedry-run now shows a per-group breakdown — which file would be kept, how many deleted, and exactly how much space would be freed. - ETA progress bar: All scan/hash operations now show estimated time remaining alongside the progress bar.
- Colorized
--count:scan --countnow shows a color-coded bar (green/yellow/red) indicating what percentage of your total disk usage is wasted on duplicates.
v2.0.0
tuicommand: Interactive terminal UI browser.watchcommand: Monitor folders for new duplicates in real time.configcommand: Manage~/.dupegun.tomlconfig file.- Plugin system: Register custom keep-strategies with
@register_strategy.
v1.3.0
statscommand,--htmlreport,--logaudit trail.
v1.2.0
comparecommand,--older-than,--max-size,--pattern.
v1.1.0
--type,--exclude,--summary,--count.
v1.0.0
- Initial release:
scan,delete,move,hardlink.
Contributing
git clone https://github.com/Prasanna-Balakrishnan/dupegun.git
cd dupegun
pip install -e ".[all]"
pip install pytest
python -m pytest tests/ -v
License
MIT — see LICENSE for details.
Author
Made by Prasanna B
GitHub: https://github.com/Prasanna-Balakrishnan/dupegun
If this tool helped you, consider giving it a star on GitHub!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file dupegun-2.1.0.tar.gz.
File metadata
- Download URL: dupegun-2.1.0.tar.gz
- Upload date:
- Size: 34.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
051b00f032f0958b3ef25da70741b400d4ef9fa8e663b2fdd1fa435ba51531e7
|
|
| MD5 |
0443292c2ee93451faaada9195b72c1f
|
|
| BLAKE2b-256 |
e3955573fd3ff8e5868252e6673c9c9e00219f6c9b50ca5600fa7caec3037c75
|
File details
Details for the file dupegun-2.1.0-py3-none-any.whl.
File metadata
- Download URL: dupegun-2.1.0-py3-none-any.whl
- Upload date:
- Size: 28.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d4389f7af53bfaa21085d54a090a0c3644337def54353a2abdce9ab045c4fbdf
|
|
| MD5 |
22abb9d7d24086a005c188a5aba4a68c
|
|
| BLAKE2b-256 |
365ef0c2ff0c4c45aa1b86488a18c41c35bb7539ea8009e4ea60b1c2ac7ec6a0
|