📧 CLI to deduplicate mails from mail boxes
Verified details
These details have been verified by PyPIProject links
GitHub Statistics
Maintainers
Project description
What is Mail Deduplicate?
Provides the mdedup CLI, an utility to deduplicate mails from a set of boxes.
Features
- Duplicate detection based on cherry-picked and normalized mail headers.
- Fetch mails from multiple sources.
- Reads and writes to
mbox,maildir,babyl,mhandmmdfformats. - Deduplication strategies based on size, content, timestamp, file path or random choice.
- Copy, move or delete the resulting set of duplicates.
- Dry-run mode.
- Protection against false-positives with safety checks on size and content differences.
- Supports macOS, Linux and Windows.
- Standalone executables for Linux, macOS and Windows.
- Shell auto-completion for Bash, Zsh and Fish.
Installation
All installation methods are available in the documentation. Below are the most popular ones:
Try it now
uv is the fastest way to run mdedup on any platform, thanks to its uvx command:
$ uvx --from mail-deduplicate -- mdedup
macOS
mdedup is part of the official Homebrew default tap, so you can install it with:
$ brew install mail-deduplicate
Executables
Standalone binaries of mdedup's latest version are available as direct downloads for several platforms and architectures:
| Platform | arm64 |
x86_64 |
|---|---|---|
| Linux | Download mdedup-linux-arm64.bin |
Download mdedup-linux-x64.bin |
| macOS | Download mdedup-macos-arm64.bin |
Download mdedup-macos-x64.bin |
| Windows | Download mdedup-windows-arm64.exe |
Download mdedup-windows-x64.exe |
Quickstart
[!WARNING] Performance and memory usage:
mdedupimplementation is quite naive and everything resides in memory.If this is good enough for a volume of a couple of gigabytes, the more emails
mdeduptry to parse, the closer you'll reach the memory limits of your machine. In which casemdedupwill exit abruptly, zapped by the OOM killer of your OS. Of course your mileage may vary depending on your hardware.You can influence implementation of this feature with pull requests, purchasing business support 🤝 and sponsorship 🫶.
Example
Project details
Verified details
These details have been verified by PyPIProject links
GitHub Statistics
Maintainers
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file mail_deduplicate-9.0.0.tar.gz.
File metadata
- Download URL: mail_deduplicate-9.0.0.tar.gz
- Upload date:
- Size: 39.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
86d6d116b0d07a0308c03f74b4f138df2db221c72ca8bb9e9922010570bea5a0
|
|
| MD5 |
39238873e83339dbf80c0f0860c40ef1
|
|
| BLAKE2b-256 |
eb557c0403d149046cbdfcaebe2299454d0bc4d33e6ac41f8651a8cc9fbe48d5
|
Provenance
The following attestation bundles were made for mail_deduplicate-9.0.0.tar.gz:
Publisher:
release.yaml on kdeldycke/mail-deduplicate
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
mail_deduplicate-9.0.0.tar.gz -
Subject digest:
86d6d116b0d07a0308c03f74b4f138df2db221c72ca8bb9e9922010570bea5a0 - Sigstore transparency entry: 2256944779
- Sigstore integration time:
-
Permalink:
kdeldycke/mail-deduplicate@861670c9e65349b679e69b79241f56eb2bdf94d6 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/kdeldycke
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yaml@861670c9e65349b679e69b79241f56eb2bdf94d6 -
Trigger Event:
push
-
Statement type:
File details
Details for the file mail_deduplicate-9.0.0-py3-none-any.whl.
File metadata
- Download URL: mail_deduplicate-9.0.0-py3-none-any.whl
- Upload date:
- Size: 40.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
dc462fac332d4ddc200d8a296479eeb0fada9b2bf7095c41a789b9ffb68c8144
|
|
| MD5 |
939b61ff573e3fc8fbf72b7c1737ceb9
|
|
| BLAKE2b-256 |
c55b098b3e5e3af97e7ac27aa41f20bc79290a7620e4a3550cab087ce71a4902
|
Provenance
The following attestation bundles were made for mail_deduplicate-9.0.0-py3-none-any.whl:
Publisher:
release.yaml on kdeldycke/mail-deduplicate
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
mail_deduplicate-9.0.0-py3-none-any.whl -
Subject digest:
dc462fac332d4ddc200d8a296479eeb0fada9b2bf7095c41a789b9ffb68c8144 - Sigstore transparency entry: 2256944777
- Sigstore integration time:
-
Permalink:
kdeldycke/mail-deduplicate@861670c9e65349b679e69b79241f56eb2bdf94d6 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/kdeldycke
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yaml@861670c9e65349b679e69b79241f56eb2bdf94d6 -
Trigger Event:
push
-
Statement type:
