Remove duplicates from parallel corpora

Project description

RemoveDup

A fast, memory efficient Python module to remove duplicates from parallel text corpora.

It's useful for cleaning up datasets that contain duplicate entries for training language models.

Installation

pip install removedup

Usage

from removedup import rdup

src, tgt, removed = rdup("source.txt", "target.txt")
print(src, tgt, removed)
# source.txt.dedup
# target.txt.dedup
# <num lines removed>

Notes

Source and target must have the same number of lines. No validation checks are made.

Duplication checks are only made on the source content. If you want to check for duplicates on the target, simply switch the order of the parameters.

Build

git clone https://github.com/LibreTranslate/RemoveDup
cd RemoveDup
python setup.py build

Standalone Binary

You can also use removedup as a standalone Windows, macOS or Linux application (but you currently need to build from source, we don't provide binaries).

mkdir build
cd build && cmake .. && make -j4
./rdup source.txt target.txt

Contributing

We welcome pull requests!

License

AGPLv3

Project details

Release history Release notifications | RSS feed

This version

1.0.6

Jan 3, 2024

1.0.5

Jan 3, 2024

1.0.4

Jan 3, 2024

1.0.3

Dec 30, 2023

1.0.2

Dec 30, 2023

1.0.1

Dec 30, 2023

1.0.0

Dec 29, 2023

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

removedup-1.0.6.tar.gz (345.3 kB view hashes)

Uploaded Jan 3, 2024 Source

Built Distributions

removedup-1.0.6-pp310-pypy310_pp73-win_amd64.whl (70.5 kB view hashes)

Uploaded Jan 3, 2024 PyPy Windows x86-64

removedup-1.0.6-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (85.3 kB view hashes)

Uploaded Jan 3, 2024 PyPy manylinux: glibc 2.17+ x86-64

removedup-1.0.6-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl (90.9 kB view hashes)

Uploaded Jan 3, 2024 PyPy manylinux: glibc 2.17+ i686

removedup-1.0.6-pp310-pypy310_pp73-macosx_10_9_x86_64.whl (63.5 kB view hashes)

Uploaded Jan 3, 2024 PyPy macOS 10.9+ x86-64

removedup-1.0.6-pp39-pypy39_pp73-win_amd64.whl (70.6 kB view hashes)

Uploaded Jan 3, 2024 PyPy Windows x86-64

removedup-1.0.6-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (85.2 kB view hashes)

Uploaded Jan 3, 2024 PyPy manylinux: glibc 2.17+ x86-64

removedup-1.0.6-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl (90.9 kB view hashes)

Uploaded Jan 3, 2024 PyPy manylinux: glibc 2.17+ i686

removedup-1.0.6-pp39-pypy39_pp73-macosx_10_9_x86_64.whl (63.5 kB view hashes)

Uploaded Jan 3, 2024 PyPy macOS 10.9+ x86-64

removedup-1.0.6-pp38-pypy38_pp73-win_amd64.whl (70.5 kB view hashes)

Uploaded Jan 3, 2024 PyPy Windows x86-64

removedup-1.0.6-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (85.3 kB view hashes)

Uploaded Jan 3, 2024 PyPy manylinux: glibc 2.17+ x86-64

removedup-1.0.6-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl (90.9 kB view hashes)

Uploaded Jan 3, 2024 PyPy manylinux: glibc 2.17+ i686

removedup-1.0.6-pp38-pypy38_pp73-macosx_10_9_x86_64.whl (63.5 kB view hashes)

Uploaded Jan 3, 2024 PyPy macOS 10.9+ x86-64

removedup-1.0.6-pp37-pypy37_pp73-win_amd64.whl (70.4 kB view hashes)

Uploaded Jan 3, 2024 PyPy Windows x86-64

removedup-1.0.6-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (84.8 kB view hashes)

Uploaded Jan 3, 2024 PyPy manylinux: glibc 2.17+ x86-64

removedup-1.0.6-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whl (90.4 kB view hashes)

Uploaded Jan 3, 2024 PyPy manylinux: glibc 2.17+ i686

removedup-1.0.6-pp37-pypy37_pp73-macosx_10_9_x86_64.whl (63.1 kB view hashes)

Uploaded Jan 3, 2024 PyPy macOS 10.9+ x86-64

removedup-1.0.6-cp312-cp312-win_amd64.whl (70.4 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.12 Windows x86-64

removedup-1.0.6-cp312-cp312-win32.whl (64.4 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.12 Windows x86

removedup-1.0.6-cp312-cp312-musllinux_1_1_x86_64.whl (610.5 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.12 musllinux: musl 1.1+ x86-64

removedup-1.0.6-cp312-cp312-musllinux_1_1_i686.whl (668.5 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.12 musllinux: musl 1.1+ i686

removedup-1.0.6-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (86.3 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.12 manylinux: glibc 2.17+ x86-64

removedup-1.0.6-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl (92.2 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.12 manylinux: glibc 2.17+ i686

removedup-1.0.6-cp312-cp312-macosx_10_9_x86_64.whl (63.5 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.12 macOS 10.9+ x86-64

removedup-1.0.6-cp311-cp311-win_amd64.whl (71.5 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.11 Windows x86-64

removedup-1.0.6-cp311-cp311-win32.whl (64.9 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.11 Windows x86

removedup-1.0.6-cp311-cp311-musllinux_1_1_x86_64.whl (610.7 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.11 musllinux: musl 1.1+ x86-64

removedup-1.0.6-cp311-cp311-musllinux_1_1_i686.whl (668.7 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.11 musllinux: musl 1.1+ i686

removedup-1.0.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (87.0 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.11 manylinux: glibc 2.17+ x86-64

removedup-1.0.6-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl (92.4 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.11 manylinux: glibc 2.17+ i686

removedup-1.0.6-cp311-cp311-macosx_10_9_x86_64.whl (64.8 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.11 macOS 10.9+ x86-64

removedup-1.0.6-cp310-cp310-win_amd64.whl (70.7 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.10 Windows x86-64

removedup-1.0.6-cp310-cp310-win32.whl (63.9 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.10 Windows x86

removedup-1.0.6-cp310-cp310-musllinux_1_1_x86_64.whl (609.7 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.10 musllinux: musl 1.1+ x86-64

removedup-1.0.6-cp310-cp310-musllinux_1_1_i686.whl (667.3 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.10 musllinux: musl 1.1+ i686

removedup-1.0.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (85.3 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.10 manylinux: glibc 2.17+ x86-64

removedup-1.0.6-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl (91.5 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.10 manylinux: glibc 2.17+ i686

removedup-1.0.6-cp310-cp310-macosx_10_9_x86_64.whl (63.4 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.10 macOS 10.9+ x86-64

removedup-1.0.6-cp39-cp39-win_amd64.whl (70.7 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.9 Windows x86-64

removedup-1.0.6-cp39-cp39-win32.whl (64.1 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.9 Windows x86

removedup-1.0.6-cp39-cp39-musllinux_1_1_x86_64.whl (610.0 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.9 musllinux: musl 1.1+ x86-64

removedup-1.0.6-cp39-cp39-musllinux_1_1_i686.whl (667.6 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.9 musllinux: musl 1.1+ i686

removedup-1.0.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (85.4 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.9 manylinux: glibc 2.17+ x86-64

removedup-1.0.6-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl (91.6 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.9 manylinux: glibc 2.17+ i686

removedup-1.0.6-cp39-cp39-macosx_10_9_x86_64.whl (63.5 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.9 macOS 10.9+ x86-64

removedup-1.0.6-cp38-cp38-win_amd64.whl (70.8 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.8 Windows x86-64

removedup-1.0.6-cp38-cp38-win32.whl (63.9 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.8 Windows x86

removedup-1.0.6-cp38-cp38-musllinux_1_1_x86_64.whl (609.8 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.8 musllinux: musl 1.1+ x86-64

removedup-1.0.6-cp38-cp38-musllinux_1_1_i686.whl (667.2 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.8 musllinux: musl 1.1+ i686

removedup-1.0.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (85.2 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.8 manylinux: glibc 2.17+ x86-64

removedup-1.0.6-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl (91.4 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.8 manylinux: glibc 2.17+ i686

removedup-1.0.6-cp38-cp38-macosx_10_9_x86_64.whl (63.4 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.8 macOS 10.9+ x86-64

removedup-1.0.6-cp37-cp37m-win_amd64.whl (71.1 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.7m Windows x86-64

removedup-1.0.6-cp37-cp37m-win32.whl (64.8 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.7m Windows x86

removedup-1.0.6-cp37-cp37m-musllinux_1_1_x86_64.whl (610.7 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.7m musllinux: musl 1.1+ x86-64

removedup-1.0.6-cp37-cp37m-musllinux_1_1_i686.whl (669.3 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.7m musllinux: musl 1.1+ i686

removedup-1.0.6-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (85.7 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.7m manylinux: glibc 2.17+ x86-64

removedup-1.0.6-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl (92.1 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.7m manylinux: glibc 2.17+ i686

removedup-1.0.6-cp37-cp37m-macosx_10_9_x86_64.whl (63.3 kB view hashes)

Uploaded Jan 3, 2024 CPython 3.7m macOS 10.9+ x86-64

Hashes for removedup-1.0.6.tar.gz

Hashes for removedup-1.0.6.tar.gz
Algorithm	Hash digest
SHA256	`82a6b7eda27f05e1dec89fd8172c056d13221a73e240223d7938298579740f68`
MD5	`b96b7ee583132df605d37279c87d25a1`
BLAKE2b-256	`ad01973d0ab469bd06c429d549a5ff85e74c863d12c79cdec795553cf11d7576`

Hashes for removedup-1.0.6-pp310-pypy310_pp73-win_amd64.whl

Hashes for removedup-1.0.6-pp310-pypy310_pp73-win_amd64.whl
Algorithm	Hash digest
SHA256	`5c832b61e33680c1b5836aab1b39e6e29ce2558195f67f1b9a144c779abd28d2`
MD5	`8fdaaa047b2d1a904e5cf7e98a01d623`
BLAKE2b-256	`4246cdb17c4ca629358ab519c10297bc0da1f7c148abf5d341570148827dce0d`

Hashes for removedup-1.0.6-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Hashes for removedup-1.0.6-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`cf0e7eedb23a26a5d2ee9123b00e2681a58758e790ac66ccc3684ab154475a77`
MD5	`bf8754e31709096332d9cefb6d940598`
BLAKE2b-256	`a948b2b833318a4966418a90c111d029cc77ede02c1ff8299a0a00aa913a1b4a`

Hashes for removedup-1.0.6-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl

Hashes for removedup-1.0.6-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm	Hash digest
SHA256	`4f263cd70891b047ab94950dcfa8e63326a4740f03d8daf1897a38825711955c`
MD5	`17b6d376a2a0e66fbb6be3045f552ef7`
BLAKE2b-256	`71ec5cb37b6aa7df021fe52149c7a8ca26c9575c1e7063f74dc997eb236a6a73`

Hashes for removedup-1.0.6-pp310-pypy310_pp73-macosx_10_9_x86_64.whl

Hashes for removedup-1.0.6-pp310-pypy310_pp73-macosx_10_9_x86_64.whl
Algorithm	Hash digest
SHA256	`c363508589de26c296272ae810d51e38cb39214eee97955822d7aa936c9e70d6`
MD5	`dfbe41653cf47eed4e4ef6feb8b03589`
BLAKE2b-256	`a5f53788892366db26a679c40de20839ee65885456cfbf3aa49fa5dc7e7a7659`

Hashes for removedup-1.0.6-pp39-pypy39_pp73-win_amd64.whl

Hashes for removedup-1.0.6-pp39-pypy39_pp73-win_amd64.whl
Algorithm	Hash digest
SHA256	`d3f58cfe117a49fd1b14fab4ca4bc52934441f7385eb298cf9481641fbcd118d`
MD5	`d5e029bd6f887e1b9d63ded0248ba2c4`
BLAKE2b-256	`76e3c74d1885085e4a4b91f36d9eaa188efd931ba5ea84872bee5c584794cf84`

Hashes for removedup-1.0.6-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Hashes for removedup-1.0.6-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`1e87ebd6ec384bf4afe24fbb518d5268978cabca8b06eb2b430048a4a7d5e8c5`
MD5	`bd45402816f6441d9275163ad659f2d6`
BLAKE2b-256	`d43724959755534daa1c3592b09a20495645ba4fb979afa0b79019f9e1e571a6`

Hashes for removedup-1.0.6-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl

Hashes for removedup-1.0.6-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm	Hash digest
SHA256	`f3ce8d0f2f82f64a32cc48c628ecb44d291f526315dfeca8afbf49ea22fb37a8`
MD5	`1efa2cf5dca3c5ef2224f5755d51c5b0`
BLAKE2b-256	`8d4895f16a3378bbb217d31acfda763485ef0ef70b38d372f1b623b23691904c`

Hashes for removedup-1.0.6-pp39-pypy39_pp73-macosx_10_9_x86_64.whl

Hashes for removedup-1.0.6-pp39-pypy39_pp73-macosx_10_9_x86_64.whl
Algorithm	Hash digest
SHA256	`6033c8944936eedc4f14bf6e91dd5ce2bdd8692bdbff69be63e3be775160b856`
MD5	`3e7f7fd759a6640e98b69d1f3193dc67`
BLAKE2b-256	`91ffceff7b8814b3b5524599a10847738623926449b3ad7849fd2f05fb07e953`

Hashes for removedup-1.0.6-pp38-pypy38_pp73-win_amd64.whl

Hashes for removedup-1.0.6-pp38-pypy38_pp73-win_amd64.whl
Algorithm	Hash digest
SHA256	`40cd862b06c4a8d4f82b30381f084467d2eb8e6d9e79eff5713c844054e60d3d`
MD5	`15fc1c8d95b1e0ba9f6b26cf6bf85774`
BLAKE2b-256	`03cb76f56dab9e78e57317acbcedb7d66fb6d5a1f30de7213f09049692b31a83`

Hashes for removedup-1.0.6-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Hashes for removedup-1.0.6-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`223f6519b290b879a5ae578e0f941ce991b953269a0eafa38891c501853ede0b`
MD5	`1cb14333ac5f9f2fbd2521972158d922`
BLAKE2b-256	`7f3590a4ad3dd463015b68b33e7757a88f34890653f10fe7bb9ab619b5150ca4`

Hashes for removedup-1.0.6-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl

Hashes for removedup-1.0.6-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm	Hash digest
SHA256	`9e3a8ca06d12016ef3e5f16867337fb8b809a78191257bde3fe75ad5c23c70f1`
MD5	`1fd1bad6e36b902feda0aeaffa7f5b01`
BLAKE2b-256	`4f06ab42be1888aba7d347acd466c04e504f141fa2a3458dd437909121bd0273`

Hashes for removedup-1.0.6-pp38-pypy38_pp73-macosx_10_9_x86_64.whl

Hashes for removedup-1.0.6-pp38-pypy38_pp73-macosx_10_9_x86_64.whl
Algorithm	Hash digest
SHA256	`8d8f180c92b1e27eeb56bfd0c0a8579aee0953795c819508b35d952cadf7ab88`
MD5	`14a9d7ebb4055ade64c10c94f0a113d7`
BLAKE2b-256	`791d435f344fbeefc8a828c01c14f004aeea69df852bd4196458a06825662921`

Hashes for removedup-1.0.6-pp37-pypy37_pp73-win_amd64.whl

Hashes for removedup-1.0.6-pp37-pypy37_pp73-win_amd64.whl
Algorithm	Hash digest
SHA256	`7238ad7e18696370505d00bd4abd62c41cbdd722b44820cab1d0153f89234a19`
MD5	`210c5ce582c208fd56f1798522b9c4f5`
BLAKE2b-256	`41122a18d370336c010b3d940b2d7c8e1a88da7f56ce7d6fcbcc6acf09dc715c`

Hashes for removedup-1.0.6-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Hashes for removedup-1.0.6-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`d786c0342bb989ba9be86098d739cf7e5b28aae326642d85b372a7e693045a22`
MD5	`02c7cdff5312009fc46f1f64108c44de`
BLAKE2b-256	`6b847cfd3a06eecc9987c454a0186a94305ddb5df8f8b91e1692c51106887e2d`

Hashes for removedup-1.0.6-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whl

Hashes for removedup-1.0.6-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm	Hash digest
SHA256	`eac3e9eca8dd6bcbfd2e7a1376626bc6bf763e52bd57e8f7f656d657e50441d8`
MD5	`715b9dbebefa7848e94cbd9e74090400`
BLAKE2b-256	`fe318a9b66b96f0997c63e5bc87532e7122dda3a9b7fd1205a70ba405c822eee`

Hashes for removedup-1.0.6-pp37-pypy37_pp73-macosx_10_9_x86_64.whl

Hashes for removedup-1.0.6-pp37-pypy37_pp73-macosx_10_9_x86_64.whl
Algorithm	Hash digest
SHA256	`48838b8b019d5fc5f9a990bde06d0481204667ab6a4e097d5db36c906640c885`
MD5	`1935d60caba16ee5d011b9a5ec3cd426`
BLAKE2b-256	`4996d59e1e4497b9cc2cab2e71d09bdac7e599b46573a8ca098d7122c1a7d3a5`

Hashes for removedup-1.0.6-cp312-cp312-win_amd64.whl

Hashes for removedup-1.0.6-cp312-cp312-win_amd64.whl
Algorithm	Hash digest
SHA256	`cff54f055ba373d4f61e6eaf60d94285eba4e4fa9f8a498c9cb5f70389f7dd10`
MD5	`9d35e716aee51869484474dcac6b16ee`
BLAKE2b-256	`e6d61b8a81c48d8fbdc27c924574de20cddfbc8e2262a609ba2520dda5678f13`

Hashes for removedup-1.0.6-cp312-cp312-win32.whl

Hashes for removedup-1.0.6-cp312-cp312-win32.whl
Algorithm	Hash digest
SHA256	`50dba858e3c526e09738d25e56ccc7b5e7c25ad0cbd4447d320ce6e3a5b671cf`
MD5	`21a7e5bfd711b5c606475fd75abb1665`
BLAKE2b-256	`95f1f399f9d2ed8b10fb8a896a4e1a67a34c61c65d36870b9cd1af69e9950447`

Hashes for removedup-1.0.6-cp312-cp312-musllinux_1_1_x86_64.whl

Hashes for removedup-1.0.6-cp312-cp312-musllinux_1_1_x86_64.whl
Algorithm	Hash digest
SHA256	`cc931d07084f1ccaea0e8c94e28a5a6920428de6c99a64ff2e8b72b2a21e12ca`
MD5	`7f3132721722e576cd0e1de921660c12`
BLAKE2b-256	`1660a554d7223afeeb426cbe1e59627e0c091fbe42ed4c77ddc3722f4089a371`

Hashes for removedup-1.0.6-cp312-cp312-musllinux_1_1_i686.whl

Hashes for removedup-1.0.6-cp312-cp312-musllinux_1_1_i686.whl
Algorithm	Hash digest
SHA256	`9b71a236b45ada43d10789ec40d5fb863cc38ef31e78091e142e95d357b18265`
MD5	`995a74f2bd8044270e9805b73f4c1d54`
BLAKE2b-256	`7c191925805276b30fdb423d03592bd2dcdcd33128c069b993f4483dd018aea8`

Hashes for removedup-1.0.6-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Hashes for removedup-1.0.6-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`1063580b987abf0ef5d761f8eb13ceeae4c6c45505a0c7b96abe7627277cafe4`
MD5	`02a093724fe35df15cd417b9fdcd67a6`
BLAKE2b-256	`fbbb0e28b26e912dbd8ff4236613b25d7bc7710dc1dc530d8b7cf30e637fd353`

Hashes for removedup-1.0.6-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl

Hashes for removedup-1.0.6-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm	Hash digest
SHA256	`949a56edf7e6909961a8b20e93fcdc3c62b0cd339e1e3b7cddf87a098da021e7`
MD5	`c220d7d71dc1b60643a49267c225c495`
BLAKE2b-256	`119db3d5630493f0bde16307b502e8c3405b78dc8f28bff0a1a270dfdd400d6e`

Hashes for removedup-1.0.6-cp312-cp312-macosx_10_9_x86_64.whl

Hashes for removedup-1.0.6-cp312-cp312-macosx_10_9_x86_64.whl
Algorithm	Hash digest
SHA256	`d18e4dca82326fcf65468858e4d157bf87f14919a43a1f26cbfa76ccd561c91b`
MD5	`4a9d33c1c45ad359cbd4b4b9e32abd74`
BLAKE2b-256	`794bec79d4342b214e0c2ccd40347af57cc574b35213d31ee04d269babe1fd01`

Hashes for removedup-1.0.6-cp311-cp311-win_amd64.whl

Hashes for removedup-1.0.6-cp311-cp311-win_amd64.whl
Algorithm	Hash digest
SHA256	`944c9b34ffa516463b8f006e879d959b1c2c9ba7430bea9835f992d5331d3fea`
MD5	`050748df07fcb9ab21d2ea625d6112f4`
BLAKE2b-256	`3b89fc575044102d5bc40a6590a7f12e0645bea91feb5fcbca5efed70109c9a4`

Hashes for removedup-1.0.6-cp311-cp311-win32.whl

Hashes for removedup-1.0.6-cp311-cp311-win32.whl
Algorithm	Hash digest
SHA256	`1ff93fad50dcfdc4154acb3d71b2bcf5a35b9f67b0d70b6e975be1e84949d48e`
MD5	`dd509c6c80d0f34ead16ec1d7cc8c3e8`
BLAKE2b-256	`1ec6f7bc1bc97fec255cab6f0706f753b3dacf5907a69c55b97adf6670f5a5e8`

Hashes for removedup-1.0.6-cp311-cp311-musllinux_1_1_x86_64.whl

Hashes for removedup-1.0.6-cp311-cp311-musllinux_1_1_x86_64.whl
Algorithm	Hash digest
SHA256	`f785ab868be940be9773cae77722b38416629ecb40d2d3948dde4253b5d6122b`
MD5	`1de8938d3e862a211bfb36a1d8777dcd`
BLAKE2b-256	`1b5731541d363ff24ca9a75cd7800f919f97aeaadd948c834874919a94c1a953`

Hashes for removedup-1.0.6-cp311-cp311-musllinux_1_1_i686.whl

Hashes for removedup-1.0.6-cp311-cp311-musllinux_1_1_i686.whl
Algorithm	Hash digest
SHA256	`dc8660453c9308b040bb7281362c37c249ccdc14c0c5a36297eea502cf76d091`
MD5	`1138a55a1f8b56f5cd56f2db9d8e9a9a`
BLAKE2b-256	`43bb8f7475eaf026fed9471b57061653c780270d8808b7dc2698e9e8e98a451b`

Hashes for removedup-1.0.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Hashes for removedup-1.0.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`e6baf05ef6e09c9300cf692bfc5f8968c902f94e710f61fbc139736cab757053`
MD5	`34fe5a580650d4bdbaee340a627ba039`
BLAKE2b-256	`4268d1aa15c4b52d52528037e4e2f781c5dec300eadb212e6dba3249d32d49ca`

Hashes for removedup-1.0.6-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl

Hashes for removedup-1.0.6-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm	Hash digest
SHA256	`34f9df34d6521c4e072c7bd40bc1e8ac352cb3c8c98947a60734945ccac99d1f`
MD5	`b4ebf1dd6dadc5e54c412405ab8cac81`
BLAKE2b-256	`dd4a201a08c5ff8d408c5549bc048cc7b456eeb647a38962eaf6aa3ce41cf4d9`

Hashes for removedup-1.0.6-cp311-cp311-macosx_10_9_x86_64.whl

Hashes for removedup-1.0.6-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm	Hash digest
SHA256	`27f25fce8c680a503fed920cea6a752c13a7b2daa697e3333bc7becf7f22d6fb`
MD5	`bbb7c7ee36efa5fef31c56dcd17ddb4a`
BLAKE2b-256	`21b4f830df86b5f8ccca036481b68b1508cd8c70dbadc2f2d26c2c85e2bafe4a`

Hashes for removedup-1.0.6-cp310-cp310-win_amd64.whl

Hashes for removedup-1.0.6-cp310-cp310-win_amd64.whl
Algorithm	Hash digest
SHA256	`f927c5b242cc1168ca7f1004814797ef509649fa487a5b9d6c3ae19aa72bac2c`
MD5	`4ea7e7b53c644e8fc3a53d71107d68c8`
BLAKE2b-256	`d6ae471de4ce27e18f1737421c35e1a997ec5c921be62c75a4d864df61fc36c3`

Hashes for removedup-1.0.6-cp310-cp310-win32.whl

Hashes for removedup-1.0.6-cp310-cp310-win32.whl
Algorithm	Hash digest
SHA256	`959a3f5e7994169ffe9acac475be86cc9964f21574cb5d9954b9db8c4e585f5e`
MD5	`49e986107f84d62acf7a41cdd1afb7f8`
BLAKE2b-256	`3dcd577f0dfa2ff9e1fa02ac3abdf2c134ffa0e3aa45e05c03a1732a27b4833a`

Hashes for removedup-1.0.6-cp310-cp310-musllinux_1_1_x86_64.whl

Hashes for removedup-1.0.6-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm	Hash digest
SHA256	`8dab485a3d33dcfebfaf59f067fb39e717940d778cb90c76816910723dabae17`
MD5	`e56f714425798adc2fb5a3336de7b872`
BLAKE2b-256	`bdadb102634da2ac495c85ec2fe6901cd80ad670a80d7875e6a77d9068a2e6dc`

Hashes for removedup-1.0.6-cp310-cp310-musllinux_1_1_i686.whl

Hashes for removedup-1.0.6-cp310-cp310-musllinux_1_1_i686.whl
Algorithm	Hash digest
SHA256	`165d63a370f960636e270006733da5b2e56567e7b0bbd93469efce312569107b`
MD5	`3a09d61d6e414ae0f489574d37297550`
BLAKE2b-256	`18e3800088560660ea55c485760e04b139a376df354a202bff5bc876e993dc7d`

Hashes for removedup-1.0.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Hashes for removedup-1.0.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`2be68cd2742068a13c4e5770d4703908d5a14f09f5be6b84f48b18808269ce1e`
MD5	`b43a699c4a93ab21ef86d32a102f7ab8`
BLAKE2b-256	`8e112d1227b18041711ee4cc7c8c9e53bd1b7e7199c3cfb805ad77171d6c1b2d`

Hashes for removedup-1.0.6-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl

Hashes for removedup-1.0.6-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm	Hash digest
SHA256	`8300e548165e5348da528ea8ffce601edf6368d2b316cf2bbfcc65d1ce1592a0`
MD5	`b22f6a6809c7c23dcfeba0811810862b`
BLAKE2b-256	`d4f1671533982bc2dc62ca40dc6a93ad99285449a89cf5a1b883073bf4c4d565`

Hashes for removedup-1.0.6-cp310-cp310-macosx_10_9_x86_64.whl

Hashes for removedup-1.0.6-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm	Hash digest
SHA256	`313916660bfcfbf4f7d9a1670621f3934b73bea42727bdbf33e928f595188ec1`
MD5	`aa77e2764bd37d5fb3f4653ba5760530`
BLAKE2b-256	`9d93ae783616fed7df780d6f3e56a35367ccd1e65264e2ee31e70e351f2ce60d`

Hashes for removedup-1.0.6-cp39-cp39-win_amd64.whl

Hashes for removedup-1.0.6-cp39-cp39-win_amd64.whl
Algorithm	Hash digest
SHA256	`0ba06c557ec6fd9d6e6fc40496c40efd162368bae24335dd1bd346b9debc63ec`
MD5	`5edf002758ecd08cbc2adc3f293cc1c2`
BLAKE2b-256	`1e5bdfc0e87a110b3606a5464ed791f32c785a43036774f31364b8a08cb445a0`

Hashes for removedup-1.0.6-cp39-cp39-win32.whl

Hashes for removedup-1.0.6-cp39-cp39-win32.whl
Algorithm	Hash digest
SHA256	`4b996fede195444a005d9329e7d36cea55f4d23a8dc83ede44ed0e55f3f97041`
MD5	`569f824fb8b0f585b66f619d0e0b85e0`
BLAKE2b-256	`cf5bbd349b87ea3f41a3fccb950a65125375da790324322956a33aebf6abb105`

Hashes for removedup-1.0.6-cp39-cp39-musllinux_1_1_x86_64.whl

Hashes for removedup-1.0.6-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm	Hash digest
SHA256	`b49b0485648d77affc14d61eda330a72d968b674adc3e7cc0f50f310bb1fd084`
MD5	`b408c3c28bc3a67d3e181b204d3f336d`
BLAKE2b-256	`ff6922797dc9b365af4453c5e972cbbed992ca8578faf66bdb1450382b598a2f`

Hashes for removedup-1.0.6-cp39-cp39-musllinux_1_1_i686.whl

Hashes for removedup-1.0.6-cp39-cp39-musllinux_1_1_i686.whl
Algorithm	Hash digest
SHA256	`ebc193c70ace4d48d1646965a0b8abc087ea7f11583d29d85a18b8532410ec5d`
MD5	`5835e07c9685067fb4d28210299c89c9`
BLAKE2b-256	`befdee2334e01b25d2cd1aa1ef4ef36b58f1b2f64c8beae5cacfed15c648c7e2`

Hashes for removedup-1.0.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Hashes for removedup-1.0.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`be1110972ebd7a978501c6da96349b926e208fcda9cd365d5604f6ca309b4896`
MD5	`e6bd2758dbda06d522b4cef2bcc77fd3`
BLAKE2b-256	`6035aa437f22adbb6f00252b8efd1fb7b3ebc68a0bf34b411cc8303286e2db9a`

Hashes for removedup-1.0.6-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl

Hashes for removedup-1.0.6-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm	Hash digest
SHA256	`21398f83b22b2a98762cdf0d13d73f8b8176064c72d092a5d8dd07a09ce41a98`
MD5	`c356fafbb4ea02b626c8d74d7ca4a710`
BLAKE2b-256	`e1b02aaffd58b9cf7c408ef4d30cb33d129835e9a7ca86e36c898670d46853d0`

Hashes for removedup-1.0.6-cp39-cp39-macosx_10_9_x86_64.whl

Hashes for removedup-1.0.6-cp39-cp39-macosx_10_9_x86_64.whl
Algorithm	Hash digest
SHA256	`f003befe781c3ade2d8ce158c6c3f89938bdd0f9e2db5dea8696f990ab782fe1`
MD5	`7abf51d4f87ec0dcc756681f1b3c975a`
BLAKE2b-256	`bf5b588086ca5d64adf7f5db3728182567a2b4fbf43fa3b6e34e8edffdf2c478`

Hashes for removedup-1.0.6-cp38-cp38-win_amd64.whl

Hashes for removedup-1.0.6-cp38-cp38-win_amd64.whl
Algorithm	Hash digest
SHA256	`fe8461e15e9dbd0dda670852d184451a94a40562aea679b48b625d47ceb4f07b`
MD5	`faacaf441053bd71e63a031e130b2f93`
BLAKE2b-256	`5d57b73f496e9805546ead8605a01a939e8c1eec863faa3ff5358780f54d0e58`

Hashes for removedup-1.0.6-cp38-cp38-win32.whl

Hashes for removedup-1.0.6-cp38-cp38-win32.whl
Algorithm	Hash digest
SHA256	`7bf321f004484d4ceb028e81b09dfb70ea17d023b73d003a2f911451c0c9cb6d`
MD5	`65a8d58516f418c3ff4a17cac9200c03`
BLAKE2b-256	`36429d8245adc0b2476e2d82a720d2ed153c537d94986caafb086e5728446db3`

Hashes for removedup-1.0.6-cp38-cp38-musllinux_1_1_x86_64.whl

Hashes for removedup-1.0.6-cp38-cp38-musllinux_1_1_x86_64.whl
Algorithm	Hash digest
SHA256	`2428c25c31218e4e3df83c097bd0290a28125e7f2d3b9d58a1dc89a56a5f7781`
MD5	`fc0594ae3a8f39ded2ff8490ecbf9af3`
BLAKE2b-256	`8f6fa6e1e9443d136cb5b41081cbcbefc9af633d9ea66c65ec06fa4ca1c74ee2`

Hashes for removedup-1.0.6-cp38-cp38-musllinux_1_1_i686.whl

Hashes for removedup-1.0.6-cp38-cp38-musllinux_1_1_i686.whl
Algorithm	Hash digest
SHA256	`efe9e7ba7643e171a6a89e0e61e4aaec942cb1a8b60ed461e3ab459e9a6f917d`
MD5	`62945af3586d45a107bbc6104e4c8fa9`
BLAKE2b-256	`ebeae94b60f852779bb2d14224c3d80a7012f10913c3adc47287fb20c38b9d1d`

Hashes for removedup-1.0.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Hashes for removedup-1.0.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`20beb0bb3bf8d2b9cfb1fd2035220bb518d8316ebfa4754b99c1ac21482d5e28`
MD5	`59c3ac4b698c99e68c949945097c80a7`
BLAKE2b-256	`bb256e9a7892511a2e8442475b037508e4b4632b13be98071528ff5464201185`

Hashes for removedup-1.0.6-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl

Hashes for removedup-1.0.6-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm	Hash digest
SHA256	`a8fd7b88c0c1c09dc755e78e53b33288fb7d79ff2c4e3c2a849e9680004abcd2`
MD5	`b3180d512fd84dfa794726ade4819689`
BLAKE2b-256	`c341be97b749fb45d80536c1aef6e921648fbc7993205a6700ab86e60de4bcb6`

Hashes for removedup-1.0.6-cp38-cp38-macosx_10_9_x86_64.whl

Hashes for removedup-1.0.6-cp38-cp38-macosx_10_9_x86_64.whl
Algorithm	Hash digest
SHA256	`a46d2443ac40244ab351e518b658e729ae387770958219869560aa83b879a932`
MD5	`af6d8aed74fb40cce1c5f2a83c7581b9`
BLAKE2b-256	`ce8cdb5cc0a7c748d6bd898d6b42497dd65ebe282f2e86d9998c68b0ed82babc`

Hashes for removedup-1.0.6-cp37-cp37m-win_amd64.whl

Hashes for removedup-1.0.6-cp37-cp37m-win_amd64.whl
Algorithm	Hash digest
SHA256	`1d8e7ba64054833039c7fd4a7635de7140ec1b8617f06d064d6e74c2a29bb36c`
MD5	`571334581a12bc635ab8d13e81d2b359`
BLAKE2b-256	`41b5e66a5995dc76bafceeec2248abce7cc76d578a052baca153709dc3701a2d`

Hashes for removedup-1.0.6-cp37-cp37m-win32.whl

Hashes for removedup-1.0.6-cp37-cp37m-win32.whl
Algorithm	Hash digest
SHA256	`276ff73ec719819f1869a4585f00bd0b00397229fa0d7e0efc8eee1b8a9eb669`
MD5	`b2ef3e6f69957e55358dbf042189d3b0`
BLAKE2b-256	`abae209f10c5d2d4a9e4559c75fed280190ae12c8d9d30ca616fdaeb8a535c72`

Hashes for removedup-1.0.6-cp37-cp37m-musllinux_1_1_x86_64.whl

Hashes for removedup-1.0.6-cp37-cp37m-musllinux_1_1_x86_64.whl
Algorithm	Hash digest
SHA256	`ca1a2e652799799ec7e8451b3d38f8cc7d3c7a397a9af31e51f7532f85ed9c6f`
MD5	`4d7d945523cdef3c7590d90ad82d591a`
BLAKE2b-256	`fc09df08aaae9766ef871c67fc70d3b4695089416901939b1bcb620bc18cdac1`

Hashes for removedup-1.0.6-cp37-cp37m-musllinux_1_1_i686.whl

Hashes for removedup-1.0.6-cp37-cp37m-musllinux_1_1_i686.whl
Algorithm	Hash digest
SHA256	`790f3cfb304c945fd5a60263b98db2772c27b3ea3cfd5914e3ea38b9811c6b49`
MD5	`d7d1e05a11762e8cdaf2e167f908e045`
BLAKE2b-256	`39b84382f8dcfb1c44bb5b5aca1f91880818ced3dcf8d3692a3504ab8adde1c2`

Hashes for removedup-1.0.6-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Hashes for removedup-1.0.6-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`1ea12bda431a6dce24abd4173bcd4e72df783ca39db9a5bad3b69755fe69891b`
MD5	`802ed1066f394a1f3f6fb7d7c3af3703`
BLAKE2b-256	`4a745971930181341fb115c4aafdc00c2d0bdf0e6402635f21c3e3453480d1d9`

Hashes for removedup-1.0.6-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl

Hashes for removedup-1.0.6-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm	Hash digest
SHA256	`3b704055dbb6f0dd1074ecfae6da578f1aea7e86684f26af7cb81eb2115cebea`
MD5	`a978512e3ed37512db90f035fc041f01`
BLAKE2b-256	`cb855f0110da229d543188e58cb812cf17f5def84658da262106b0b1ffdcef81`

Hashes for removedup-1.0.6-cp37-cp37m-macosx_10_9_x86_64.whl

Hashes for removedup-1.0.6-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm	Hash digest
SHA256	`9de1414b3dd93dd3b7968eeabaf55b2a3cbf9e175ac3261dd81354bda639fa94`
MD5	`3c9fb17e175f3548a9a8f627efb06e21`
BLAKE2b-256	`40b213811c6a61aa19a1d380cd4bd8c99750469e09743421517bb64a0a2eec67`