Skip to main content

DESCRIPTION

The script finds all duplicate files in a list of files and folders.

You give it a list of files and folders, it takes all files in those folders and compares them to one another to find which ones are the same. It doesn't care about file names, directory structure or the location of the files in that structure. It cares only about bytes - whether or not two files or more are identical in their bytes.

How to use

It works like this:

import fdups
f = fdups.fdups()
f.set(["", "", ...])
f.fdups()

You set a list of files and folders and call fdups().
The list can contain any mixture of files and folders.
If you set a new list of folders it clears the previous result.

Example

>>> import fdups
>>> f = fdups.fdups()
>>> f.set(["C:\\Python27\\Scripts", "C:\\Python27\\Lib\\site-packages\\setuptools"])
>>> f.fdups()
Collecting files
Sorting
Comparing
. . . . . . 
Info:
Total number of files compared:  162
Non duplicate files:  151
Duplicate groups:  4
Total wasted space:  518.0 kB   ( 530465 )

Do you want to see the duplicate groups?
(y for Yes, anything else for No)
y

C:\Python27\Scripts\futurize.exe
C:\Python27\Scripts\pasteurize.exe
C:\Python27\Lib\site-packages\setuptools\cli-32.exe
C:\Python27\Lib\site-packages\setuptools\cli.exe

C:\Python27\Lib\site-packages\setuptools\gui-32.exe
C:\Python27\Lib\site-packages\setuptools\gui.exe

C:\Python27\Scripts\pip.exe
C:\Python27\Scripts\pip2.7.exe
C:\Python27\Scripts\pip2.exe

C:\Python27\Scripts\easy_install-2.7.exe
C:\Python27\Scripts\easy_install.exe

Do you want to see the NON duplicate files? (151 files)
(y for Yes, anything else for No)

Metadata

Release files for fdups 0.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for fdups 0.0.2
File Size Uploaded
fdups-0.0.2.tar.gz 3.4 kB Details

Release files / fdups-0.0.2.tar.gz

Download URL fdups-0.0.2.tar.gz
Size 3.4 kB
Tags Source
SHA-256 checksum
How to use checksums
511b28282ac74dbe6ed86fd688dfba504994efb36ca2523af6d15ba0ce72b492
BLAKE2b-256 checksum
How to use checksums
a4706916d09c812c2fd836fdbac6abce8986a9e532ecea32c7724f76e6ba7371
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.15.0 pkginfo/1.7.1 requests/2.26.0 setuptools/44.1.1 requests-toolbelt/0.9.1 tqdm/4.62.1 CPython/2.7.14

Release history Release notifications | RSS feed

This release

0.0.2 This release

1 release file

0.0.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page