folderstats 0.4.0

Creates statistics from a folder structure

folderstats

This is a python module and command-line interface that creates statistics from a folder structure. It returns a Pandas dataframe from the folders and files from a selected folder.

Installation

pip install folderstats

Usage

To get statistics of a folder structure as a Pandas dataframe in Python you can type:

import folderstats  
df = folderstats.folderstats(
    '.', hash_name='md5',
    exclude=["tests", "venv", "__pycache__"],
    ignore_hidden=True)
df

path	name	extension	size	atime	mtime	ctime	folder	num_files	depth	uid	md5
./folder_structure.png	folder_structure	png	525239	2022-01-10 16:08:32	2020-11-22 19:38:03	2020-11-22 19:38:03	False		0	1000	a3cac43de8dd5fc33d7bede1bb1849de
./requirements.txt	requirements	txt	14	2022-01-10 18:37:52	2022-01-08 17:29:52	2022-01-08 17:29:52	False		0	1000	d8e272adf08f0389ef08be879d851df8
./requirements-dev.txt	requirements-dev	txt	33	2022-01-10 14:14:50	2022-01-08 17:54:50	2022-01-08 17:54:50	False		0	1000	42c7e7d9bc4620c2c7a12e6bbf8120bb
./README.md	README	md	3909	2022-01-10 18:37:52	2022-01-10 18:37:34	2022-01-10 18:37:34	False		0	1000	4339e186a35d77689419e996ee3998dc
./folderstats/__main__.py	__main__	py	3313	2022-01-10 18:06:03	2022-01-10 18:05:58	2022-01-10 18:05:58	False		1	1000	62652872e08be115495aaf6e9f3a239a
./folderstats/__init__.py	__init__	py	4556	2022-01-10 18:05:12	2022-01-10 18:04:56	2022-01-10 18:04:56	False		1	1000	f0c8eb98713ddec7a4812a1471384296
./folderstats	folderstats		7869	2022-01-10 17:10:15	2022-01-10 17:10:15	2022-01-10 17:10:15	True	2.0	1	1000
./LICENSE	LICENSE		1073	2022-01-10 16:08:38	2020-11-22 19:38:03	2020-11-22 19:38:03	False		0	1000	1232cbd9eced47e27816f69740ad479d
./setup.py	setup	py	1925	2022-01-10 16:29:32	2020-11-22 19:38:03	2020-11-22 19:38:03	False		0	1000	01d39c60a0b41e6c928a6d3df6085d63
.	.		544158	2022-01-10 18:37:00	2022-01-10 18:37:00	2022-01-10 18:37:00	True	8.0	0	1000

You can use the same functionality as a command-line interface which can generate files (CSV or JSON) or print the statistics directly into the command line:

folderstats . -c md5 -i -o stats.csv

In order to see the other available arguments, type:

folderstats --help

usage: folderstats [-h] [-o OUTPUT_FILEPATH] [-c HASH_NAME] [-a] [-m] [-i]
                   [-p] [-e EXCLUDE] [-f FILTER_EXTENSION] [-l] [-v]
                   folderpath

Creates statistics from a folder structure

positional arguments:
  folderpath            input folder path

optional arguments:
  -h, --help            show this help message and exit
  -o OUTPUT_FILEPATH    output filepath, CSV and JSON supported
  -c HASH_NAME          hash function for checksum
  -a                    add absolute path column
  -m                    store timestamps with microseconds
  -i                    ignore hidden files and folders, Linux and Unix only
  -p                    Add index and parent index
  -e EXCLUDE, --exclude EXCLUDE
                        Exclude files and folders by name
  -f FILTER_EXTENSION, --filter-extension FILTER_EXTENSION
                        Filter files by extension
  -l, --follow-links    Follow symbolic and hard links
  -v                    verbose console output

Testing

Prepare dev environment with:

# Create virtual environement
python -m venv ./venv

# Install dependencies
pip install -r requirements-dev.txt
pip install -r requirements.txt

# Activate virtual environment
source venv/bin/activate

To run unit tests, type:

pytest -v

License

This project is licensed under the MIT license. See the LICENSE for details.