Skip to main content

A python package that crawls a directory recursively and returns the file names and file stats as well as execute a custom function passed as an argument.

This project has been archived.

The maintainers of this project have marked this project as archived. No new releases are expected.

Project description

🚀 Crawler Byte

Crawler Byte is a Python package for recursively crawling directories, collecting file stats, and executing custom actions on each file.
It’s perfect for building file search tools, batch processors, or custom directory explorers.


📦 Installation

$ pip install crawler_byte

Usage

crawl() takes three arguments => path (str), max_depth (int), function (callable)

from crawler_byte.crawler import crawl
import os

# Set your target directory
base_dir = os.path.join(os.path.dirname(os.path.abspath(__file__)), 'data')

def main():
    # Crawl the directory and run a custom action on each file
    result = crawl(base_dir, max_depth=1000, action=lambda f: f)
    print("Crawled Data:", result)

if __name__ == "__main__":
    main()

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crawler_byte-0.0.1.tar.gz (4.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

crawler_byte-0.0.1-py3-none-any.whl (3.8 kB view details)

Uploaded Python 3

File details

Details for the file crawler_byte-0.0.1.tar.gz.

File metadata

  • Download URL: crawler_byte-0.0.1.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for crawler_byte-0.0.1.tar.gz
Algorithm Hash digest
SHA256 500ae07960ecd716d998c77a344a90df119ed2e17c8f62bda37535395f91546c
MD5 739870565e9b185d6bf24a6986a051ed
BLAKE2b-256 5623bcd2eb393425b54fdacf1030c30e5adec1891a750b980932cb46b0aee2a1

See more details on using hashes here.

File details

Details for the file crawler_byte-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: crawler_byte-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 3.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for crawler_byte-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 a2ad44b307a128771eed3f4ae9f8d3688b5bb271ae44547ba70711fa9be095fd
MD5 edcf67d60b786c3937f197aab4408095
BLAKE2b-256 e25dd60178234bbb672eb88373571a7fc0bacb9db856f646c6a18e6630c551bd

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page