Skip to main content

A python package that crawls a directory recursively and returns the file names and file stats as well as execute a custom function passed as an argument.

This project has been archived.

The maintainers of this project have marked this project as archived. No new releases are expected.

Project description

🚀 CrawlerByte

Crawler Byte is a Python package for recursively crawling directories, collecting file stats, and executing custom actions on each file.
It’s perfect for building file search tools, batch processors, or custom directory explorers.


📦 Installation

$ pip install crawlerbyte

Usage

crawl() takes three arguments => path (str), max_depth (int), function (callable)

from crawlerbyte.crawler import crawl
import os

# Set your target directory
base_dir = os.path.join(os.path.dirname(os.path.abspath(__file__)), 'data')

def main():
    # Crawl the directory and run a custom action on each file
    result = crawl(base_dir, max_depth=1000, action=lambda f: f)
    print("Crawled Data:", result)

if __name__ == "__main__":
    main()

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crawler_byte-0.0.2.tar.gz (4.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

crawler_byte-0.0.2-py3-none-any.whl (3.8 kB view details)

Uploaded Python 3

File details

Details for the file crawler_byte-0.0.2.tar.gz.

File metadata

  • Download URL: crawler_byte-0.0.2.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for crawler_byte-0.0.2.tar.gz
Algorithm Hash digest
SHA256 99176088c2145c5737cd00547c3837500d381afd2c2a0d0e7b175d6ee7ea3882
MD5 683afceff8e42949bd3737dcec6c60d8
BLAKE2b-256 ede7af4510b9c6f1df85d5bac4747d0503f30b111faab50d7deae12d414c8c05

See more details on using hashes here.

File details

Details for the file crawler_byte-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: crawler_byte-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 3.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for crawler_byte-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 09f4c251e01ba90c639507df3c9c4afc51d69a07a7cb89ce87aa5e8e769681e4
MD5 99d0fae93dc233f78f3624c9cb900318
BLAKE2b-256 9fdb17c9a1f8790190387da5623bbaa2780fda38bb4f497a4f53be70a095b2cd

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page