Skip to main content

A python package that crawls a directory recursively and returns the file names and file stats as well as execute a custom function passed as a parameter.

Project description

🚀 CrawlerUgo

Crawler Ugo is a Python package for recursively crawling directories, collecting file stats, and executing custom actions on each file.
It’s perfect for building file search tools, batch processors, or custom directory explorers.


📦 Installation

$ pip install crawlerugo

Usage

crawl() takes three arguments => path (str), function (callable), max_depth (int|None) = None

from crawlerugo.crawler import crawl
import os

# Set your target directory
base_dir = os.path.join(os.path.dirname(os.path.abspath(__file__)), 'data')

def main():
    # Crawl the directory and run a custom action on each file
    result = crawl(base_dir, lambda f: f, 1000)  # max_depth is optional but if present indicates the debth count to crawl
    print("Crawled Data:", result)

if __name__ == "__main__":
    main()

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crawlerugo-0.0.4.tar.gz (4.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

crawlerugo-0.0.4-py3-none-any.whl (3.8 kB view details)

Uploaded Python 3

File details

Details for the file crawlerugo-0.0.4.tar.gz.

File metadata

  • Download URL: crawlerugo-0.0.4.tar.gz
  • Upload date:
  • Size: 4.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for crawlerugo-0.0.4.tar.gz
Algorithm Hash digest
SHA256 678fcb045bf479af2ee3834ad13000ee0043804476b66e435feed1dd0e76985c
MD5 3973fae25f8e2130291418c41f000269
BLAKE2b-256 32a659e31372b30a48d2aa677f07140681eac33cd7673c69acfd041bd3049b3c

See more details on using hashes here.

File details

Details for the file crawlerugo-0.0.4-py3-none-any.whl.

File metadata

  • Download URL: crawlerugo-0.0.4-py3-none-any.whl
  • Upload date:
  • Size: 3.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for crawlerugo-0.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 0ff8f6faf99a7fa6911bb28d4ca9cba7007d4b5cd8398e0e651f5528cc6da5d7
MD5 85b0459eafc9c9724304f1002a9112a0
BLAKE2b-256 592bdf86a7bca6a4b079e23a5b773a16b1536d6a90ee087f0c5b1a648e39ddba

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page