Skip to main content

Asynchronous batch directory crawler & downloader

Project description

Batch Download 网页批量文件下载工具

异步批量目录爬虫,支持断点续传、深度限制、扩展名过滤等功能。 开源地址:https://github.com/PIKACHUIM/BatchDownload

Install 安装方法

pip install aiohttp aiofiles playwright tqdm

首次使用前需安装浏览器依赖:

playwright install chromium

Usage 使用示例

import asyncio
from batchdownload import BatchDownload

async def main():
    crawler = BatchDownload(
        url="https://example.com/files",
        depth=2,
        store_dir="downloads",
        ext={".zip", ".pdf"}
    )
    links = await crawler.fetch()
    await crawler.download(max_workers=5)

if __name__ == "__main__":
    asyncio.run(main())

GUI App 图形化客户端下载

https://github.com/PIKACHUIM/BatchDownload/releases

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

batchdownload-0.1.1.tar.gz (17.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

batchdownload-0.1.1-py3-none-any.whl (17.9 kB view details)

Uploaded Python 3

File details

Details for the file batchdownload-0.1.1.tar.gz.

File metadata

  • Download URL: batchdownload-0.1.1.tar.gz
  • Upload date:
  • Size: 17.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.2

File hashes

Hashes for batchdownload-0.1.1.tar.gz
Algorithm Hash digest
SHA256 edd38ac7a461bcb1ec297b6cd578e93f862ef6a8bcef5fb6580f752595462760
MD5 33144e1425cabe2d2bfe18751a2a3835
BLAKE2b-256 446d9dc36df394325dc51b0231d47550ee60f7d57e235d9c048bbc564431e7ea

See more details on using hashes here.

File details

Details for the file batchdownload-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: batchdownload-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 17.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.2

File hashes

Hashes for batchdownload-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 52f7cae7d523fb4d312b92b98ff67168fd7dec8ebedd13b4d6951212e5955ade
MD5 f17275e6f2084251c97b77e9765ce4e5
BLAKE2b-256 ce4c322e9d0f3f4a2da1a8fe723a638f87a6fe59e7e1d6f5b9367c01f8227b1c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page