Skip to main content

Asynchronous batch directory crawler & downloader

Project description

Batch Download 网页批量文件下载工具

异步批量目录爬虫,支持断点续传、深度限制、扩展名过滤等功能。 开源地址:https://github.com/PIKACHUIM/BatchDownload

Install 安装方法

pip install aiohttp aiofiles playwright tqdm

首次使用前需安装浏览器依赖:

playwright install chromium

Usage 使用示例

import asyncio
from batchdownload import BatchDownload

async def main():
    crawler = BatchDownload(
        url="https://example.com/files",
        depth=2,
        store_dir="downloads",
        ext={".zip", ".pdf"}
    )
    links = await crawler.fetch()
    await crawler.download(max_workers=5)

if __name__ == "__main__":
    asyncio.run(main())

GUI App 图形化客户端下载

https://github.com/PIKACHUIM/BatchDownload/releases

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

batchdownload-0.1.2.tar.gz (17.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

batchdownload-0.1.2-py3-none-any.whl (17.9 kB view details)

Uploaded Python 3

File details

Details for the file batchdownload-0.1.2.tar.gz.

File metadata

  • Download URL: batchdownload-0.1.2.tar.gz
  • Upload date:
  • Size: 17.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.2

File hashes

Hashes for batchdownload-0.1.2.tar.gz
Algorithm Hash digest
SHA256 7d61ba3ad83fde59488a79cbdf3c6a530717c10ce1292de4f0db99c8dc4b525a
MD5 6f308d36b82c58989a8c82eca73acc43
BLAKE2b-256 12790f4ded2f2a80ea9b4fea53abffc32507b32fd96b59f2f11c6f11874fc90d

See more details on using hashes here.

File details

Details for the file batchdownload-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: batchdownload-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 17.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.2

File hashes

Hashes for batchdownload-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 d4de5bc919f2f5dd5cd508b459f020cfdcd64e605884e9dc6daecf36e1371d2e
MD5 0520eff809b2c1e0672d8de35d4036b7
BLAKE2b-256 3b64ea1381c19c3529371d53835e994a9cb68a97af7866b842e054f13c5899ed

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page