Asynchronous batch directory crawler & downloader
Project description
Batch Download 网页批量文件下载工具
异步批量目录爬虫,支持断点续传、深度限制、扩展名过滤等功能。 开源地址:https://github.com/PIKACHUIM/BatchDownload
Install 安装方法
pip install aiohttp aiofiles playwright tqdm
首次使用前需安装浏览器依赖:
playwright install chromium
Usage 使用示例
import asyncio
from batchdownload import BatchDownload
async def main():
crawler = BatchDownload(
url="https://example.com/files",
depth=2,
store_dir="downloads",
ext={".zip", ".pdf"}
)
links = await crawler.fetch()
await crawler.download(max_workers=5)
if __name__ == "__main__":
asyncio.run(main())
GUI App 图形化客户端下载
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
batchdownload-0.1.1.tar.gz
(17.5 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file batchdownload-0.1.1.tar.gz.
File metadata
- Download URL: batchdownload-0.1.1.tar.gz
- Upload date:
- Size: 17.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
edd38ac7a461bcb1ec297b6cd578e93f862ef6a8bcef5fb6580f752595462760
|
|
| MD5 |
33144e1425cabe2d2bfe18751a2a3835
|
|
| BLAKE2b-256 |
446d9dc36df394325dc51b0231d47550ee60f7d57e235d9c048bbc564431e7ea
|
File details
Details for the file batchdownload-0.1.1-py3-none-any.whl.
File metadata
- Download URL: batchdownload-0.1.1-py3-none-any.whl
- Upload date:
- Size: 17.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
52f7cae7d523fb4d312b92b98ff67168fd7dec8ebedd13b4d6951212e5955ade
|
|
| MD5 |
f17275e6f2084251c97b77e9765ce4e5
|
|
| BLAKE2b-256 |
ce4c322e9d0f3f4a2da1a8fe723a638f87a6fe59e7e1d6f5b9367c01f8227b1c
|