Asynchronous batch directory crawler & downloader
Project description
Batch Download 网页批量文件下载工具
异步批量目录爬虫,支持断点续传、深度限制、扩展名过滤等功能。 开源地址:https://github.com/PIKACHUIM/BatchDownload
Install 安装方法
pip install aiohttp aiofiles playwright tqdm
首次使用前需安装浏览器依赖:
playwright install chromium
Usage 使用示例
import asyncio
from batchdownload import BatchDownload
async def main():
crawler = BatchDownload(
url="https://example.com/files",
depth=2,
store_dir="downloads",
ext={".zip", ".pdf"}
)
links = await crawler.fetch()
await crawler.download(max_workers=5)
if __name__ == "__main__":
asyncio.run(main())
GUI App 图形化客户端下载
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
batchdownload-0.1.2.tar.gz
(17.5 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file batchdownload-0.1.2.tar.gz.
File metadata
- Download URL: batchdownload-0.1.2.tar.gz
- Upload date:
- Size: 17.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7d61ba3ad83fde59488a79cbdf3c6a530717c10ce1292de4f0db99c8dc4b525a
|
|
| MD5 |
6f308d36b82c58989a8c82eca73acc43
|
|
| BLAKE2b-256 |
12790f4ded2f2a80ea9b4fea53abffc32507b32fd96b59f2f11c6f11874fc90d
|
File details
Details for the file batchdownload-0.1.2-py3-none-any.whl.
File metadata
- Download URL: batchdownload-0.1.2-py3-none-any.whl
- Upload date:
- Size: 17.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d4de5bc919f2f5dd5cd508b459f020cfdcd64e605884e9dc6daecf36e1371d2e
|
|
| MD5 |
0520eff809b2c1e0672d8de35d4036b7
|
|
| BLAKE2b-256 |
3b64ea1381c19c3529371d53835e994a9cb68a97af7866b842e054f13c5899ed
|