贴吧一体化工具箱 (tieba-toolkit)
本项目将高效的贴吧异步爬虫 (craw3.4.8.py) 和 Apple 风格的 HTML 查看器生成工具 (conv_v2.1.py) 封装成了一个易于安装和使用的 Python 库及命令行工具。
🚀 1. 核心功能与特性
| 模块 | 功能描述 |
|---|---|
| 异步爬虫 | 基于 aiotieba,实现高并发、异步的帖子内容和图片爬取。 |
| 断点续爬 | 自动记录 checkpoint,支持中断后恢复爬取,无需担心进度丢失。 |
| 图片下载 | 多工作线程异步下载帖子中所有图片资源,支持重试机制。 |
| HTML 转换 | 将爬取的原始 JSON 数据转换为单文件、美观的 Apple 风格 HTML 查看器,支持异步加载和分页浏览,便于本地离线预览。 |
| CLI 命令行 | 提供 tieba-cli 命令,统一管理爬取、转换和列表查看功能。 |
⚙️ 2. 安装与环境要求
2.1 环境要求
- Python 3.8+
- 贴吧登录凭证:BDUSS(必须通过环境变量设置)
2.2 安装
使用 pip 即可从 PyPI 安装 tieba-toolkit(假设您已完成发布):
pip install tieba-toolkit
Metadata
Release files for keaixiaojiycw-tieba-post-crawler 0.7.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| keaixiaojiycw_tieba_post_crawler-0.7.1.tar.gz | 17.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| keaixiaojiycw_tieba_post_crawler-0.7.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 51.4 kB
Release files / keaixiaojiycw_tieba_post_crawler-0.7.1.tar.gz
| Download URL | keaixiaojiycw_tieba_post_crawler-0.7.1.tar.gz |
|---|---|
| Size | 17.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
ebbb743346a9e2b06b2569778ae7fc42208178e85cae3d0b45e265a402dedd5b
|
|
BLAKE2b-256 checksum How to use checksums |
6887bd771e18a3ca44ebd400c8768e2152c1d14b11d507a7929aa25ec5393e8c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.13.0
|
Release files / keaixiaojiycw_tieba_post_crawler-0.7.1-py3-none-any.whl
| Download URL | keaixiaojiycw_tieba_post_crawler-0.7.1-py3-none-any.whl |
|---|---|
| Size | 34.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
910f0666dc71c37fb1c7b26aedd4e6be4f827050e8e4599a6d95392b7577961a
|
|
BLAKE2b-256 checksum How to use checksums |
8587ba374979c8c3818976f9e233b4cdec3bc78f2ca490c70ef42504ea66fa3b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.13.0
|