spider framework for winndoo.
Project description
##版本说明:
- 5.2.5: add ua list
- 5.2.6: add table create function
- 5.2.7: add ua list again
- 5.2.8: 添加获取百度cookie的方法
- 5.2.9: 修改百度cookie存储位置
- 5.2.10: add *.txt file
- 5.2.11: baidu cookie storage use sorted set
- 5.2.12: add baidu mb cookie
- 5.2.13: 修复本地中文乱码
- 5.2.14: downloader fail
- 5.2.15: downloader fail
- 5.2.16: pymysql版本写法问题
- 5.2.18: v1.0.0及以上请使用from pymysql.converters import escape_string
- 5.3.0: 使用私有网络 172.17.0.*
- 5.3.1: spider里可以打印当前ip
新下载中心参数,参考 newDownloadReadme.md 文件
使用方法: config={"param": {"et":13,'cu',url}} request = SpiderRequest(headers=headers, urls=urls,config = config)
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
wd_download_center-5.3.1.tar.gz
(38.7 kB
view details)
Built Distribution
File details
Details for the file wd_download_center-5.3.1.tar.gz
.
File metadata
- Download URL: wd_download_center-5.3.1.tar.gz
- Upload date:
- Size: 38.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/58.0.4 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2f9d7244a3e172d92af268f9c51ca50c0cb4b608cbf435264d0d29f1d6e114e9 |
|
MD5 | d12fe8ce9667e162269c6c61bbe7c74b |
|
BLAKE2b-256 | dfc17a89a19f175d41f612295203a04b71ca0d877139555c647abe45353705c8 |
File details
Details for the file wd_download_center-5.3.1-py2.py3-none-any.whl
.
File metadata
- Download URL: wd_download_center-5.3.1-py2.py3-none-any.whl
- Upload date:
- Size: 70.5 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/58.0.4 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 598db1aecbac93b404e43e882d97abed35aca3e5a60c88f5dd3ab33ddfe8a499 |
|
MD5 | 22f5cfd84cbc3f4e4ff94e03c22c5458 |
|
BLAKE2b-256 | afa634fd9fb29a4f3cd40cf524221a7c40dcc3ce4eadfbf31242a0f16d80556b |