spider framework for winndoo.
Project description
##版本说明:
- 5.2.5: add ua list
- 5.2.6: add table create function
- 5.2.7: add ua list again
- 5.2.8: 添加获取百度cookie的方法
- 5.2.9: 修改百度cookie存储位置
- 5.2.10: add *.txt file
- 5.2.11: baidu cookie storage use sorted set
- 5.2.12: add baidu mb cookie
- 5.2.13: 修复本地中文乱码
- 5.2.14: downloader fail
- 5.2.15: downloader fail
- 5.2.16: pymysql版本写法问题
- 5.2.18: v1.0.0及以上请使用from pymysql.converters import escape_string
- 5.3.0: 使用私有网络 172.17.0.*
- 5.3.1: spider里可以打印当前ip
- 5.3.2: 登录是判断当前ip
- 5.3.3: 添加百度工具包:pc,mb请求头 + 获取真实url
- 5.3.5: 添加本地模式代理
新下载中心参数,参考 newDownloadReadme.md 文件
使用方法: config={"param": {"et":13,'cu',url}} request = SpiderRequest(headers=headers, urls=urls,config = config)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
download-center-5.4.6.tar.gz
(31.2 kB
view details)
Built Distribution
File details
Details for the file download-center-5.4.6.tar.gz
.
File metadata
- Download URL: download-center-5.4.6.tar.gz
- Upload date:
- Size: 31.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.0 CPython/3.8.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 333e2bb629df6e49ff6c3b92a1be6ec7ffe373b212d18a91bb35a4b8ae5fc916 |
|
MD5 | 09cd857a7b31230b71d4b5bf185ad79d |
|
BLAKE2b-256 | 656826c1678b6c174f2437d9cc7f18dde24dca2809c497266c4dae5e55b3f249 |
File details
Details for the file download_center-5.4.6-py2.py3-none-any.whl
.
File metadata
- Download URL: download_center-5.4.6-py2.py3-none-any.whl
- Upload date:
- Size: 51.3 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.0 CPython/3.8.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | fa930812cf38972c23b0b9e6d954c9891b1d476273b51832dfa6188718bf5447 |
|
MD5 | 8eba9dfb3bd24ea79c6fa07b34ed577f |
|
BLAKE2b-256 | 2ac9a9eebb17d3a15dd1aea2229f16598e3a344a349847f7919e0e92d8bee9a6 |