Skip to main content

spider framework for winndoo.

Project description

##版本说明:

  • 5.2.5: add ua list
  • 5.2.6: add table create function
  • 5.2.7: add ua list again
  • 5.2.8: 添加获取百度cookie的方法
  • 5.2.9: 修改百度cookie存储位置
  • 5.2.10: add *.txt file
  • 5.2.11: baidu cookie storage use sorted set
  • 5.2.12: add baidu mb cookie
  • 5.2.13: 修复本地中文乱码
  • 5.2.14: downloader fail
  • 5.2.15: downloader fail
  • 5.2.16: pymysql版本写法问题
  • 5.2.18: v1.0.0及以上请使用from pymysql.converters import escape_string
  • 5.3.0: 使用私有网络 172.17.0.*
  • 5.3.1: spider里可以打印当前ip

新下载中心参数,参考 newDownloadReadme.md 文件

使用方法: config={"param": {"et":13,'cu',url}} request = SpiderRequest(headers=headers, urls=urls,config = config)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wd_download_center-5.3.1.tar.gz (38.7 kB view details)

Uploaded Source

Built Distribution

wd_download_center-5.3.1-py2.py3-none-any.whl (70.5 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file wd_download_center-5.3.1.tar.gz.

File metadata

  • Download URL: wd_download_center-5.3.1.tar.gz
  • Upload date:
  • Size: 38.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/58.0.4 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.6

File hashes

Hashes for wd_download_center-5.3.1.tar.gz
Algorithm Hash digest
SHA256 2f9d7244a3e172d92af268f9c51ca50c0cb4b608cbf435264d0d29f1d6e114e9
MD5 d12fe8ce9667e162269c6c61bbe7c74b
BLAKE2b-256 dfc17a89a19f175d41f612295203a04b71ca0d877139555c647abe45353705c8

See more details on using hashes here.

File details

Details for the file wd_download_center-5.3.1-py2.py3-none-any.whl.

File metadata

  • Download URL: wd_download_center-5.3.1-py2.py3-none-any.whl
  • Upload date:
  • Size: 70.5 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.1 setuptools/58.0.4 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.6

File hashes

Hashes for wd_download_center-5.3.1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 598db1aecbac93b404e43e882d97abed35aca3e5a60c88f5dd3ab33ddfe8a499
MD5 22f5cfd84cbc3f4e4ff94e03c22c5458
BLAKE2b-256 afa634fd9fb29a4f3cd40cf524221a7c40dcc3ce4eadfbf31242a0f16d80556b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page