免费的中国代理,网站列表
[1]: lab.crossincode.com [2]: 89ip [3]: www.ip3366.net [4]: ip.jiangxianli.com [5]: www.kuaidaili.com [6]: www.xsdaili.com [7]: www.xicidaili.com [8]: www.superfastip.com [9]: www.freeip.top
安装
pip install freeproxy_cn
使用
循环抓取代理
>>> from freeproxy_cn import Engin
>>> import asyncio
>>> loop = asyncio.get_event_loop()
>>> loop.run_until_complete(Engin().run())
获取代理
>>> from redis import Redis >>> rds = Redis() >>> rds.spop('http://icanhazip.com') 192.168.1.1
参数说明
| Engin参数 | 含义 | | ————– |
| | redis_host | 存储代理的redis的host | | redis_port | 存储代理的redis的port | | redis_password | 存储代理的redis的password | | redis_db | 存储代理的redis使用哪个db,默认为0 | | valid_thread | 用于验证代理有效性的线程数目,默认为4,想加快验证的可以适当增大该参数 | | valid_per_time | 每批验证多少个代理地址,默认20个,可以适当增大该参数加快验证 | | valid_url | 默认为一个返回请求IP网站,这个网站没有区分http和https,实际中需要换成自己要抓取的目标网站来验证代理 | | valid_timeout | 验证超时时间设定,默认为5秒 | ### 改进
可以使用一个web服务器代替redis进行代理提供,暂时还没有写
更新日期
2019-12-23
Home-page: https://github.com/Hexmagic/freeproxy_cn.git Author: Hexmagic Author-email: 191440042@qq.com License: GNU General Public License v3.0 Description: UNKNOWN Platform: UNKNOWN Classifier: Programming Language :: Python :: 3.6 Classifier: Operating System :: OS Independent
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file freeproxy_cn-1.8.tar.gz.
File metadata
- Download URL: freeproxy_cn-1.8.tar.gz
- Upload date:
- Size: 10.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.7.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
25c904d10fea9f00df959c59de8e82f2be45c103f0defa899d45696e38334f78
|
|
| MD5 |
c80b79f525830b88f586edd77e1fbd49
|
|
| BLAKE2b-256 |
115a63c89d3b8deb1519ee2327497c6a44c138544299e1ae9e8de46c8dbd6bad
|