proxy_pool_redis 使用redis作为后端存储的ip代理池
能够根据对应付费ip的请求Url加载对应的Proxy ip到池中,并能够提供多个应用使用,对应每个应用需要传入特定的应用名字做标示,可对特定的应用使用的Ip报告被ban,质量差的ip
使用方法
from proxy_pool_redis import XunProxyPool
pool = XunProxyPool(api_url='xxx',name='crawl_name',redis_host='xx',redis_port=xx,redis_password='xx',report_num=10)
pool.start()
# 获取一个ip
ip = pool.get_ip()
# 报告ip已经被当前应用ban了
pool.report_ban_ip(ip)
# 报告当前ip的质量不好
# 如果报告的次数达到了report_num的值,则将该ip ban掉
pool.report_bad_ip(ip)
Metadata
Release files for proxy-pool-redis 0.0.15
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| proxy_pool_redis-0.0.15.tar.gz | 8.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| proxy_pool_redis-0.0.15-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 19.2 kB
Release files / proxy_pool_redis-0.0.15.tar.gz
| Download URL | proxy_pool_redis-0.0.15.tar.gz |
|---|---|
| Size | 8.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
ca9b0dee5edd3fa5b32d3cd3bab84e2527fa0bf3d2d3b152458cc4cf23191728
|
|
BLAKE2b-256 checksum How to use checksums |
c1a1572f1c68a9eb60b8bc4c550af8dda12041811024b8fb29be34517d5edc96
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.7.1 importlib_metadata/4.8.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.10
|
Release files / proxy_pool_redis-0.0.15-py3-none-any.whl
| Download URL | proxy_pool_redis-0.0.15-py3-none-any.whl |
|---|---|
| Size | 10.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
d897eb2e4f25098307d93a930a944ca445ed19272209304c3a3b9b6644e3fa94
|
|
BLAKE2b-256 checksum How to use checksums |
4d36fc6cfed79de1e5a9202e93d63f2172edda1ae190578fc24f90bec6fc4455
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.7.1 importlib_metadata/4.8.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.10
|