High aviariable proxy pool client for crawlers.
Project description
在原先SpiderClub/haipproxy cli 的基础上，稍微修改了下
- 可以通过scrapy中的settings配置来覆盖默认配置，
- 编写了scrapy download middleware ,自动配置proxy,前提是你通过haipproxy配置好了redis proxy pool
todo
- delete proxy 逻辑,删除连接失败的代理
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
haipproxy2-0.1.4.tar.gz
(13.3 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file haipproxy2-0.1.4.tar.gz.
File metadata
- Download URL: haipproxy2-0.1.4.tar.gz
- Upload date:
- Size: 13.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.0.0.post20200309 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.7.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7df2a9efeb5f6cfc4bef06f2f91d51349b6684241a396c6934fdd14a4e68d0f5
|
|
| MD5 |
6bc6ec50f16f0c9d458b0ba7025a5582
|
|
| BLAKE2b-256 |
5d1bf7dfc229f5a36612c81c483516e9a172a51dd6306b1b42e3a8b11c3c057b
|
File details
Details for the file haipproxy2-0.1.4-py3-none-any.whl.
File metadata
- Download URL: haipproxy2-0.1.4-py3-none-any.whl
- Upload date:
- Size: 16.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.0.0.post20200309 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.7.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f95b9b2cf9fa494abd216a5e0e1501b5131d9ad77a8573afee2c96c3474c47c1
|
|
| MD5 |
be68106f30800b9b5f63052efb2f7891
|
|
| BLAKE2b-256 |
72ce565f73004a29664a0a2e363b5ac39e05343572e018b0ab27090800a9c3b6
|
