在原先SpiderClub/haipproxy cli 的基础上,稍微修改了下
- 可以通过scrapy中的settings配置来覆盖默认配置,
- 编写了scrapy download middleware ,自动配置proxy,前提是你通过haipproxy配置好了redis proxy pool
todo
- delete proxy 逻辑,删除连接失败的代理
Metadata
Release files for haipproxy2 0.1.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| haipproxy2-0.1.4.tar.gz | 13.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| haipproxy2-0.1.4-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 29.4 kB
Release files / haipproxy2-0.1.4.tar.gz
| Download URL | haipproxy2-0.1.4.tar.gz |
|---|---|
| Size | 13.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
7df2a9efeb5f6cfc4bef06f2f91d51349b6684241a396c6934fdd14a4e68d0f5
|
|
BLAKE2b-256 checksum How to use checksums |
5d1bf7dfc229f5a36612c81c483516e9a172a51dd6306b1b42e3a8b11c3c057b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.3.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.0.0.post20200309 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.7.6
|
Release files / haipproxy2-0.1.4-py3-none-any.whl
| Download URL | haipproxy2-0.1.4-py3-none-any.whl |
|---|---|
| Size | 16.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
f95b9b2cf9fa494abd216a5e0e1501b5131d9ad77a8573afee2c96c3474c47c1
|
|
BLAKE2b-256 checksum How to use checksums |
72ce565f73004a29664a0a2e363b5ac39e05343572e018b0ab27090800a9c3b6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.3.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.0.0.post20200309 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.7.6
|