Need proxy? You`re welcome.
To parse really big site in a small amount of time you need to make hundreds of requests concurrently and not being banned (that’s mainly impossible to do from one IP).
So, proxipy could help you with this.
It returns a random proxy (or list of proxies) to use it directly in requests module.
Installation
$ pip install proxipy
Usage
First, we need to import our module (and/or requests):
>>> from proxipy import proxipy
>>> import requests
And use it with/out filters:
>>> prox = proxipy()
>>> prox
{'http': ..., 'https': ...}
>>> req = requests.get('http://httpbin.org/get',
... proxies=proxipy(country='US', port=8080))
>>> req
<Response [...]>
Metadata
Release files for proxipy 1.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| proxipy-1.1.tar.gz | 17.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| proxipy-1.1-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Total release size: 22.3 kB
Release files / proxipy-1.1.tar.gz
| Download URL | proxipy-1.1.tar.gz |
|---|---|
| Size | 17.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e90d7554e9058c58490bf64b57fe6d378d1709aa54f0a36b1ca7dd8cec21e6c2
|
|
BLAKE2b-256 checksum How to use checksums |
02881a113eb1dd3c35bd37d6f42c2131fb0ee51a87bdef0efe8298c0aa99409f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.0.0 requests-toolbelt/0.8.0 tqdm/4.26.0 CPython/3.7.0
|
Release files / proxipy-1.1-py2.py3-none-any.whl
| Download URL | proxipy-1.1-py2.py3-none-any.whl |
|---|---|
| Size | 5.3 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
19bc7f7ecc4954481c0a2e11d33f2f697b74d563f49126c718992b15f09931e6
|
|
BLAKE2b-256 checksum How to use checksums |
05f90537482a54269a338dab71d40939504af24cfca2eeb8fc6dfd52281998f6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.0.0 requests-toolbelt/0.8.0 tqdm/4.26.0 CPython/3.7.0
|