A description of your project
Project description
title: Title
summary: "summary"
Proxy Manager - Python
The package is intended to manage a set of proxies, rotating through at random, to prevent blocking. Proxies are currently dropped from the rotation if they fail twice in a row.
VERY EARLY STAGE
Installation
pip install ProxyManager
Basic usage
PROXY_LIST = [
'70.45.80.236:4602',
'70.45.80.236:4603',
'70.45.80.236:4604'
]
URL = 'http://www.myurl.com'
from ProxyManager.core import ProxyManager, Proxy
proxies = [i for i in PROXY_LIST] # OR [Proxy(i) for i in PROXY_LIST]
result = proxies.make_request(URL)
# Manually fail last proxy
if '<something_wrong_about>' in result['response']:
pm.manual_fail()
Free Proxies
If you don't bring your own proxies, which is HIGHLY recommended, I have written a function that scrapes https://free-proxy-list.net/ to obtain a set of proxies.
from ProxyManager.free_proxies import get_free
FREE_PROXIES = get_free(10)
proxies = [Proxy('{}:{}'.format(i['ip'], i['port'])) for i in FREE_PROXIES]
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ProxyManager-0.0.5.tar.gz
(4.5 kB
view hashes)
Built Distribution
Close
Hashes for ProxyManager-0.0.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 108ab53b2c683be51c42b7c49fde75bd4956c3adc769b6d9d39685bf3352de27 |
|
MD5 | e858bcc2840507429ce988cc305e4e7a |
|
BLAKE2b-256 | 60d72c7b2b0ad3b289921e9c51a63da50c1f0c52ca005f8294b3e285cc3677fb |