A description of your project
Project description
title: Title
summary: "summary"
Proxy Manager
The package is intended to manage a set of proxies, rotating through at random, to prevent blocking. Proxies are dropped from the rotation if they fail multiple times in a row.
VERY EARLY STAGE
Installation
pip install ProxyManager
Basic usage
PROXY_LIST = [
'70.45.80.236:4602',
'70.45.80.236:4603',
'70.45.80.236:4604'
]
URL = 'http://www.myurl.com'
from ProxyManager.core import ProxyManager, Proxy
proxies = [Proxy(i) for i in PROXY_LIST]
response = proxies.make_request(URL)
Free Proxies
If you don't bring your own proxies, which is HIGHLY recommended, I have written a function that scrapes https://free-proxy-list.net/ to obtain a set of proxies.
from ProxyManager.free_proxies import get_free
FREE_PROXIES = get_free(10)
proxies = [Proxy('{}:{}'.format(i['ip'], i['port'])) for i in FREE_PROXIES]
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ProxyManager-0.0.2.tar.gz
(4.2 kB
view hashes)
Built Distribution
Close
Hashes for ProxyManager-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6c4dc48e95a5750fb26c1abfe1167f46afd6834d0d7baad437dd92bb73e6d471 |
|
MD5 | a38401a88f413348a923933ded07d093 |
|
BLAKE2b-256 | 32f12ecac287b370b817a41d721057a37a6470105ea7752471a9ded1dbd89fa8 |