proxy randomizer
Project description
proxy-randomizer
proxy randomizer
Free software: MIT license
Documentation: https://proxy-randomizer.readthedocs.io.
Description
Inpired by http-request-randomizer
proxy_randomizer is intended to use for small-meduim web scrapers/crawlers, helping to avoid temporal/permanent bans from web pages, generating random proxies to include in the requests
Installation
pip install proxy_randomizer
API
To use proxy_randomizer in your code, you just need to generate a RegisteredProviders instance and parse the providers.
from proxy_randomizer import RegisteredProviders
rp = RegisteredProviders()
rp.parse_providers()
print(f"proxy: {rp.get_random_proxy()}")
You can iterate throughout all proxies as simple as this.
from proxy_randomizer import RegisteredProviders
import requests
rp = RegisteredProviders()
rp.parse_providers()
for proxy in rp.proxies:
proxies = {"https": proxy.get_proxy()}
response = requests.get("http://google.com", proxies=proxies)
If you need to hide your identity, you can filter the proxy list by its anonymity level.
from proxy_randomizer import RegisteredProviders
from proxy_randomizer.proxy import Anonymity
rp = RegisteredProviders()
rp.parse_providers()
anonymous_proxies = list(
filter(lambda proxy: proxy.anonymity == Anonymity.ANONYMOUS, rp.proxies)
)
print(f"filtered proxies: {anonymous_proxies}")
There are four different anonymity levels, you can inspect them like this
from proxy_randomizer.utils import ANONYMITY_LEVELS
for level in ANONYMITY_LEVELS:
print(level.label)
Command-line interface
If you need some quick proxy, just type this in your terminal.
proxy_randomizer
Credits
This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.
History
1.2.1 (2020-12-23)
Fix dependencies versions
1.2.0 (2020-12-23)
Refactor code
0.1.0 (2020-08-02)
First release on PyPI.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for proxy_randomizer-1.2.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6c1a1790251f6e6b0d021ea473d16812564e37dc2cf7bcacdb56afe4c35edddc |
|
MD5 | 7b36fafde7a353bc3a3d8f346cf41226 |
|
BLAKE2b-256 | d261e4f50438f441d1529dab412d058fe64d5cd46cb289c1040310c61ac2fd62 |