A wrapper for the Python 3 requests module
Project description
Python Proxy Requests | make an http GET/POST with a proxy scraped from https://www.sslproxies.org/
The ProxyRequests class first scrapes proxies from the web. Then it recursively attempts to make a request if the initial request with a proxy is unsuccessful. System Requirements: Python 3 and the requests module.
Youtube Demo: https://youtu.be/isxJeqo_sBA
Runs on Linux and Windows (and Mac probably)-It may take a moment to run depending on current proxy.
Either copy the code and put where you want it, or download via pip:
pip3 install proxy-requests
from proxy_requests.proxy_requests import ProxyRequests
or if you need the Basic Auth subclass as well:
from proxy_requests.proxy_requests import ProxyRequests, ProxyRequestsBasicAuth
If the above import statement is used, method calls will be identical to the ones shown below. Pass a fully qualified URL when initializing an instance.
The ProxyRequestBasicAuth subclass has get(), get_with_headers(), post(), post_with_headers(), and post_file() methods that will override the Parent methods.
example GET:
r = ProxyRequests("https://api.ipify.org")
r.get()
example GET with headers:
h = {"User-Agent": "NCSA Mosaic/3.0 (Windows 95)"}
r = ProxyRequests("url here")
r.set_headers(h)
r.get_with_headers()
example POST:
r = ProxyRequests("url here")
r.post({"key1": "value1", "key2": "value2"})
example POST with headers:
r = ProxyRequests("url here")
r.set_headers({"name": "rootVIII", "secret_message": "7Yufs9KIfj33d"})
r.post_with_headers({"key1": "value1", "key2": "value2"})
example POST FILE:
r = ProxyRequests("url here")
r.set_file({'file': open('test.txt', 'rb')})
r.post_file()
example GET with Basic Authentication:
r = ProxyRequestsBasicAuth("url here", "username", "password")
r.get()
example GET with headers & Basic Authentication:
h = {"User-Agent": "NCSA Mosaic/3.0 (Windows 95)"}
r = ProxyRequestsBasicAuth("url here", "username", "password")
r.set_headers(h)
r.get_with_headers()
example POST with Basic Authentication
r = ProxyRequestsBasicAuth("url here", "username", "password")
r.post({"key1": "value1", "key2": "value2"})
example POSTwith headers & Basic Authentication
r = ProxyRequestsBasicAuth("url here", "username", "password")
r.set_headers({"header_key": "header_value"})
r.post_with_headers({"key1": "value1", "key2": "value2"})
example POST FILE with Basic Authentication:
r = ProxyRequestsBasicAuth("url here", "username", "password")
r.set_file({'file': open('test.txt', 'rb')})
r.post_file()
Response Methods:
Returns a string:
print(r)
Or if you want the raw content as bytes:
r.get_raw()
Get the response headers:
print(r.get_headers())
Get the status code:
print(r.get_status_code())
Get the proxy that was used to make the request:
print(r.get_proxy_used())
To write response a to a file (including an image):
r.response_to_file()
Load your response to JSON:
import json
r = ProxyRequests(url)
r.get()
json.loads(r.get_raw().decode())
This was developed on Ubuntu 16.04.4 LTS.
Author: James Loye Colley 04AUG2018
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file proxy_requests-0.1.10.tar.gz.
File metadata
- Download URL: proxy_requests-0.1.10.tar.gz
- Upload date:
- Size: 3.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.20.0 setuptools/40.0.0 requests-toolbelt/0.8.0 tqdm/4.24.0 CPython/3.5.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
77e57bc67c73dce47764739768c2f8f22c663d4dad1afa05e930502287d5e390
|
|
| MD5 |
a7e31b44d2bdc5a59dc4ab0f844b6bfd
|
|
| BLAKE2b-256 |
a5016943fc49b23b6f2f15ab8e362f988d8a4d87ffc1594a8e28b2e79beec376
|
File details
Details for the file proxy_requests-0.1.10-py3-none-any.whl.
File metadata
- Download URL: proxy_requests-0.1.10-py3-none-any.whl
- Upload date:
- Size: 4.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.2.0 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.6.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b9c0a13312dfa2005d5e1ba8e41e617f4d3ccccc8b782fc21ae08f81fb8420de
|
|
| MD5 |
c4ae33b8a94bfcb2c54adf8d796e2896
|
|
| BLAKE2b-256 |
326a5911e3ddd01cc005be36281fcc968f4789a148d7fa1eee001fbd18e69ee8
|