Skip to main content

A wrapper for the Python 3 requests module

Project description

make an http GET/POST with a proxy scraped from https://www.sslproxies.org/

The ProxyRequests class first scrapes proxies from the web

Then it recursively attempts to make a request if the initial request with a proxy is unsuccessful

Requirements: Python 3 and the requests module

Pass it a fully qualified URL when initializing an instance

The ProxyRequestBasicAuth subclass has get, post, post_with_headers, and post_file, and string methods that will override the Parent methods

example GET:
  r = ProxyRequests("https://postman-echo.com/get?foo1=bar1&foo2=bar2")
  r.get()

example POST:
  r = ProxyRequests("url here")
  r.post({"key1": "value1", "key2": "value2"})

example POST with headers:
  r = ProxyRequests("url here")
  r.set_headers({"name": "rootVIII", "secret_message": "7Yufs9KIfj33d"})
  r.post_with_headers({"key1": "value1", "key2": "value2"})

example POST FILE:
  r = ProxyRequests("url here")
  r.set_file({'file': open('test.txt', 'rb')})
  r.post_file()

example GET with Basic Authentication:
  r = ProxyRequestsBasicAuth("url here", "username", "password")
  r.get()

example post with Basic Authentication
  r = ProxyRequestsBasicAuth("url here", "username", "password")
  r.post({"key1": "value1", "key2": "value2"})

example post with headers & Basic Authentication
  r = ProxyRequestsBasicAuth("url here", "username", "password")
  r.set_headers({"header_key": "header_value"})
  r.post_with_headers({"key1": "value1", "key2": "value2"})

example POST FILE with Basic Authentication:
  r = ProxyRequestsBasicAuth("url here", "username", "password")
  r.set_file({'file': open('test.txt', 'rb')})
  r.post_file()

  print(r)
  print(r.get_headers())
  print(r.get_status_code())
  print(r.to_json())
  print(r.get_proxy_used())

The to_json() method is not intended to be used for a string of HTML

This was developed on Ubuntu 16.04.4 LTS.


Author: James Loye Colley 04AUG2018

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

proxy_requests-0.0.3.tar.gz (1.9 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page