Skip to main content

Retrieve lists of free HTTP proxies from online sites.

Project description

Package Description

GetProx is a library for retrieving lists of free HTTP proxies from various online sites.

Installation

The package may be installed as follows:

pip install getprox

Usage Examples

To retrieve proxies from all available sources, invoke the package as follows:

import getprox
proxy_uri_list = getprox.proxy_get()

Proxies are returned in http://host:port format. By default, the proxies will be tested using a simple timeout test to determine whether they are alive. A list of supported proxy sources can be obtained via

proxy_src_list = getprox.sources()

Proxies may also be obtained from a specific source or sources. For example:

proxy_uri_list = getprox.proxy_get('letushide')

Internally, proxy retrieval and testing is performed asynchronously; one can also access the asynchronous mechanism as follows:

p = getprox.ProxyGet()
# .. wait for a while ..
proxy_src_list = p.get()

Instantiation of the ProxyGet class will launch threads that perform retrieval and testing. If the threads finish running, the get() method will return the retrieved proxy URIs; if not, the method will return an empty list.

Development

The latest release of the package may be obtained from GitHub.

To Do

  • Add support for more proxy sources.
  • Expose proxy selection options for specific sources.
  • Provide more robust proxy checking algorithm.

Author

See the included AUTHORS.rst file for more information.

License

This software is licensed under the BSD License.

Project details


Release history Release notifications

This version
History Node

0.1.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
getprox-0.1.1.tar.gz (10.1 kB) Copy SHA256 hash SHA256 Source None Jan 6, 2015

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page