Skip to main content
Donate to the Python Software Foundation or Purchase a PyCharm License to Benefit the PSF! Donate Now

Proxy scraper for further use

Project description

Free-proxy

Get free working proxy from https://www.sslproxies.org/ and use it in your script

FreeProxy class scrapes proxies from https://www.sslproxies.org/ and checkes if proxy is working. There is posibility to
filter proxies by country and acceptable timeout. You can also randomize list of proxies from where script would get
first working proxy.

You can use it in sending request through custom proxy, with selenium or wherever you want.

Returns proxy as string:

'113.160.218.14:8888'  

Requirements

  • Python3

  • Request library

  • Lxml library

Usage with examples

Parameter Type Example Default value
country_id str 'US' None
timeout float > 0 0.1 0.5
rand bool True False
proxy = FreeProxy().get()  
  • country_id parameter
    Get first working proxy from specified country. If there is no valid proxy from specified country check all countries
proxy = FreeProxy(country_id='US').get()  
  • timeout parameter
    Timeout is parameter for checking if proxy is valid. If test site doesn't respond in specified time
    script marks this proxy as invalid. Default timeout=0.5. You can change it by defining
    specified timeout eg. timeout=1.
proxy = FreeProxt(timeut=1).get()  
  • rand parameter
proxy = FreeProxy(rand=True).get()  

Shuffles proxy list from https://www.sslproxies.org/. Default rand=False and searches for working proxy from newest to oldest (as they are listed in https://www.sslproxies.org/).

You can combine parameters:

proxy = FreeProxy(country_id='US', timeout=0.3, rand=True).get()  

If there is no working proxy script returns None

License

MIT

Free Software!

Project details


Release history Release notifications

This version
History Node

1.0.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
free_proxy-1.0.0-py3-none-any.whl (4.3 kB) Copy SHA256 hash SHA256 Wheel py3
free_proxy-1.0.0.tar.gz (2.9 kB) Copy SHA256 hash SHA256 Source None

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page