Proxy scraper for further use
Get free working proxy from https://www.sslproxies.org/ and use it in your script
FreeProxy class scrapes proxies from https://www.sslproxies.org/ and checks if proxy is working. There is possibility to filter proxies by country and acceptable timeout. You can also randomize list of proxies from where script would get first working proxy.
You can use it in sending request through custom proxy, with selenium or wherever you want.
Returns proxy as string:
- Request library
- Lxml library
pip install free-proxy
Usage with examples
First import Free Proxy that way:
from fp.fp import FreeProxy
|timeout||float > 0||0.1||0.5|
- No parameters Get first working proxy from https://www.sslproxies.org/
proxy = FreeProxy().get()
country_idparameter Get first working proxy from specified list of countries. If there is no valid proxy from specified list check all countries
proxy = FreeProxy(country_id=['US', 'BR']).get()
timeoutparameter Timeout is parameter for checking if proxy is valid. If test site doesn't respond in specified time script marks this proxy as invalid. Default
timeout=0.5. You can change it by defining specified timeout eg.
proxy = FreeProxy(timeout=1).get()
randparameter Shuffles proxy list from https://www.sslproxies.org/. Default
rand=Falseand searches for working proxy from newest to oldest (as they are listed in https://www.sslproxies.org/).
proxy = FreeProxy(rand=True).get()
anonymparameter Return only those proxies that are marked as anonymous. Defaults to
proxy = FreeProxy(anonym=True).get()
eliteparameter Return only those proxies that are marked as 'elite proxy'. Defaults to
proxy = FreeProxy(elite=True).get()
Note that elite proxies are anonymous at the same time, thus
anonym=True automatically when
Trueit returns only those proxies that are marked as goggle, if
False- as no google. Defaults to
google=Nonethat returns all proxies.
proxy = FreeProxy(google=True).get()
httpsparameter If true it returns only those proxies that are marked as HTTPS. Defaults to
https=False- i.e. HTTP proxy (for HTTP websites).
Note that HTTPS proxy is for both HTTP and HTTPS websites.
proxy = FreeProxy(https=True).get()
You can combine parameters:
proxy = FreeProxy(country_id=['US', 'BR'], timeout=0.3, rand=True).get()
If there are no working proxies with provided parameters script raises
There are no working proxies at this time. message.
[1.0.6] - 2022-01-23
[1.0.5] - 2022-01-07
- Add exception class and raise exception instead of system exit
- Change lxml version to 4.6.5
[1.0.4] - 2021-11-13
- Fix proxy list default length
[1.0.3] - 2021-08-18
- Change XPatch due to SSL proxies page update
- Change lxml version
[1.0.2] - 2020-09-03
[1.0.1] - 2020-03-19
- Fix typos in readme
- Fix urrlib3 exception
urllib3.exceptions.ProxySchemeUnknown: Not supported proxy scheme None,
- Fix imports
[1.0.0] - 2019-02-04
- Initial release
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.