Skip to main content

Proxy scraper for further use

Project description

Free-proxy

Version 1.2.2

Get free working proxies from https://www.sslproxies.org/, https://www.us-proxy.org/, https://free-proxy-list.net/uk-proxy.html and https://free-proxy-list.net and use them in your script

The FreeProxy class scrapes proxies from https://www.sslproxies.org/, https://www.us-proxy.org/, https://free-proxy-list.net/uk-proxy.html, and https://free-proxy-list.net and checks to make sure that it works. You can filter proxies by country, and specify an acceptable timeout. You can also randomize the list of proxies, rather than going in the order that they are scraped in.

You can use this to send requests through a custom proxy, with Selenium, or with anything else.

Returns proxy as string:

'http://113.160.218.14:8888'

Requirements

Installation

pip install free-proxy

asciicast

Usage examples

First import Free Proxy that way:

from fp.fp import FreeProxy

Options

Parameter Type Example Default value
country_id list ['US', 'BR'] None
timeout float > 0 0.1 0.5
rand bool True False
anonym bool True False
elite bool True False
google bool,None False None
https bool True False
url str '' google.com
request_timeout float > 0 5 10
proxy = FreeProxy().get()
proxy = FreeProxy(country_id=['US', 'BR']).get()
proxy = FreeProxy(country_id=['US']).get()
proxy = FreeProxy(country_id=['GB']).get()
  • timeout parameter Timeout is the parameter for checking if a proxy is valid. If the server does not respond in specified time, the script will mark the proxy as invalid. Default timeout=0.5. You can change it by specifying a timeout eg. timeout=1.
proxy = FreeProxy(timeout=1).get()
  • rand parameter Shuffles the order of the proxy list from https://www.sslproxies.org/ instead of going from newest to oldest (as listed on the website). Defaults to rand=False
proxy = FreeProxy(rand=True).get()
  • anonym parameter Return only proxies marked as anonymous. Defaults to anonym=False
proxy = FreeProxy(anonym=True).get()
  • elite parameter Return only proxies marked as 'elite proxy'. Defaults to elite=False.
proxy = FreeProxy(elite=True).get()

Please note: elite proxies are always anonymous. If you set elite=True, you will also be eliminating any non-anonymous proxies.

  • google parameter If True it will only return proxies marked as "google". If False, it will not return proxies marked as "google". Defaults to google=None, which returns all proxies.
proxy = FreeProxy(google=True).get()
  • https parameter If True it will only return proxies marked as HTTPS. Defaults to https=False - i.e. HTTP proxy (for HTTP websites).

    Please note: HTTPS proxies work for both HTTP and HTTPS websites.

proxy = FreeProxy(https=True).get()

You can combine parameters:

proxy = FreeProxy(country_id=['US', 'BR'], timeout=0.3, rand=True).get()

If there are no working proxies with the provided parameters, the script will raise FreeProxyException with the message There are no working proxies at this time..

  • url parameter The url parameter allows you to set a custom URL for testing purposes. If left empty, it defaults to 'https://www.google.com'.

Using default URL:

proxy = FreeProxy().get() 

Using custom URL, if test on different endpoint is needed:

proxy = FreeProxy(url='http://httpbin.org/get').get() 
  • request_timeout parameter Number of seconds to wait when downloading the proxy list from the source websites (https://www.sslproxies.org/ etc.). If the website does not respond in that time, the script raises FreeProxyException instead of hanging indefinitely. Defaults to request_timeout=10. Not to be confused with timeout, which is used for checking individual proxies.
proxy = FreeProxy(request_timeout=5).get()

CHANGELOG


[1.2.2] - 2026-07-04

  • Fixed get_proxy_list hanging indefinitely when a source website stalls — the proxy list request now has a timeout (#58)
  • Added request_timeout parameter (default: 10 seconds) to control the proxy list download timeout

[1.2.1] - 2026-06-09

  • Fixed proxy check failing due to a duplicated URL schema (http://https://...), introduced in 1.1.3. This broke https=True and custom url usage (#52, #43).

[1.2.0] - 2026-06-09

  • Updated lxml to version 6.1.1
  • Updated requests to version 2.34.2
  • Updated pip-chill to version 1.0.5
  • Pinned minimum dependency versions in install_requires (lxml>=5.0,<7, requests>=2.31,<3)
  • Raised minimum Python version to 3.8

[1.1.3] - 2024-11-07

  • Added url paramameter

[1.1.2] - 2024-09-07

  • Updated lxml to version 5.3.0
  • Updated pip-chill to version 1.0.3
  • Updated requests to version 2.32.3

[1.1.1] - 2023-02-18

  • Fixed https parameter error
  • Fixed additional loop issue when no proxy was found

[1.1.0] - 2022-11-12

[1.0.6] - 2022-01-23

  • Added google parameter
  • Added https parameter

[1.0.5] - 2022-01-07

  • Added elite parameter
  • Add exception class and raise exception instead of system exit
  • Change lxml version to 4.6.5

[1.0.4] - 2021-11-13

  • Fix proxy list default length

[1.0.3] - 2021-08-18

  • Change XPatch due to SSL proxies page update
  • Change lxml version

[1.0.2] - 2020-09-03

  • Added anonym parameter

[1.0.1] - 2020-03-19

  • Fix typos in readme
  • Fix urrlib3 exception urllib3.exceptions.ProxySchemeUnknown: Not supported proxy scheme None,
  • Fix imports

[1.0.0] - 2019-02-04

  • Initial release

Disclaimer

The authors of this repository are not responsible for any consequences, damages or losses arising from the use or misuse of this repository or content. Users are solely responsible for their actions and any consequences that may follow.

License


MIT

Free Software!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

free_proxy-1.2.2.tar.gz (6.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

free_proxy-1.2.2-py3-none-any.whl (6.6 kB view details)

Uploaded Python 3

File details

Details for the file free_proxy-1.2.2.tar.gz.

File metadata

  • Download URL: free_proxy-1.2.2.tar.gz
  • Upload date:
  • Size: 6.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.25

File hashes

Hashes for free_proxy-1.2.2.tar.gz
Algorithm Hash digest
SHA256 5d6e228f7a513755d1f30064ddff74014b56817ed9bcbbea60d4229651ccc816
MD5 3ec5de355ec7f5e15b64c5b5e711054e
BLAKE2b-256 9052004a5ef63b453f7352b55047d54aa0ed408d68c159cce00f2f3479d35e34

See more details on using hashes here.

File details

Details for the file free_proxy-1.2.2-py3-none-any.whl.

File metadata

  • Download URL: free_proxy-1.2.2-py3-none-any.whl
  • Upload date:
  • Size: 6.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.25

File hashes

Hashes for free_proxy-1.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 c281712f8802afe6b460015a5986ba2fdf8671b00732980f32bff2b62d008a48
MD5 39bad31185db599eff9e9eada97cd118
BLAKE2b-256 b087a325c999876f5c982bd5e6cca4f8775bf9cf1bc3f3f9acad77f209a1f619

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page