getproxies
Get some free proxies scraped from free proxy sources.
from getproxies import get_proxies
proxies = get_proxies()
print(proxies[:10])
# [http://196.18.215.153:3128, https://36.67.89.179:65205, http://35.247.192.53:3128, socks5://113.54.158.40:1080, https://180.122.51.154:9999, socks4://117.44.28.152:9201, https://178.20.137.178:43980, https://109.86.121.118:46333, https://148.77.34.194:39175, socks4://114.99.16.195:1080]
or using cli:
$ poetry run getproxies --help
Usage: getproxies [OPTIONS]
scrape free proxies from all sources and put it to STDOUT
Options:
-p, --protocol [https|http|socks4|socks5]
restrict to specific protocol
-c, --country TEXT only proxies from specified country (ISO
double char code, e.g. US)
-l, --limit INTEGER limit proxy retrieval - increases
performance
-f, --format TEXT proxy output format, available variables: ho
st,port,protocol,code,country,anonymous,sour
ce [default: {protocol}://{host}:{port}]
--help Show this message and exit.
Install
$ pip install getproxies
or for latest code
$ pip install -U git+https://github.com/granitosaurus/getproxies
Sources
Currently these sources are supported
| source | spider |
|---|---|
| http://free-proxy-list.net | FreeProxyListSpider |
| http://proxy-daily.com | ProxyDailySpider |
extended usage
For more detailed proxy query a ProxyManager can be used:
from getproxies import ProxyManager
proxies = ProxyManager(
limit=10, # only 10 proxies
protocol='socks5', # only socks5 proxies
country='us', # only us proxies
)
limit parameter can reduce retrieval time
Proxy objects also have extended attributes:
class Proxy:
host: str
port: str
protocol: str
code: str = ''
country: str = ''
anonymous: bool = False
source: str = ''
as strings they resolve to protocol://host:port template.
Metadata
Release files for getproxies 1.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| getproxies-1.0.0.tar.gz | 4.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| getproxies-1.0.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 11.1 kB
Release files / getproxies-1.0.0.tar.gz
| Download URL | getproxies-1.0.0.tar.gz |
|---|---|
| Size | 4.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
8b9e26ea774aa1ff2038f410a0c1acebe803484cc05eef77387a803468c32f27
|
|
BLAKE2b-256 checksum How to use checksums |
7223f717e851806d8aa8a527a06b53bd5d3ad9d84be5faffc5f635c598e33075
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.0.3 CPython/3.8.1 Linux/5.5.0-1-mainline
|
Release files / getproxies-1.0.0-py3-none-any.whl
| Download URL | getproxies-1.0.0-py3-none-any.whl |
|---|---|
| Size | 6.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
1943706ea1c23bf64caef8f5ab611b919584b48e52ebb0d297a0570ac99b7ba0
|
|
BLAKE2b-256 checksum How to use checksums |
5f269dc8d32c6f3a741d5ddfa4872360866ec28d9d29a33a08e7770a28c0b2a8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.0.3 CPython/3.8.1 Linux/5.5.0-1-mainline
|