A simple package made using Python and requests to get proxies from multiple sites!
Project description
ProxyGrab
I made this software to scrap proxies for my web scrapping and other testing purposes. This program just uses requests to get the response from API and return the proxies.
NOTE: This library isn't designed for production use. It's advised to use your own proxies or purchase a service which provides an API. These are merely free ones that are retrieved from sites and should only be used for development or testing purposes.
Installation
The latest version of proxygrab is available via pip
:
pip install proxygrab --upgrade
Also, you can even download the source code and install using:
python setup.py install
Provided Proxies:
Provider | Proxy Types avaiable | Url |
---|---|---|
Proxyscrape | http, https, socks4, socks5 | https://proxyscrape.com/ |
Proxy-List | http, https, socks4, socks5 | https://www.proxy-list.download/ |
SSL Proxies | https | https://www.sslproxies.org/ |
Free Proxy List | http, https | https://free-proxy-list.net/ |
US Proxies | http, https | https://www.us-proxy.org/ |
Socks Proxy | socks4, socks5 | https://www.socks-proxy.net/ |
Usage:
In Python Script
import proxygrab
socks5_list = proxygrab.get_socks5() # Returns socks5 proxylist
socks4_list = proxygrab.get_socks4() # Returns socks4 proxylist
http_list = proxygrab.get_http() # Returns http proxylist
https_list = proxygrab.get_https() # Returns https proxylist
proxy_list = proxygrab.get_proxy(type) # Type can any one from http, https, socks4, socks5
https_list = proxygrab.get_https("scrapper") # Get proxies only from scrappers
proxy_list = proxygrab.get_proxy(type, "scrapper") # Same for this
# Starting v2.0
# If you don't provide a method,
# 'all' would be used as default!
Console
proxygrab --help
- To save proxies to file:
proxygrab --type http --save
- Save to custom filename:
proxygrab --type http --outfile custom_filename.txt --save
- Save 100 proxies to custom filename:
proxygrab --type http --count 100 --outfile custom_filename.txt --save
- Print only 5 proxies to terminal:
proxygrab --type http --count 5
- Print only 5 proxies to terminal:
proxygrab --type http --count 5
- Take proxies only from API: (Default = all)
proxygrab --type http --method api
If no proxy type is specified, the program will show this message:
"No Proxy type specified, check help by proxygrab --help"
Contribuiting
Wanna help and improve this project?
Make sure to follow these before opening a PR:
- Make sure your PR is formatted with Black.
- Make sure the package is working.
License
This project is licensed under the MIT License - see the LICENSE.md file for details
Thanks to:
- @JaredLGillespie for his proxyscrape library from which I took scrappers!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for ProxyGrab-0.2.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 63e16b407762d0f7ef4937e0d3c958de785d5f509a90fa3a333e0de4c7a62a73 |
|
MD5 | 4b2020e6b57b7e4172d7a909bee1783b |
|
BLAKE2b-256 | d07c1d967a1736f4cd431be9816123d07f9d1f0e8d737dc4a03ae5fa599df81b |