Skip to main content

A simple package made using Python and requests to get proxies from multiple sites!

Project description

ProxyGrab

PyPI CI (pip) PyPI - License PyPI - Wheel Downloads

I made this software to scrap proxies for my web scrapping and other testing purposes. This program just uses requests to get the response from API and return the proxies.

NOTE: This library isn't designed for production use. It's advised to use your own proxies or purchase a service which provides an API. These are merely free ones that are retrieved from sites and should only be used for development or testing purposes.

Installation

The latest version of proxygrab is available via pip:

pip install proxygrab --upgrade

Also, you can even download the source code and install using:

python setup.py install

Provided Proxies:

Provider Proxy Types avaiable Url
Proxyscrape http, https, socks4, socks5 https://proxyscrape.com/
Proxy-List http, https, socks4, socks5 https://www.proxy-list.download/
SSL Proxies https https://www.sslproxies.org/
Free Proxy List http, https https://free-proxy-list.net/
US Proxies http, https https://www.us-proxy.org/
Socks Proxy socks4, socks5 https://www.socks-proxy.net/

Usage:

In Python Script

import proxygrab

socks5_list = proxygrab.get_socks5()  # Returns socks5 proxylist
socks4_list = proxygrab.get_socks4()  # Returns socks4 proxylist
http_list = proxygrab.get_http()  # Returns http proxylist
https_list = proxygrab.get_https()  # Returns https proxylist
proxy_list = proxygrab.get_proxy(type)  # Type can any one from http, https, socks4, socks5

https_list = proxygrab.get_https("scrapper")  # Get proxies only from scrappers
proxy_list = proxygrab.get_proxy(type, "scrapper")  # Same for this

# Starting v2.0
# If you don't provide a method,
# 'all' would be used as default!

Console

proxygrab --help
  • To save proxies to file:
proxygrab --type http --save
  • Save to custom filename:
proxygrab --type http --outfile custom_filename.txt --save
  • Save 100 proxies to custom filename:
proxygrab --type http --count 100 --outfile custom_filename.txt --save
  • Print only 5 proxies to terminal:
proxygrab --type http --count 5
  • Print only 5 proxies to terminal:
proxygrab --type http --count 5
  • Take proxies only from API: (Default = all)
proxygrab --type http --method api

If no proxy type is specified, the program will show this message:

"No Proxy type specified, check help by proxygrab --help"

Contribuiting

Wanna help and improve this project?

Make sure to follow these before opening a PR:

  • Make sure your PR is formatted with Black.
  • Make sure the package is working.

License

This project is licensed under the MIT License - see the LICENSE.md file for details

Thanks to:

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ProxyGrab-0.2.0.tar.gz (6.2 kB view hashes)

Uploaded Source

Built Distribution

ProxyGrab-0.2.0-py3-none-any.whl (8.2 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page