Skip to main content

Asynchronous Library to scrap proxies for my web scrapping applications and other testing purposes

Project description

ProxyGrab

Software to scrap proxies for my web scrapping and other testing purposes.

PyPI CI (pip) Supported Python Versions Downloads Documentation

I made this software to scrap proxies for my web scrapping and other testing purposes. This program just uses aiohttp to get the response from API and return the proxies, also it can scrape proxies from a few sites so that it can be used without using the API.

NOTE: This library isn't designed for production use. It's advised to use your own proxies or purchase a service which provides an API. These are merely free ones that are retrieved from sites and should only be used for development or testing purposes.

Installation

The latest version of proxygrab is available via pip:

pip install --upgrade proxygrab

Also, you can download the source code and install using:

python setup.py install

Provided Proxies

Provider Proxy Types avaiable Url
Proxyscrape http, https, socks4, socks5 https://proxyscrape.com/
Proxy-List http, https, socks4, socks5 https://www.proxy-list.download/
SSL Proxies https https://www.sslproxies.org/
Free Proxy List http, https https://free-proxy-list.net/
US Proxies http, https https://www.us-proxy.org/
Socks Proxy socks4, socks5 https://www.socks-proxy.net/

Documentation

https://proxygrab.netlify.com

Contribuiting

Wanna help and improve this project?

Make sure to follow these before opening a PR:

  • Make sure your PR passes the test and is formatted according to pre-commit.
  • Make sure the package is working without any issues!

License

This project is licensed under the MIT License - see the LICENSE file for details

Thanks to

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ProxyGrab-1.0.1.tar.gz (10.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ProxyGrab-1.0.1-py3-none-any.whl (13.7 kB view details)

Uploaded Python 3

File details

Details for the file ProxyGrab-1.0.1.tar.gz.

File metadata

  • Download URL: ProxyGrab-1.0.1.tar.gz
  • Upload date:
  • Size: 10.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.6 CPython/3.9.5 Linux/5.4.72-microsoft-standard-WSL2

File hashes

Hashes for ProxyGrab-1.0.1.tar.gz
Algorithm Hash digest
SHA256 8f97d47a539992d4e65b55998392ab15e3dea198eeff643c946783d0f4148cfc
MD5 deddeb4f0ece360a5782284d777eb86e
BLAKE2b-256 9ed552fde19b34d1fb7972743a699dfdc74bacd171a49d4954a673da86470141

See more details on using hashes here.

File details

Details for the file ProxyGrab-1.0.1-py3-none-any.whl.

File metadata

  • Download URL: ProxyGrab-1.0.1-py3-none-any.whl
  • Upload date:
  • Size: 13.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.6 CPython/3.9.5 Linux/5.4.72-microsoft-standard-WSL2

File hashes

Hashes for ProxyGrab-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 2ff6f9702178500c49023a8ce74af2ed326ca8f7561c718adb2498e274a94162
MD5 8c8f8f5749655822fc96b9ef833d3558
BLAKE2b-256 f7d32a04d622ce88cf0ec01a71e30dd974095f0b6147a98e219846e89d131aa3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page