Skip to main content

Asynchronous Library to scrap proxies for my web scrapping applications and other testing purposes

Project description

ProxyGrab

Software to scrap proxies for my web scrapping and other testing purposes.

PyPI CI (pip) Supported Python Versions Downloads Documentation

I made this software to scrap proxies for my web scrapping and other testing purposes. This program just uses aiohttp to get the response from API and return the proxies, also it can scrape proxies from a few sites so that it can be used without using the API.

NOTE: This library isn't designed for production use. It's advised to use your own proxies or purchase a service which provides an API. These are merely free ones that are retrieved from sites and should only be used for development or testing purposes.

Installation

The latest version of proxygrab is available via pip:

pip install --upgrade proxygrab

Also, you can download the source code and install using:

python setup.py install

Provided Proxies

Provider Proxy Types avaiable Url
Proxyscrape http, https, socks4, socks5 https://proxyscrape.com/
Proxy-List http, https, socks4, socks5 https://www.proxy-list.download/
SSL Proxies https https://www.sslproxies.org/
Free Proxy List http, https https://free-proxy-list.net/
US Proxies http, https https://www.us-proxy.org/
Socks Proxy socks4, socks5 https://www.socks-proxy.net/

Documentation

https://proxygrab.netlify.com

Contribuiting

Wanna help and improve this project?

Make sure to follow these before opening a PR:

  • Make sure your PR passes the test and is formatted according to pre-commit.
  • Make sure the package is working without any issues!

License

This project is licensed under the MIT License - see the LICENSE file for details

Thanks to

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ProxyGrab-1.1.1.tar.gz (9.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ProxyGrab-1.1.1-py3-none-any.whl (13.7 kB view details)

Uploaded Python 3

File details

Details for the file ProxyGrab-1.1.1.tar.gz.

File metadata

  • Download URL: ProxyGrab-1.1.1.tar.gz
  • Upload date:
  • Size: 9.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.10 CPython/3.9.7 Linux/5.10.16.3-microsoft-standard-WSL2

File hashes

Hashes for ProxyGrab-1.1.1.tar.gz
Algorithm Hash digest
SHA256 74e30fcf45277d2175a5e1d843e0bc9dca9051d81f05cff73e2e8afa7b8b62ae
MD5 fd33d56f608ed6d0db89d1b04056ce85
BLAKE2b-256 66871a5f494ea7d438cccd38ded0f51e22b536b62c0963d6034ebe8528ca7525

See more details on using hashes here.

File details

Details for the file ProxyGrab-1.1.1-py3-none-any.whl.

File metadata

  • Download URL: ProxyGrab-1.1.1-py3-none-any.whl
  • Upload date:
  • Size: 13.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.10 CPython/3.9.7 Linux/5.10.16.3-microsoft-standard-WSL2

File hashes

Hashes for ProxyGrab-1.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 f40804dcff74afa0dd2cd85dd94f715092412fce220485f4d8bd368f34656201
MD5 d52db5488c442184218d25d31113c96d
BLAKE2b-256 da3a38361812e772f2e544cd5d20b4e61cbd6d20f0125a533ccde7cc2ccbf879

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page