Asynchronous Library to scrap proxies for my web scrapping applications and other testing purposes
Project description
ProxyGrab
Software to scrap proxies for my web scrapping and other testing purposes.
I made this software to scrap proxies for my web scrapping and other testing purposes. This program just uses aiohttp to get the response from API and return the proxies, also it can scrape proxies from a few sites so that it can be used without using the API.
NOTE: This library isn't designed for production use. It's advised to use your own proxies or purchase a service which provides an API. These are merely free ones that are retrieved from sites and should only be used for development or testing purposes.
Installation
The latest version of proxygrab is available via pip
:
pip install --upgrade proxygrab
Provided Proxies
Provider | Proxy Types avaiable | Url |
---|---|---|
Proxyscrape | http, https, socks4, socks5 | https://proxyscrape.com/ |
Proxy-List | http, https, socks4, socks5 | https://www.proxy-list.download/ |
SSL Proxies | https | https://www.sslproxies.org/ |
Free Proxy List | http, https | https://free-proxy-list.net/ |
US Proxies | http, https | https://www.us-proxy.org/ |
Socks Proxy | socks4, socks5 | https://www.socks-proxy.net/ |
Documentation
Contribuiting
Wanna help and improve this project?
Make sure to follow these before opening a PR:
- Make sure your PR passes the test and is formatted according to pre-commit.
- Make sure the package is working without any issues!
License
This project is licensed under the MIT License - see the LICENSE file for details
Thanks to
- @JaredLGillespie for his proxyscrape library from which I took scrappers!
- Proxy Providers mentioned above
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file ProxyGrab-1.2.9.tar.gz
.
File metadata
- Download URL: ProxyGrab-1.2.9.tar.gz
- Upload date:
- Size: 9.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.2.0 CPython/3.10.2 Linux/5.15.0-1019-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7b0571656fe1a952d415bf7410f1a49d1cdc09b056684c4d3e77d642bd211f93 |
|
MD5 | 08c7fe5b775f3d5f837a12602a40c2cb |
|
BLAKE2b-256 | 5cf6ad2dc15a95967ea669d21b058a2196dd3cc36e9396789dc2790e1d50b657 |
File details
Details for the file proxygrab-1.2.9-py3-none-any.whl
.
File metadata
- Download URL: proxygrab-1.2.9-py3-none-any.whl
- Upload date:
- Size: 13.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.2.0 CPython/3.10.2 Linux/5.15.0-1019-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 666dc89b6b80d63f7425e1b326b5afc28a049be62bb3aec9251999575d49d855 |
|
MD5 | 82bb9e4fbc4c7892575ca9eb95f1c68c |
|
BLAKE2b-256 | 7cf2393cf3674d345854f7fcee0ab39ca65d95a99f48ea61605bab7f885826c9 |