ProxyGrab
Software to scrap proxies for my web scrapping and other testing purposes.
I made this software to scrap proxies for my web scrapping and other testing purposes. This program just uses aiohttp to get the response from API and return the proxies, also it can scrape proxies from a few sites so that it can be used without using the API.
NOTE: This library isn't designed for production use. It's advised to use your own proxies or purchase a service which provides an API. These are merely free ones that are retrieved from sites and should only be used for development or testing purposes.
Installation
The latest version of proxygrab is available via pip:
pip install --upgrade proxygrab
Provided Proxies
| Provider | Proxy Types avaiable | Url |
|---|---|---|
| Proxyscrape | http, https, socks4, socks5 | https://proxyscrape.com/ |
| Proxy-List | http, https, socks4, socks5 | https://www.proxy-list.download/ |
| SSL Proxies | https | https://www.sslproxies.org/ |
| Free Proxy List | http, https | https://free-proxy-list.net/ |
| US Proxies | http, https | https://www.us-proxy.org/ |
| Socks Proxy | socks4, socks5 | https://www.socks-proxy.net/ |
Documentation
Contribuiting
Wanna help and improve this project?
Make sure to follow these before opening a PR:
- Make sure your PR passes the test and is formatted according to pre-commit.
- Make sure the package is working without any issues!
License
This project is licensed under the MIT License - see the LICENSE file for details
Thanks to
- @JaredLGillespie for his proxyscrape library from which I took scrappers!
- Proxy Providers mentioned above
Metadata
Release files for proxygrab 1.2.9
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| ProxyGrab-1.2.9.tar.gz | 9.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| proxygrab-1.2.9-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 23.6 kB
Release files / ProxyGrab-1.2.9.tar.gz
| Download URL | ProxyGrab-1.2.9.tar.gz |
|---|---|
| Size | 9.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
7b0571656fe1a952d415bf7410f1a49d1cdc09b056684c4d3e77d642bd211f93
|
|
BLAKE2b-256 checksum How to use checksums |
5cf6ad2dc15a95967ea669d21b058a2196dd3cc36e9396789dc2790e1d50b657
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.2.0 CPython/3.10.2 Linux/5.15.0-1019-azure
|
Release files / proxygrab-1.2.9-py3-none-any.whl
| Download URL | proxygrab-1.2.9-py3-none-any.whl |
|---|---|
| Size | 13.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
666dc89b6b80d63f7425e1b326b5afc28a049be62bb3aec9251999575d49d855
|
|
BLAKE2b-256 checksum How to use checksums |
7cf2393cf3674d345854f7fcee0ab39ca65d95a99f48ea61605bab7f885826c9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.2.0 CPython/3.10.2 Linux/5.15.0-1019-azure
|