Asynchronous Library to scrap proxies for my web scrapping applications and other testing purposes
Project description
ProxyGrab
Software to scrap proxies for my web scrapping and other testing purposes.
I made this software to scrap proxies for my web scrapping and other testing purposes. This program just uses aiohttp to get the response from API and return the proxies, also it can scrape proxies from a few sites so that it can be used without using the API.
NOTE: This library isn't designed for production use. It's advised to use your own proxies or purchase a service which provides an API. These are merely free ones that are retrieved from sites and should only be used for development or testing purposes.
Installation
The latest version of proxygrab is available via pip:
pip install --upgrade proxygrab
Also, you can download the source code and install using:
python setup.py install
Provided Proxies
| Provider | Proxy Types avaiable | Url |
|---|---|---|
| Proxyscrape | http, https, socks4, socks5 | https://proxyscrape.com/ |
| Proxy-List | http, https, socks4, socks5 | https://www.proxy-list.download/ |
| SSL Proxies | https | https://www.sslproxies.org/ |
| Free Proxy List | http, https | https://free-proxy-list.net/ |
| US Proxies | http, https | https://www.us-proxy.org/ |
| Socks Proxy | socks4, socks5 | https://www.socks-proxy.net/ |
Documentation
Contribuiting
Wanna help and improve this project?
Make sure to follow these before opening a PR:
- Make sure your PR passes the test and is formatted according to pre-commit.
- Make sure the package is working without any issues!
License
This project is licensed under the MIT License - see the LICENSE file for details
Thanks to
- @JaredLGillespie for his proxyscrape library from which I took scrappers!
- Proxy Providers mentioned above
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file ProxyGrab-1.0.1.tar.gz.
File metadata
- Download URL: ProxyGrab-1.0.1.tar.gz
- Upload date:
- Size: 10.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.1.6 CPython/3.9.5 Linux/5.4.72-microsoft-standard-WSL2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8f97d47a539992d4e65b55998392ab15e3dea198eeff643c946783d0f4148cfc
|
|
| MD5 |
deddeb4f0ece360a5782284d777eb86e
|
|
| BLAKE2b-256 |
9ed552fde19b34d1fb7972743a699dfdc74bacd171a49d4954a673da86470141
|
File details
Details for the file ProxyGrab-1.0.1-py3-none-any.whl.
File metadata
- Download URL: ProxyGrab-1.0.1-py3-none-any.whl
- Upload date:
- Size: 13.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.1.6 CPython/3.9.5 Linux/5.4.72-microsoft-standard-WSL2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2ff6f9702178500c49023a8ce74af2ed326ca8f7561c718adb2498e274a94162
|
|
| MD5 |
8c8f8f5749655822fc96b9ef833d3558
|
|
| BLAKE2b-256 |
f7d32a04d622ce88cf0ec01a71e30dd974095f0b6147a98e219846e89d131aa3
|