A utility to get and filter free proxies
Project description
proxygetter
Description
proxygetter
is a Python library that provides a fast and customizable way to scrape, filter, and manage proxies. It's powered by asyncio and aiohttp to validate proxies asynchronously. Originally designed to scrape from sslproxies.org, it now supports customizable sources and multiple filters.
Installation
Install the package via pip:
pip install proxygetter
Features
Proxy Management
Manage your proxies with ease using the ProxyManager
class.
from proxygetter import ProxyManager
manager = ProxyManager()
Asynchronous Filtering
Filter proxies based on their validity asynchronously.
valid_proxies = manager.filter_with_validity(url="http://example.com")
Proxy Information
Access details about each proxy through the Proxy
class.
proxy = valid_proxies[0]
print(proxy.get_requests_format())
print(proxy.get_selenium_format())
Advanced Filters
Get proxies using advanced filters like country code, anonymity, https support, Google compatibility, and last checked time.
filtered_proxies = manager.get_proxies(country_code='US', anonymity='elite proxy', https=True, google=True, last_checked_max=600)
Fetch a Random Proxy
You can fetch a random proxy based on specified filters.
random_proxy = manager.get_random_proxy(country_code='US', https=True)
Environment Configuration
Configure default user agent and timeout using environment variables.
export PROXY_URL_CHECKER_USER_AGENT=your_user_agent
export PROXY_URL_CHECKER_TIMEOUT=your_timeout_value
License
This project is under the MIT License - see the LICENSE file for details.
Upcoming Features
- Proxy blacklisting
- Additional proxy databases
- Enhanced documentation and examples
Feel free to contribute or suggest improvements.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file proxygetter-0.2.1.tar.gz
.
File metadata
- Download URL: proxygetter-0.2.1.tar.gz
- Upload date:
- Size: 6.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.12.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6a4888b555fb7ae2e03339f6b1b222951beeca59fa2694d87527fbe541c3f6d6 |
|
MD5 | 8394b1fa74830af86dca6938d70293da |
|
BLAKE2b-256 | 384c23deee6d77b88f74bfb151b89e6ffe1c830d21c58b9e7cdbc4b2d1571e57 |
File details
Details for the file proxygetter-0.2.1-py3-none-any.whl
.
File metadata
- Download URL: proxygetter-0.2.1-py3-none-any.whl
- Upload date:
- Size: 8.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.12.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 013fc5d15649e16bc90a00afe9dc4c5306a1e0ea7b2d62267475839faee25cf5 |
|
MD5 | ffc70334ed696aa22e7e46ef89331c64 |
|
BLAKE2b-256 | 94301c0db3eb25dcc4d8f32e2a4d7dab21825a698de7cd3b38e979c125abdefd |