Skip to main content

A utility to get and filter free proxies

Project description

proxygetter

Description

proxygetter is a Python library that provides a fast and customizable way to scrape, filter, and manage proxies. It's powered by asyncio and aiohttp to validate proxies asynchronously. Originally designed to scrape from sslproxies.org, it now supports customizable sources and multiple filters.

Installation

Install the package via pip:

pip install proxygetter

Features

Proxy Management

Manage your proxies with ease using the ProxyManager class.

from proxygetter import ProxyManager
manager = ProxyManager()

Asynchronous Filtering

Filter proxies based on their validity asynchronously.

valid_proxies = manager.filter_with_validity(url="http://example.com")

Proxy Information

Access details about each proxy through the Proxy class.

proxy = valid_proxies[0]
print(proxy.get_requests_format())
print(proxy.get_selenium_format())

Advanced Filters

Get proxies using advanced filters like country code, anonymity, https support, Google compatibility, and last checked time.

filtered_proxies = manager.get_proxies(country_code='US', anonymity='elite proxy', https=True, google=True, last_checked_max=600)

Fetch a Random Proxy

You can fetch a random proxy based on specified filters.

random_proxy = manager.get_random_proxy(country_code='US', https=True)

Environment Configuration

Configure default user agent and timeout using environment variables.

export PROXY_URL_CHECKER_USER_AGENT=your_user_agent
export PROXY_URL_CHECKER_TIMEOUT=your_timeout_value

License

This project is under the MIT License - see the LICENSE file for details.

Upcoming Features

  • Proxy blacklisting
  • Additional proxy databases
  • Enhanced documentation and examples

Feel free to contribute or suggest improvements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

proxygetter-0.2.2.tar.gz (6.4 kB view details)

Uploaded Source

Built Distribution

proxygetter-0.2.2-py3-none-any.whl (8.1 kB view details)

Uploaded Python 3

File details

Details for the file proxygetter-0.2.2.tar.gz.

File metadata

  • Download URL: proxygetter-0.2.2.tar.gz
  • Upload date:
  • Size: 6.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.0 CPython/3.12.1

File hashes

Hashes for proxygetter-0.2.2.tar.gz
Algorithm Hash digest
SHA256 57486bc0fa37b08795d59eaac898a6f502df8e0feb7b928dda4222fad4d10fc8
MD5 5ad9e123525fedae1208f513a069b7f0
BLAKE2b-256 087b5c19974fbe7d453a7959cfeace599f2487b942abd075e3320c41e939c7a5

See more details on using hashes here.

File details

Details for the file proxygetter-0.2.2-py3-none-any.whl.

File metadata

  • Download URL: proxygetter-0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 8.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.0 CPython/3.12.1

File hashes

Hashes for proxygetter-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 d68d9ffe2eaf05c46c002beeb16e27b553c815e1f5eb4c40bfde5f76805993ac
MD5 c07c02522bfdbd46d28e01c816085ad6
BLAKE2b-256 028418a4786bdcaed3667770473040dd8265c6664fd86107901877bcb42162c9

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page