Skip to main content

A utility to get and filter free proxies

Project description

proxygetter

Description

proxygetter is a Python library that provides a fast and customizable way to scrape, filter, and manage proxies. It's powered by asyncio and aiohttp to validate proxies asynchronously. Originally designed to scrape from sslproxies.org, it now supports customizable sources and multiple filters.

Installation

Install the package via pip:

pip install proxygetter

Features

Proxy Management

Manage your proxies with ease using the ProxyManager class.

from proxygetter import ProxyManager
manager = ProxyManager()

Asynchronous Filtering

Filter proxies based on their validity asynchronously.

valid_proxies = manager.filter_with_validity(url="http://example.com")

Proxy Information

Access details about each proxy through the Proxy class.

proxy = valid_proxies[0]
print(proxy.get_requests_format())
print(proxy.get_selenium_format())

Advanced Filters

Get proxies using advanced filters like country code, anonymity, https support, Google compatibility, and last checked time.

filtered_proxies = manager.get_proxies(country_code='US', anonymity='elite proxy', https=True, google=True, last_checked_max=600)

Fetch a Random Proxy

You can fetch a random proxy based on specified filters.

random_proxy = manager.get_random_proxy(country_code='US', https=True)

Environment Configuration

Configure default user agent and timeout using environment variables.

export PROXY_URL_CHECKER_USER_AGENT=your_user_agent
export PROXY_URL_CHECKER_TIMEOUT=your_timeout_value

License

This project is under the MIT License - see the LICENSE file for details.

Upcoming Features

  • Proxy blacklisting
  • Additional proxy databases
  • Enhanced documentation and examples

Feel free to contribute or suggest improvements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

proxygetter-0.2.1.tar.gz (6.5 kB view details)

Uploaded Source

Built Distribution

proxygetter-0.2.1-py3-none-any.whl (8.2 kB view details)

Uploaded Python 3

File details

Details for the file proxygetter-0.2.1.tar.gz.

File metadata

  • Download URL: proxygetter-0.2.1.tar.gz
  • Upload date:
  • Size: 6.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.12.0

File hashes

Hashes for proxygetter-0.2.1.tar.gz
Algorithm Hash digest
SHA256 6a4888b555fb7ae2e03339f6b1b222951beeca59fa2694d87527fbe541c3f6d6
MD5 8394b1fa74830af86dca6938d70293da
BLAKE2b-256 384c23deee6d77b88f74bfb151b89e6ffe1c830d21c58b9e7cdbc4b2d1571e57

See more details on using hashes here.

File details

Details for the file proxygetter-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: proxygetter-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 8.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.12.0

File hashes

Hashes for proxygetter-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 013fc5d15649e16bc90a00afe9dc4c5306a1e0ea7b2d62267475839faee25cf5
MD5 ffc70334ed696aa22e7e46ef89331c64
BLAKE2b-256 94301c0db3eb25dcc4d8f32e2a4d7dab21825a698de7cd3b38e979c125abdefd

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page