Skip to main content

A Python package for proxies scraping

Project description

Proxies Scraper

A Python package for searching free proxies. This package allows you to retrieve and filter proxy servers based on various criteria such as:

  • Country code.
  • Anonymity level.
  • HTTP or HTTPS type.

Table of Contents

Introduction

Proxies Scraper is a versatile Python package designed to help developers find and filter free proxy servers. It can be particularly useful for tasks such as web scraping, automated testing, and browsing with privacy.

Features

  • Filter proxies by country code.
  • Filter proxies by anonymity level.
  • Filter proxies by HTTP/HTTPS type.

Installation

You can install the package using pip:

pip install proxies_scraper

Usage

Basic Example

Get a list of all proxies.

from proxies_scraper.main import get_proxies

proxies = get_proxies()

print(proxies)

Advanced Example

Get a proxies list filtered by country code and HTTPS support.

from proxies_scraper.main import get_proxies

proxies = get_proxies(
    country_codes_filter=['US'],
    anonymity_filter=[2],
    https_filter=True
)

print(proxies)

Return Example

The get_proxies method will return the results with the following structure:

[
    {
        "ip_address": "192.168.1.1",
        "port": "8090",
        "proxy": "192.168.1.1:8090",
        "country_code": "GB",
        "country": null,
        "anonymity": 1,
        "https": false,
        "source": "webpage",
        "last_checked": 1724839341,
        "created_date": "2024-08-28 15:25:01.228439"
    }
]

Contributing

Contributions are welcome! Please follow these steps to contribute:

  1. Fork the repository.
  2. Create a new branch for your feature or bugfix.
  3. Implement your changes and ensure your code passes the tests.
  4. Commit your changes with a descriptive commit message.
  5. Push your changes to your forked repository.
  6. Create a pull request to the main repository.

Please make sure your code adheres to the project's coding standards and includes appropriate tests.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

proxies_scraper-1.0.2.tar.gz (10.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

proxies_scraper-1.0.2-py3-none-any.whl (14.1 kB view details)

Uploaded Python 3

File details

Details for the file proxies_scraper-1.0.2.tar.gz.

File metadata

  • Download URL: proxies_scraper-1.0.2.tar.gz
  • Upload date:
  • Size: 10.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.2 CPython/3.12.3 Linux/6.8.0-40-generic

File hashes

Hashes for proxies_scraper-1.0.2.tar.gz
Algorithm Hash digest
SHA256 817f09cf0a720847b28e587ed4b07ae8a3d5be8be4dfdf42ffca95ce6f687b50
MD5 8e9e7203d0b0efa29227e2de406ec805
BLAKE2b-256 73a314ccf0624c318c4bd625ce711b4503350c1a097245e45ee6f321ff5e97f7

See more details on using hashes here.

File details

Details for the file proxies_scraper-1.0.2-py3-none-any.whl.

File metadata

  • Download URL: proxies_scraper-1.0.2-py3-none-any.whl
  • Upload date:
  • Size: 14.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.2 CPython/3.12.3 Linux/6.8.0-40-generic

File hashes

Hashes for proxies_scraper-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 8503221448788e0af71075241f65854135632deef5797962e20a35a75d71044a
MD5 d51f25ec4297c1839d43c3ccf8d824de
BLAKE2b-256 343740d40999ce5203db6c9f778ea7e76f468d65c2664f74a05084fcdacb9aad

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page