Skip to main content

Quickly generate a list of free and working proxies

Project description

pscrape

quickly generate a list of free and working proxies


Installation

python3 -m pip install pscrape 

Usage

>>> from pscrape import Proxies
>>>
>>> proxies = Proxies(country='US', anon='elite', https=True).scrape()
>>> proxies
['20.241.236.196:3128' '204.2.218.145:8080', '104.223.135.178:10000', '5.78.50.231:8888', '4.16.68.158:443' '104.148.86.58:3129']

Proxies class parameters:

  • country (None | str, optional): Country ISO Code. Defaults to None.
  • anon (None | str, optional): Anonymity level. Defaults to None. anonymous, elite, or transparent.
  • https (bool, optional): Https only. Defaults to False.
  • debug (bool, optional): Display scraped and validated proxies. Defaults to False.

CLI

usage: pscrape [-h] [-c COUNTRY] [-a {anonymous,elite,transparent}] [--https]
                    [-o OUTPUT_FILE]

optional arguments:
-h, --help            show this help message and exit
-c COUNTRY, --country COUNTRY
                    Country ISO Code
-a {anonymous,elite,transparent}, --anon {anonymous,elite,transparent}
                    Anonymity level
--https               Https only
-o OUTPUT_FILE, --output_file OUTPUT_FILE
                    Save list of proxies to file.

Example:

$ pscrape -c US --https -o /tmp/proxies.txt
+ Total scraped proxies:  12
> 20.241.236.196:3128    | US  | anonymous    | https
> 204.2.218.145:8080     | US  | elite proxy  | https
> 104.223.135.178:10000  | US  | elite proxy  | https
> 5.78.50.231:8888       | US  | elite proxy  | https
> 4.16.68.158:443        | US  | elite proxy  | https
> 104.148.86.58:3129     | US  | elite proxy  | https
+ Total validated proxies: 6
+ Saved proxy list to: /tmp/proxies.txt
$ cat /tmp/proxies.txt
20.241.236.196:3128
204.2.218.145:8080
104.223.135.178:10000
5.78.50.231:8888
4.16.68.158:443
104.148.86.58:3129

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pscrape-0.0.3.tar.gz (4.3 kB view hashes)

Uploaded Source

Built Distribution

pscrape-0.0.3-py3-none-any.whl (4.8 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page