A Python Proxy Scraper for gathering fresh proxies.
Project description
ProxyEater[1.3.0]
A Python Proxy Scraper for gathering fresh proxies.
Install ProxyEater
To install ProxyEater, you can simply use the pip install ProxyEater
command:
python -m pip install ProxyEater
Or you can clone the repository and run:
git clone https://github.com/MPCodeWriter21/ProxyEater
cd ProxyEater
python setup.py install
Usage
usage: ProxyEater [-h] [--source SOURCE] [--output OUTPUT] [--format { text, json, csv }]
[--threads THREADS] [--include-status] [--verbose] [--quiet] [--version]
[--timeout TIMEOUT] [--proxy PROXY] [--proxy-type PROXY_TYPE] [--useragent
USERAGENT] [--include-geolocation] [--source-format { text, json, csv }]
[--default-type { http, https, socks4, socks5 }]
mode
positional arguments:
mode Modes: Scrape, Check
options:
-h, --help
show this help message and exit
--source SOURCE, -s SOURCE
The source of the proxies(default:*\Python\Python310\lib\site-packages\ProxyEater\sources.json).
--output OUTPUT, -o OUTPUT
The output file.
--format { text, json, csv }, -f { text, json, csv }
The format of the output file(default:text).
--threads THREADS, -t THREADS
The number of threads to use for scraping(default:25).
--include-status, -is
Include the status of the proxies in the output file.
--verbose, -v
The verbose of the program(default:False).
--quiet, -q
The quiet of the program(default:False).
--version, -V
The version of the program.
--timeout TIMEOUT, -to TIMEOUT
The timeout of the requests(default:15).
Scrape:
Scrape mode arguments
--proxy PROXY, -p PROXY
The proxy to use for scraping.
--proxy-type PROXY_TYPE, -type PROXY_TYPE
The type of the proxies(default:all).
--useragent USERAGENT, -ua USERAGENT
The useragent of the requests(default:random).
--include-geolocation, -ig
Include the geolocation info of the proxies in the output file.
Check:
Check mode arguments
--source-format { text, json, csv }, -sf { text, json, csv }
The format of the source file(default:text).
--default-type { http, https, socks4, socks5 }, -dt { http, https, socks4, socks5 }
The default type of the proxies - Use this if you are providing proxies
without scheme(default:http).
About
Author: CodeWriter21 (Mehrad Pooryoussof)
GitHub: MPCodeWriter21
Telegram Channel: @CodeWriter21
Aparat Channel: CodeWriter21
License
Donate
In order to support this project you can donate some crypto of your choice 8D
Or if you can't, give this project a star on GitHub :)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ProxyEater-1.3.0.tar.gz
(16.8 kB
view hashes)
Built Distribution
ProxyEater-1.3.0-py3-none-any.whl
(17.4 kB
view hashes)
Close
Hashes for ProxyEater-1.3.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2543207f41ebe5bfb051bb6ae0293c6893ee1dd8080cc42884aeb15ccf1505b6 |
|
MD5 | 6f2fdd7d9029ba7f91a45843236ef39c |
|
BLAKE2b-256 | 7c820213f5145d127e40d9d1aa6fa7f24e3a704a2644da08f9d8008bee260f1b |