proxy list scrapper from various websites. they gives the free proxies for temporary use.
Project description
Proxy-List-Scrapper
Proxy List Scrapper from various websites.
They gives the free proxies for temporary use.
How to use
You can clone this project from github. or use
pip install Proxy-List-Scrapper
Make sure you have installed the requests and urllib3 in python
in import add
from Proxy_List_Scrapper import Scrapper, Proxy, ScrapperException
After that simply create an object of Scrapper class as "scrapper"
scrapper = Scrapper(category=Category, print_err_trace=False)
Here Your need to specify category defined as below:
'SSL': 'https://www.sslproxies.org/',
'GOOGLE': 'https://www.google-proxy.net/',
'ANANY': 'https://free-proxy-list.net/anonymous-proxy.html',
'UK': 'https://free-proxy-list.net/uk-proxy.html',
'US': 'https://www.us-proxy.org/',
'NEW': 'https://free-proxy-list.net/',
'SPYS.ME': 'http://spys.me/proxy.txt',
'ALL': 'ALL'
These are all categories.
After you have to call a function named "getProxies"
# Get ALL Proxies According to your Choice
data = scrapper.getProxies()
the data will be returned by the above function the data is having the response data of function.
in data having proxies,len,category
- @proxies is the list of Proxy Class which has actual proxy.
- @len is the count of total proxies in @proxies.
- @category is the category of proxies defined above.
You can handle the response data as below
# Print These Scrapped Proxies
print("Scrapped Proxies:")
for item in data.proxies:
print('{}:{}'.format(item.ip, item.port))
# Print the size of proxies scrapped
print("Total Proxies")
print(data.len)
# Print the Category of proxy from which you scrapped
print("Category of the Proxy")
print(data.category)
Author
Sameer Narkhede
Profile : https://github.com/narkhedesam
Website : https://narkhedesam.github.io/
Thanks for giving free proxies we all are thankful
- https://www.sslproxies.org/
- https://www.google-proxy.net/
- https://free-proxy-list.net/anonymous-proxy.html
- https://free-proxy-list.net/uk-proxy.html
- https://www.us-proxy.org/
- https://free-proxy-list.net/
- http://spys.me/proxy.txt
Screenshot is added
Donation
If this project help you reduce time to develop, you can give me a cup of coffee :relaxed:
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Hashes for Proxy-List-Scrapper-0.1.4.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 56dcb7cc6c6d0b89e934e9ab330f23411894de45b01327d05f4b27a8e4b74af2 |
|
MD5 | 3f8028edafe20068ffa4180b0b7c4592 |
|
BLAKE2b-256 | 00b1b31a8b8c3a2d8d7c64a24a82cd09a12b0cbd6cf5e614d1a70c370fe031a3 |