proxy list scrapper from various websites. they gives the free proxies for temporary use.
Project description
Proxy-List-Scrapper
Proxy List Scrapper from various websites. They gives the free proxies for temporary use.
How to use
Just Download the code and place in your project.
Make sure you have installed the requests and urllib3 in python
in import add
from Proxy_List_Scrapper import Scrapper, Proxy, ScrapperException
After that simply create an object of Scrapper class as "scrapper"
scrapper = Scrapper(category=Category, print_err_trace=False)
Here Your need to specify category defined as below:
'SSL': 'https://www.sslproxies.org/',
'GOOGLE': 'https://www.google-proxy.net/',
'ANANY': 'https://free-proxy-list.net/anonymous-proxy.html',
'UK': 'https://free-proxy-list.net/uk-proxy.html',
'US': 'https://www.us-proxy.org/',
'NEW': 'https://free-proxy-list.net/',
'SPYS.ME': 'http://spys.me/proxy.txt',
'ALL': 'ALL'
These are all categories.
After you have to call a function named "getProxies"
# Get ALl Proxies According to your Choice
data = scrapper.getProxies()
the data will be returned by the above function the data is having the response data of function.
in data having proxies,len,category
- @proxies is the list of Proxy Class which has actual proxy.
- @len is the count of total proxies in @proxies.
- @category is the category of proxies defined above.
You can handle the response data as below
# Print These Scrapped Proxies
print("Scrapped Proxies:")
for item in data.proxies:
print('{}:{}'.format(item.ip, item.port))
# Print the size of proxies scrapped
print("Total Proxies")
print(data.len)
# Print the Category of proxy from which you scrapped
print("Category of the Proxy")
print(data.category)
Author
Sameer Narkhede
Profile : https://github.com/narkhedesam
Website : https://narkhedesam.github.io/
Thanks for giving free proxies we all are thankful
- https://www.sslproxies.org/
- https://www.google-proxy.net/
- https://free-proxy-list.net/anonymous-proxy.html
- https://free-proxy-list.net/uk-proxy.html
- https://www.us-proxy.org/
- https://free-proxy-list.net/
- http://spys.me/proxy.txt
Screenshot is added
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Hashes for Proxy-List-Scrapper-0.1.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | e418d3d0503bdb0a8c81f2f40c184de2b8921ff9a1ec4a11a069e489ae282015 |
|
MD5 | 1a2bb8af27d54883a416bce610a0a7bf |
|
BLAKE2b-256 | 4b90cf6183a6765c88c91677cc5e2d0c4cee6b527140da632914c3b829a05325 |