Skip to main content

proxy list scrapper from various websites. they gives the free proxies for temporary use.

Project description

Proxy-List-Scrapper

paypal



Proxy List Scrapper from various websites. They gives the free proxies for temporary use.

How to use

You can clone this project from github. or use

pip install Proxy-List-Scrapper

Make sure you have installed the requests and urllib3 in python

in import add

from Proxy_List_Scrapper import Scrapper, Proxy, ScrapperException

After that simply create an object of Scrapper class as "scrapper"

scrapper = Scrapper(category=Category, print_err_trace=False)

Here Your need to specify category defined as below:

'SSL': 'https://www.sslproxies.org/',
'GOOGLE': 'https://www.google-proxy.net/',
'ANANY': 'https://free-proxy-list.net/anonymous-proxy.html',
'UK': 'https://free-proxy-list.net/uk-proxy.html',
'US': 'https://www.us-proxy.org/',
'NEW': 'https://free-proxy-list.net/',
'SPYS.ME': 'http://spys.me/proxy.txt',
'ALL': 'ALL'

These are all categories.
After you have to call a function named "getProxies"

# Get ALL Proxies According to your Choice
data = scrapper.getProxies()

the data will be returned by the above function the data is having the response data of function.
in data having proxies,len,category

  • @proxies is the list of Proxy Class which has actual proxy.
  • @len is the count of total proxies in @proxies.
  • @category is the category of proxies defined above.

You can handle the response data as below

# Print These Scrapped Proxies
print("Scrapped Proxies:")
for item in data.proxies:
    print('{}:{}'.format(item.ip, item.port))

# Print the size of proxies scrapped
print("Total Proxies")
print(data.len)

# Print the Category of proxy from which you scrapped
print("Category of the Proxy")
print(data.category)

Author

Sameer Narkhede
Profile : https://github.com/narkhedesam
Website : https://narkhedesam.github.io/

Thanks for giving free proxies we all are thankful

Screenshot is added

Screenshot

Donation

If this project help you reduce time to develop, you can give me a cup of coffee :relaxed:

paypal

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for Proxy-List-Scrapper, version 0.1.4
Filename, size File type Python version Upload date Hashes
Filename, size Proxy-List-Scrapper-0.1.4.tar.gz (4.1 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page