Skip to main content

proxy list scrapper from various websites. they gives the free proxies for temporary use.

Project description

Proxy-List-Scrapper

Proxy List Scrapper from various websites. They gives the free proxies for temporary use.

How to use

Just Download the code and place in your project.

Make sure you have installed the requests and urllib3 in python

in import add

from Proxy_List_Scrapper import Scrapper, Proxy, ScrapperException

After that simply create an object of Scrapper class as "scrapper"

scrapper = Scrapper(category=Category, print_err_trace=False)

Here Your need to specify category defined as below:

'SSL': 'https://www.sslproxies.org/',
'GOOGLE': 'https://www.google-proxy.net/',
'ANANY': 'https://free-proxy-list.net/anonymous-proxy.html',
'UK': 'https://free-proxy-list.net/uk-proxy.html',
'US': 'https://www.us-proxy.org/',
'NEW': 'https://free-proxy-list.net/',
'SPYS.ME': 'http://spys.me/proxy.txt',
'ALL': 'ALL'

These are all categories.
After you have to call a function named "getProxies"

# Get ALl Proxies According to your Choice
data = scrapper.getProxies()

the data will be returned by the above function the data is having the response data of function.
in data having proxies,len,category

  • @proxies is the list of Proxy Class which has actual proxy.
  • @len is the count of total proxies in @proxies.
  • @category is the category of proxies defined above.

You can handle the response data as below

# Print These Scrapped Proxies
print("Scrapped Proxies:")
for item in data.proxies:
    print('{}:{}'.format(item.ip, item.port))

# Print the size of proxies scrapped
print("Total Proxies")
print(data.len)

# Print the Category of proxy from which you scrapped
print("Category of the Proxy")
print(data.category)

Author

Sameer Narkhede
Profile : https://github.com/narkhedesam
Website : https://narkhedesam.github.io/

Thanks for giving free proxies we all are thankful

Screenshot is added

Screenshot

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Proxy-List-Scrapper-0.1.1.tar.gz (3.7 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page