Skip to main content

Proxy list scrapper from various websites. They gives the free proxies for temporary use.

Project description

Proxy-List-Scrapper

demo live example using javascript

paypal Proxy-List-Scrapper licence Proxy-List-Scrapper forks Proxy-List-Scrapper stars Proxy-List-Scrapper issues Proxy-List-Scrapper pull-requests



Proxy List Scrapper from various websites. They gives the free proxies for temporary use.

What is a proxy

A proxy is server that acts like a gateway or intermediary between any device and the rest of the internet. A proxy accepts and forwards connection requests, then returns data for those requests. This is the basic definition, which is quite limited, because there are dozens of unique proxy types with their own distinct configurations.

What are the most popular types of proxies:

Residential proxies, Datacenter proxies, Anonymous proxies, Transparent proxies

People use proxies to:

Avoid Geo-restrictions, Protect Privacy and Increase Security, Avoid Firewalls and Bans, Automate Online Processes, Use Multiple Accounts and Gather Data

Chrome Extension in here

you can download the chrome extension "Free Proxy List Scrapper Chrome Extension" folder and load in the extension.

Goto Chrome Extension click here.

Web_Scrapper Module here

Web Scrapper is proxy web scraper using proxy rotating api https://scrape.do
you can check official documentation from here

You can send request to any webpages with proxy gateway & web api provided by scrape.do


## How to use Proxy List Scrapper You can clone this project from github. or use
pip install Proxy-List-Scrapper

Make sure you have installed the requests and urllib3 in python

in import add

from Proxy_List_Scrapper import Scrapper, Proxy, ScrapperException

After that simply create an object of Scrapper class as "scrapper"

scrapper = Scrapper(category=Category, print_err_trace=False)

Here Your need to specify category defined as below:

SSL = 'https://www.sslproxies.org/',
GOOGLE = 'https://www.google-proxy.net/',
ANANY = 'https://free-proxy-list.net/anonymous-proxy.html',
UK = 'https://free-proxy-list.net/uk-proxy.html',
US = 'https://www.us-proxy.org/',
NEW = 'https://free-proxy-list.net/',
SPYS_ME = 'http://spys.me/proxy.txt',
PROXYSCRAPE = 'https://api.proxyscrape.com/?request=getproxies&proxytype=all&country=all&ssl=all&anonymity=all',
PROXYNOVA = 'https://www.proxynova.com/proxy-server-list/'
PROXYLIST_DOWNLOAD_HTTP = 'https://www.proxy-list.download/HTTP'
PROXYLIST_DOWNLOAD_HTTPS = 'https://www.proxy-list.download/HTTPS'
PROXYLIST_DOWNLOAD_SOCKS4 = 'https://www.proxy-list.download/SOCKS4'
PROXYLIST_DOWNLOAD_SOCKS5 = 'https://www.proxy-list.download/SOCKS5'
ALL = 'ALL'

These are all categories.
After you have to call a function named "getProxies"

# Get ALL Proxies According to your Choice
data = scrapper.getProxies()

the data will be returned by the above function the data is having the response data of function.
in data having proxies,len,category

  • @proxies is the list of Proxy Class which has actual proxy.
  • @len is the count of total proxies in @proxies.
  • @category is the category of proxies defined above.

You can handle the response data as below

# Print These Scrapped Proxies
print("Scrapped Proxies:")
for item in data.proxies:
    print('{}:{}'.format(item.ip, item.port))

# Print the size of proxies scrapped
print("Total Proxies")
print(data.len)

# Print the Category of proxy from which you scrapped
print("Category of the Proxy")
print(data.category)

Author

Sameer Narkhede

https://github.com/narkhedesam https://narkhedesam.com/ https://www.linkedin.com/in/sameer-narkhede/ https://www.facebook.com/narkhedesam https://www.instagram.com/sam_narkhede/ https://t.me/narkhedesam

Thanks for giving free proxies

Take a look here

Screenshot

Donation

If this project help you reduce time to develop, you can give me a cup of coffee :relaxed:

paypal

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Proxy-List-Scrapper-0.2.2.tar.gz (7.3 kB view hashes)

Uploaded source

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page