Scrapy scraperapi Proxy: scraperapi interfacing middleware for Scrapy
Project description
scrapyx-scraperapi-proxy
Scraper API middleware for Scrapy (http://scrapy.org/)
Processes Scrapy requests a man in the middle proxy service using https://www.scraperapi.com
Required
python version >= 3.6
Install
Checkout the source and run
python setup.py install
Or
pip install scrapyx-scraperapi-proxy
settings.py
# Activate the middleware
SCRAPERAPI_ENABLED = True
#The API key
SCRAPERAPI_KEY='your API key'
DOWNLOADER_MIDDLEWARES = {
'scrapyx_scraperapi.ScraperApiProxyMiddleware': 610,
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapyx-scraperapi-proxy-0.1.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | b8d7319ad1a85df02de591f1b2765b08e29bd4e67e627f27e0eaab70a125eba8 |
|
MD5 | c367f047e539b8600ad637b8509f6fc1 |
|
BLAKE2b-256 | 8229c752a1a3bcab7e26c057e216f99cc35c2ff48ab6aaa0fd9bf44c893865ce |
Close
Hashes for scrapyx_scraperapi_proxy-0.1.1-py3.6.egg
Algorithm | Hash digest | |
---|---|---|
SHA256 | a954db14b4a6603b36ea60ced28082857d4b13d0ab9616a25e44126ad313b638 |
|
MD5 | 589596f1a9a7055d834515efcad19f8b |
|
BLAKE2b-256 | 73c273c1a0a408d8463219acd084a94dd8f5969b77bea16475f91b1add6e08a0 |