Scrapy scraperapi Proxy: scraperapi interfacing middleware for Scrapy
Project description
scrapyx-scraperapi-proxy
Scraper API middleware for Scrapy (http://scrapy.org/)
Processes Scrapy requests a man in the middle proxy service using https://www.scraperapi.com
Required
python version >= 2.7
Install
Checkout the source and run
python setup.py install
Or
pip install scrapyx-scraperapi-v2
settings.py
# Activate the middleware
SCRAPERAPI_ENABLED = True
# The API key
SCRAPERAPI_KEY='your API key'
# JS Redering
SCRAPERAPI_RENDER = False
# Premium account
SCRAPERAPI_PREMIUM = False
# Geographic Location
# 'US', 'UK', ...
SCRAPERAPI_COUNTRY_CODE = ''
DOWNLOADER_MIDDLEWARES = {
'scrapyx_scraperapi_v2.ScraperApiV2ProxyMiddleware': 610,
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distributions
Close
Hashes for scrapyx_scraperapi_v2-0.1.2-py3.6.egg
Algorithm | Hash digest | |
---|---|---|
SHA256 | 219417e887ea6580b2c4d5eb2aa6ac10c13ba1e235db37f901dccc13ed414fcc |
|
MD5 | ab2a36a0afa8efda6e292f052d845138 |
|
BLAKE2b-256 | bc5d7e6f67c4d8527ea70de850babda947140b863a6eaf40449592157d230093 |
Close
Hashes for scrapyx_scraperapi_v2-0.1.2-py2.7.egg
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7e531af5b8c244bdb55f4419a2c71e406274959a1e5b0f31811368f693783b2f |
|
MD5 | ecdfa2f1877b2aeaf560aa8bf9b9706b |
|
BLAKE2b-256 | 8fa17c869945fd9d932a3de7e59573d4495bce4775490d14ad10f775f6ffabd9 |