Scrapy scraperapi Proxy: scraperapi interfacing middleware for Scrapy
Project description
scrapyx-scraperapi-proxy
Scraper API middleware for Scrapy (http://scrapy.org/)
Processes Scrapy requests a man in the middle proxy service using https://www.scraperapi.com
Required
python version >= 3.6
Install
Checkout the source and run
python setup.py install
Or
pip install scrapyx-scraperapi-proxy
settings.py
# Activate the middleware
SCRAPERAPI_ENABLED = True
# The API key
SCRAPERAPI_KEY='your API key'
# JS Redering
SCRAPERAPI_RENDER = False
# Premium account
SCRAPERAPI_PREMIUM = False
# Geographic Location
# 'US', 'UK', ...
SCRAPERAPI_COUNTRY_CODE = ''
DOWNLOADER_MIDDLEWARES = {
'scrapyx_scraperapi_v2.ScraperApiV2ProxyMiddleware': 610,
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapyx-scraperapi-v2-0.1.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | ee5638d498bc4597a9d90eefce385f27ed230ec9e4f99eba200c69a19ebcd686 |
|
MD5 | 3ff575c7c04c1ce2058d423303783b39 |
|
BLAKE2b-256 | dacbd4a22d1c698545e08a6e910397f737d9424936ee7daf6a1be4311b787ed1 |
Close
Hashes for scrapyx_scraperapi_v2-0.1.1-py2.7.egg
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2373e739c3c3707db1b80af748ab04b53c4909e3a6fb3c2cc6022072909a97cd |
|
MD5 | 1393f27a78022abdcaded1973eb03a77 |
|
BLAKE2b-256 | 7b8095f538b5f397fcc1d637a76cee38c911009befe649970532799dd8059db8 |