Scrapy scraperapi Proxy: scraperapi interfacing middleware for Scrapy
Project description
scrapyx-scraperapi-proxy
Scraper API middleware for Scrapy (http://scrapy.org/)
Processes Scrapy requests a man in the middle proxy service using https://www.scraperapi.com
Required
python version >= 3.6
Install
Checkout the source and run
python setup.py install
Or
pip install scrapyx-scraperapi-proxy
settings.py
# Activate the middleware
SCRAPERAPI_ENABLED = True
# The API key
SCRAPERAPI_KEY='your API key'
# JS Redering
SCRAPERAPI_RENDER = False
# Premium account
SCRAPERAPI_PREMIUM = False
# Geographic Location
SCRAPERAPI_COUNTRY_CODE = '' # 'US', 'UK', ...
DOWNLOADER_MIDDLEWARES = {
'scrapyx_scraperapi.ScraperApiProxyMiddleware': 610,
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapyx-scraperapi-proxy-0.1.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2c84f2197ebe9bd79ce84aa70b18d5d55da8c3e40e0d426307be1418ba76517d |
|
MD5 | b49e96305f3b7889c57e52de46d5dd3f |
|
BLAKE2b-256 | 534e2cfcdc1fe29e003e10ca0562567805a41f67a980a322ccc08a8733e262db |
Close
Hashes for scrapyx_scraperapi_proxy-0.1.2-py3.6.egg
Algorithm | Hash digest | |
---|---|---|
SHA256 | 95cd980b1e3af0b9d0c8b79c127ef569bee4cbc5d4b6b8f6e5a822e29e14ba0f |
|
MD5 | 9ae1d6d24bef514d10cdc6592aaaf41b |
|
BLAKE2b-256 | e6d33656769578e6ec37555eeb8e020886e9c05e1ac4923bbe2c3a09f80cd472 |