Scrapy scraperapi Proxy: scraperapi interfacing middleware for Scrapy
Project description
scrapyx-scraperapi-proxy
Scraper API middleware for Scrapy (http://scrapy.org/)
Processes Scrapy requests a man in the middle proxy service using https://www.scraperapi.com
Required
python version >= 2.7
Install
Checkout the source and run
python setup.py install
Or
pip install scrapyx-scraperapi-v2
settings.py
# Activate the middleware
SCRAPERAPI_ENABLED = True
# The API key
SCRAPERAPI_KEY='your API key'
# JS Redering
SCRAPERAPI_RENDER = False
# Premium account
SCRAPERAPI_PREMIUM = False
# Geographic Location
# 'US', 'UK', ...
SCRAPERAPI_COUNTRY_CODE = ''
DOWNLOADER_MIDDLEWARES = {
'scrapyx_scraperapi_v2.ScraperApiV2ProxyMiddleware': 610,
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapyx-scraperapi-v2-0.1.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 610d6171b73d20fe78a0fa2aa38bc395b50cf3a82999ce09db3e719d4803ec55 |
|
MD5 | 0490cfc3cfd4e930318fcdfae64fb955 |
|
BLAKE2b-256 | 5f072d72803990538171dc827fcffb9929dbeadbc2115f265f2ac74ee3c371c5 |
Close
Hashes for scrapyx_scraperapi_v2-0.1.3-py2.7.egg
Algorithm | Hash digest | |
---|---|---|
SHA256 | b6711e1bdaee3e1303ac821ba4e7ed746e0100d3636f2fbd0130a04bc68bf3c5 |
|
MD5 | 0e581efca03fa911b8fc6bc5da6b79e1 |
|
BLAKE2b-256 | 226ff722a4036c9f8ca766cd2e14ae9983128e488e6f7ba1dd5646d6f39a8c69 |