Proxy Port integration for Scrapy.
Project description
Proxy Port integration for Scrapy.
Installation
$ pip install scrapyproxyport
Getting Started
# inside <your_project>/settings.py
DOWNLOADER_MIDDLEWARES = {
# Add middleware with order number right before CookiesMiddleware
'scrapyproxyport.middlewares.ProxyMiddleware': 898,
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware': 899,
}
DOWNLOAD_TIMEOUT = 10
RETRY_TIMES = 20
DUPEFILTER_CLASS = 'scrapy.dupefilters.BaseDupeFilter'
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapyproxyport-1.0.4.tar.gz
(2.9 kB
view hashes)
