scrapy-proxyland-middleware 1.0

Middleware to easily implement Proxyland in Scrapy projects

scrapy-proxyland-middleware

This middleware lets you use Proxyland for every request you process with Scrapy.

Settings

You need to specify your package credentials for Proxyland in your settings.py or settings object for this middleware to take effect.

PROXYLAND = {
    'username': 'package_username',
    'password': 'package_password'
}

You need to also enable ScrapyProxylandMiddleware as well as Scrapy's HttpProxyMiddleware.

DOWNLOADER_MIDDLEWARES = {
    'scrapy_proxyland_middleware.ScrapyProxylandMiddleware': 350,
    'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware': 400,
}