About

https://travis-ci.org/povilasb/scrapy-proxy-rotator.svg?branch=master

https://coveralls.io/repos/github/povilasb/scrapy-proxy-rotator/badge.svg?branch=master:target:https://coveralls.io/github/povilasb/scrapy-proxy-rotator?branch=master

This is a Scrapy downloader middleware that sets proxy server for requests. Currently proxy servers are rotated randomly. In the future more rotation strategies will be supported.

Configuration

Scrapy settings file:

DOWNLOADER_MIDDLEWARES = {
    'scrapy_proxy_rotator.ProxyMiddleware': 1,
}

PROXY_ROTATOR = {
    'username': 'user1',
    'password': 'pass1',
    'proxies_file': 'proxies.txt',
}

In proxies file proxy server must be formatted like this http://host:port.

Release files for scrapy-proxy-rotator 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for scrapy-proxy-rotator 0.1.0
File	Size	Uploaded
scrapy-proxy-rotator-0.1.0.tar.gz	2.0 kB	Apr 25, 2016	Details

Release files / scrapy-proxy-rotator-0.1.0.tar.gz

Download URL	scrapy-proxy-rotator-0.1.0.tar.gz
Size	2.0 kB
Tags	Source
SHA-256 checksum How to use checksums	`e5af52cf003bcda44a6c2c488c09e7c95eeb88483b3c94ad971d972bc19bc6c7`
BLAKE2b-256 checksum How to use checksums	`ed857527b898ea09332f62b40c351e4e468126767c0c743db6d043a1bd4c9239`
Upload date	Apr 25, 2016
Uploaded using Trusted Publishing? What is trusted publishing?	No