scrapy-proxycrawl-middleware 1.0.2

Scrapy ProxyCrawl Proxy Middleware: ProxyCrawl interfacing middleware for Scrapy

ProxyCrawl API middleware for Scrapy

Processes Scrapy requests using ProxyCrawl services either with Normal or Javascript tokens

Installing

Choose a way of installing:

• Clone the repository inside your Scrapy project and run the following:

python setup.py install

• Or use PyPi Python package manager. pip install scrapy-proxycrawl-middleware

Then in your Scrapy settings.py add the following lines:

# Activate the middleware
PROXYCRAWL_ENABLED = True

# The ProxyCrawl API token you wish to use, either normal of javascript token
PROXYCRAWL_TOKEN = 'your token'

# Enable the middleware
DOWNLOADER_MIDDLEWARES = {
    'scrapy_proxycrawl.ProxyCrawlMiddleware': 610
}

If you have questions or need help using the library, please open an issue or contact us.

---

Copyright 2019 ProxyCrawl