Skip to main content

Middleware to easily implement Proxyland in Scrapy projects

Project description

scrapy-proxyland-middleware

scrapy-proxyland-middleware on pypi
This middleware lets you use Proxyland for every request you process with Scrapy.

Settings

You need to specify your package credentials for Proxyland in your settings.py or settings object for this middleware to take effect.

PROXYLAND = {
    'username': 'package_username',
    'password': 'package_password'
}

You need to also enable ScrapyProxylandMiddleware as well as Scrapy's HttpProxyMiddleware.

DOWNLOADER_MIDDLEWARES = {
    'scrapy_proxyland_middleware.ScrapyProxylandMiddleware': 350,
    'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware': 400,
}

Project details


Release history Release notifications | RSS feed

This version

1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapy-proxyland-middleware-1.0.tar.gz (2.9 kB view hashes)

Uploaded source

Built Distribution

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page