Proxy Port integration for Scrapy.
Project description
Proxy Port integration for Scrapy.
Installation
$ pip install scrapyproxyport
Getting Started
# inside <your_project>/settings.py
DOWNLOADER_MIDDLEWARES = {
# Add middleware with order number right before CookiesMiddleware
'scrapyproxyport.middlewares.ProxyMiddleware': 898,
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware': 899,
}
DOWNLOAD_TIMEOUT = 10
RETRY_TIMES = 20
DUPEFILTER_CLASS = 'scrapy.dupefilters.BaseDupeFilter'
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapyproxyport-1.0.4.tar.gz
(2.9 kB
view details)
File details
Details for the file scrapyproxyport-1.0.4.tar.gz.
File metadata
- Download URL: scrapyproxyport-1.0.4.tar.gz
- Upload date:
- Size: 2.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/51.1.2 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.9.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 0a395c3ad8f1a12c0f14fcd0d999f06c63b7cc6121dec0a204e061c31abe7d53 |
|
| MD5 | 9eb90a42e20f6da942ef351055431279 |
|
| BLAKE2b-256 | 2a8cd9c21cf3ecd4011afe2cb3e4bcda7ea2d1853af842b5adbf05760dd0298d |
