Proxy Port integration with Scrapy framework.
Project description
Proxy Port integration with Scrapy framework.
Installation
$ pip install scrapyproxyport
Getting Started
# inside <your_project>/settings.py
DOWNLOADER_MIDDLEWARES = {
# Add middleware with order number right before CookiesMiddleware
'scrapyproxyport.middlewares.ProxyMiddleware': 898,
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware': 899,
}
DOWNLOAD_TIMEOUT = 10
RETRY_TIMES = 20
DUPEFILTER_CLASS = 'scrapy.dupefilters.BaseDupeFilter'
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapyproxyport-1.0.1.tar.gz
(2.9 kB
view details)
File details
Details for the file scrapyproxyport-1.0.1.tar.gz.
File metadata
- Download URL: scrapyproxyport-1.0.1.tar.gz
- Upload date:
- Size: 2.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/51.1.2 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.9.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5f044a3dc37e6e0f86c3ea4f3e9cebdb5f9b41d19a80b9d7b8dfc2e4b37725e4 |
|
| MD5 | 7783202aca49159b80b27a7ab65a3d44 |
|
| BLAKE2b-256 | 6946b14268f72dbf6478c75f9d5f5cc1c8f272f89969bc3f4e04ffab180cb546 |
