Proxy Port integration for Scrapy. About Proxy Port
Prerequisites
To use this package you will need a free API key. Get your API key here. Detailed instructions here.
Installation
$ pip install scrapyproxyport
Getting Started
You need to assign an API key. This can be done either through an environment variable
$ export PROXY_PORT_API_KEY=<API_KEY>
or inside settings.py.
# inside <your_project>/settings.py
PROXY_PORT_API_KEY = '<API_KEY>'
DOWNLOADER_MIDDLEWARES = {
# Add middleware with order number right before CookiesMiddleware
'scrapyproxyport.middlewares.ProxyMiddleware': 898,
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware': 899,
}
DOWNLOAD_TIMEOUT = 10
RETRY_TIMES = 20
DUPEFILTER_CLASS = 'scrapy.dupefilters.BaseDupeFilter'
Example Scrapy project
1 maintainer
Metadata
1 maintainer
Release files for scrapyproxyport 1.1.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| scrapyproxyport-1.1.1.tar.gz | 4.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| scrapyproxyport-1.1.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 9.9 kB
Release files / scrapyproxyport-1.1.1.tar.gz
| Download URL | scrapyproxyport-1.1.1.tar.gz |
|---|---|
| Size | 4.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
1be9633479c04ca34aa074aefa1fad06fb39b206006f1072e4814cad5b5a4347
|
|
BLAKE2b-256 checksum How to use checksums |
d1f9068500a949f86849a1d8051bb85990023df82a6d94a20e9562968c3d2156
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.10.9
|
Release files / scrapyproxyport-1.1.1-py3-none-any.whl
| Download URL | scrapyproxyport-1.1.1-py3-none-any.whl |
|---|---|
| Size | 5.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
351899ab71c67f4025124c7f17b1653758ceb3a4425fbff0559f7b677a2f28bf
|
|
BLAKE2b-256 checksum How to use checksums |
ee0a4e45b4a67aecbeb8c5bdd798349b27c8f624d11fd3480acdf73fb4c3cf5e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.10.9
|
