ProxyCrawl API middleware for Scrapy
Processes Scrapy requests using ProxyCrawl services either with Normal or Javascript tokens
Installing
Choose a way of installing:
- Clone the repository inside your Scrapy project and run the following:
python setup.py install
- Or use PyPi Python package manager.
pip install scrapy-proxycrawl-middleware
Then in your Scrapy settings.py add the following lines:
# Activate the middleware
PROXYCRAWL_ENABLED = True
# The ProxyCrawl API token you wish to use, either normal of javascript token
PROXYCRAWL_TOKEN = 'your token'
# Enable the middleware
DOWNLOADER_MIDDLEWARES = {
'scrapy_proxycrawl.ProxyCrawlMiddleware': 610
}
If you have questions or need help using the library, please open an issue or contact us.
Copyright 2019 ProxyCrawl
1 maintainer
Metadata
1 maintainer
Release files for scrapy-proxycrawl-middleware 1.0.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| scrapy-proxycrawl-middleware-1.0.1.tar.gz | 2.3 kB | Details |
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| scrapy_proxycrawl_middleware-1.0.1-py3-none-any.whl | Python 3 | none | any | Details |
| scrapy_proxycrawl_middleware-1.0.1-py2-none-any.whl | Python 2 | none | any | Details |
Total release size: 16.4 kB
Release files / scrapy-proxycrawl-middleware-1.0.1.tar.gz
| Download URL | scrapy-proxycrawl-middleware-1.0.1.tar.gz |
|---|---|
| Size | 2.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
27678659abd6c36dd143e2a7f0dfcb34067a29cae906fb310d5bf2ad39717819
|
|
BLAKE2b-256 checksum How to use checksums |
d2847036219916d770c48341c919c3a86d2299c6dff6787333cdd0a9bf7df5f5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.4.2 requests/2.18.4 setuptools/40.7.3 requests-toolbelt/0.8.0 tqdm/4.23.4 CPython/3.6.5
|
Release files / scrapy_proxycrawl_middleware-1.0.1-py3-none-any.whl
| Download URL | scrapy_proxycrawl_middleware-1.0.1-py3-none-any.whl |
|---|---|
| Size | 7.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
8f4c81aeed66d78d0442a250af6cb028abf65c53b9b87916d9f4d925b73a5a25
|
|
BLAKE2b-256 checksum How to use checksums |
e8a12d3b42d4724166f3064ab7e50f93954f01eba6c6596f3d3094534e3fb033
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.4.2 requests/2.18.4 setuptools/40.7.3 requests-toolbelt/0.8.0 tqdm/4.23.4 CPython/3.6.5
|
Release files / scrapy_proxycrawl_middleware-1.0.1-py2-none-any.whl
| Download URL | scrapy_proxycrawl_middleware-1.0.1-py2-none-any.whl |
|---|---|
| Size | 7.1 kB |
| Tags | Python 2 |
|
SHA-256 checksum How to use checksums |
a20dafdb92454641d7f59d4c49659a4084e4d5d754750cf4d997229adcbd553a
|
|
BLAKE2b-256 checksum How to use checksums |
e62dcdf3319cca36519d2aa59eeee89bf34810bef2b56c9353a518046daadd44
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.4.2 requests/2.18.4 setuptools/40.7.3 requests-toolbelt/0.8.0 tqdm/4.23.4 CPython/3.6.5
|
