ProxyCrawl API middleware for Scrapy
Processes Scrapy requests using ProxyCrawl services either with Normal or Javascript tokens
Installing
Choose a way of installing:
- Clone the repository inside your Scrapy project and run the following:
python setup.py install
- Or use PyPi Python package manager.
pip install scrapy-proxycrawl-middleware
Then in your Scrapy settings.py add the following lines:
# Activate the middleware
PROXYCRAWL_ENABLED = True
# The ProxyCrawl API token you wish to use, either normal of javascript token
PROXYCRAWL_TOKEN = 'your token'
# Enable the middleware
DOWNLOADER_MIDDLEWARES = {
'scrapy_proxycrawl.ProxyCrawlMiddleware': 610
}
If you have questions or need help using the library, please open an issue or contact us.
Copyright 2019 ProxyCrawl
1 maintainer
Release files for scrapy-proxycrawl-middleware 1.0.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| scrapy-proxycrawl-middleware-1.0.2.tar.gz | 2.3 kB | Details |
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| scrapy_proxycrawl_middleware-1.0.2-py3-none-any.whl | Python 3 | none | any | Details |
| scrapy_proxycrawl_middleware-1.0.2-py2-none-any.whl | Python 2 | none | any | Details |
Total release size: 16.4 kB
Release files / scrapy-proxycrawl-middleware-1.0.2.tar.gz
| Download URL | scrapy-proxycrawl-middleware-1.0.2.tar.gz |
|---|---|
| Size | 2.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
164f01dc7af7a55fb033d1249e47474e96cef161e3675adb7e6af625e1c45860
|
|
BLAKE2b-256 checksum How to use checksums |
94d85fd6ba6a72909c74e4757bc241ab1fd81f092748aa3f7b4ad1274f51a4ad
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.4.2 requests/2.18.4 setuptools/40.7.3 requests-toolbelt/0.8.0 tqdm/4.23.4 CPython/2.7.15
|
Release files / scrapy_proxycrawl_middleware-1.0.2-py3-none-any.whl
| Download URL | scrapy_proxycrawl_middleware-1.0.2-py3-none-any.whl |
|---|---|
| Size | 7.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
a7c9a9a8c57d48af2e413296415ed650856d57b6381ff81f6e6702c02df41723
|
|
BLAKE2b-256 checksum How to use checksums |
39441e0ca40d6b39e4157d32a3d160109e76d2e49b6bfd289179b0d32ceda4be
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.4.2 requests/2.18.4 setuptools/40.7.3 requests-toolbelt/0.8.0 tqdm/4.23.4 CPython/2.7.15
|
Release files / scrapy_proxycrawl_middleware-1.0.2-py2-none-any.whl
| Download URL | scrapy_proxycrawl_middleware-1.0.2-py2-none-any.whl |
|---|---|
| Size | 7.1 kB |
| Tags | Python 2 |
|
SHA-256 checksum How to use checksums |
b4295e648236ea06f770334d2446e026f5b3d41b796c3130d03f5ad1e82eeccb
|
|
BLAKE2b-256 checksum How to use checksums |
ce80103ee6fa995f9827b1bc3cda98189c5956dceb3eb0719479bbb779b0f5cf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.4.2 requests/2.18.4 setuptools/40.7.3 requests-toolbelt/0.8.0 tqdm/4.23.4 CPython/2.7.15
|
