This package provides a daemon which is able to run buildout based scrapy spider packages. (see s01.demo). The daemon processes pending crawl jobs stored in mongodb. The daemon also provides a WSGI server providing a JSON-RPC 2.0 API. The JSON-RPC proxy from the s01.client package can be used for install packages and add new crawl jobs to the mongodb which is the queue.
Changes
0.5.0 (2012-11-18)
initial implementation
Release files for s01.worker 0.5.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| s01.worker-0.5.0.zip | 73.1 kB | Details |
Release files / s01.worker-0.5.0.zip
| Download URL | s01.worker-0.5.0.zip |
|---|---|
| Size | 73.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
b8f9f72cc43bb2b3ee83563ca11275e147b4836fa0604b431a599a43e5fa086c
|
|
BLAKE2b-256 checksum How to use checksums |
651d8efc244acccf442e08a6f7e60f2565e832b001444a2208598958f107c4d7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
