Skip to main content

Package for buildout based scrapy spider development

Project description

This package provides some core component for buildout based scrapy spider development. Such scrapy spider packages can get installed, scheduled and processed with the mongodb based s01.worker daemon using the JSON-RPC proxy located in the s01.client package. The package also provides some recipes which allows to use external files as scrapy settings.

Changes

0.0.4 (2010-12-22)

  • alpha version released for development and testing the tool chain

  • remove spider name from crawl recipe

0.0.3 (2010-11-29)

  • alpha version released for development and testing the tool chain

  • fix hex data parts in settings content

  • use s01.worker as default logging handler name

0.0.2 (2010-11-29)

  • alpha version released for development and testing the tool chain

  • added settings recipe

0.0.1 (2010-11-21)

  • alpha version released for development and testing the tool chain

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

s01.scrapy-0.0.4.zip (17.3 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page