UNKNOWN
Project description
Item definition and utils for storing items in CDR format for scrapy.
Install
pip install scrapy-cdr
Usage
from scrapy_cdr import text_cdr_item def parse(response): yield text_cdr_item( response, crawler_name='my scrapy crawler', team_name='my team', metadata={'extra': 'metadata'}, # optional item_cls=MyCDRItem, # optional )
There is also scrapy_cdr.cdr_item for non-text items, and item definition in scrapy_cdr.CDRItem.
License
License is MIT.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapy-cdr-0.1.2.tar.gz
(2.4 kB
view hashes)