Item Pipeline Components for Scrapy & Gerapy
Project description
Gerapy Item Pipeline
This is a package for supporting Item Pipelines in Scrapy, also this package is a module in Gerapy.
Installation
pip3 install gerapy-item-pipeline
Usage
These are all kinds of the storage implemented.
MongoDB
MONGODB_CONNECTION_STRING = 'localhost'
MONGODB_DATABASE_NAME = 'default'
MONGODB_UPSERT = True
MONGODB_COLLECTION_NAME_FIELD = 'mongodb_collection_name'
MONGODB_COLLECTION_NAME_DEFAULT = 'default'
MONGODB_ITEM_PRIMARY_KEY_FIELD = 'primary_key'
MONGODB_ITEM_PRIMARY_KEY_DEFAULT = 'id'
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for gerapy-item-pipeline-0.0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | a2a36557de7a81c17d64c5a4347f428cb8368904df83b526379d896ad0e565fe |
|
MD5 | 764bd1c74ac952378f9a314575936c80 |
|
BLAKE2b-256 | d14842ca12779e2f5be54f106bd13787707edc99c9d602b6b36d5e319ed96106 |
Close
Hashes for gerapy_item_pipeline-0.0.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ea2c8f089f03b9c3b79e9393d87adef94dbeef1db1f62db811465821c29faadd |
|
MD5 | b5c1484ec3e133f3a526aa2030ebaf8b |
|
BLAKE2b-256 | 96e8919e3b06df4204b2b70dc96c1420a668b4f16406942fd8788133f013c7bc |