Item Pipeline Components for Scrapy & Gerapy
Project description
Gerapy Item Pipeline
This is a package for supporting Item Pipelines in Scrapy, also this package is a module in Gerapy.
Installation
pip3 install gerapy-item-pipeline
Usage
These are all kinds of the storage implemented.
MongoDB
MONGODB_CONNECTION_STRING = 'localhost'
MONGODB_DATABASE_NAME = 'default'
MONGODB_UPSERT = True
MONGODB_COLLECTION_NAME_FIELD = 'mongodb_collection_name'
MONGODB_COLLECTION_NAME_DEFAULT = 'default'
MONGODB_ITEM_PRIMARY_KEY_FIELD = 'primary_key'
MONGODB_ITEM_PRIMARY_KEY_DEFAULT = 'id'
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for gerapy-item-pipeline-0.1.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 640c65e434f96bc1813481724af0cca4bff74b554ea6a9e64c28ca72905f8e05 |
|
MD5 | 631ec876d5751dc8b28a7e65ca2d5528 |
|
BLAKE2b-256 | 04a6ca7dbcd9ba3dbde2bc98e647210a47bc574cc9f856b4fe634ca4a8e5d7e1 |
Close
Hashes for gerapy_item_pipeline-0.1.0-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5859c96b87702f4f3f69256247cde8e8c149281d13fb3f3ade32abebcc02e43e |
|
MD5 | bb5daa0fc94e3db563684eb1889bc789 |
|
BLAKE2b-256 | 61a78095d5e116ec6907e33ae258943802f7a7c7710040a064b410cf64b64010 |