Item Pipeline Components for Scrapy & Gerapy
Project description
Gerapy Item Pipeline
This is a package for supporting Item Pipelines in Scrapy, also this package is a module in Gerapy.
Installation
pip3 install gerapy-item-pipeline
Usage
These are all kinds of the storage implemented.
MongoDB
MONGODB_CONNECTION_STRING = 'localhost'
MONGODB_DATABASE_NAME = 'default'
MONGODB_UPSERT = True
MONGODB_COLLECTION_NAME_FIELD = 'mongodb_collection_name'
MONGODB_COLLECTION_NAME_DEFAULT = 'default'
MONGODB_ITEM_PRIMARY_KEY_FIELD = 'primary_key'
MONGODB_ITEM_PRIMARY_KEY_DEFAULT = 'id'
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for gerapy-item-pipeline-0.1.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 42070a9550c1b6e19e790b1c745c9c9b9b7eb37ecdafa32cd2fba5d33a598463 |
|
MD5 | 29e8c82c2f123d3116d4681c9ba05fa2 |
|
BLAKE2b-256 | ef44a0ca4167145b4e785461426160875a91a29eb9d090476a3b5b242f3aa10d |
Close
Hashes for gerapy_item_pipeline-0.1.3-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f706c8ef68df34e5f725a920abbad81bec0790daaa6c45eca7de60548e639fae |
|
MD5 | 9389118d4b4877e131e92c1ffb7e55fb |
|
BLAKE2b-256 | 949b2da82a4e4e88f5d5c0e97e2470bde5bae92e220cd70338848ea46e12225e |