Item Pipeline Components for Scrapy & Gerapy
Project description
Gerapy Item Pipeline
This is a package for supporting Item Pipelines in Scrapy, also this package is a module in Gerapy.
Installation
pip3 install gerapy-item-pipeline
Usage
These are all kinds of the storage implemented.
MongoDB
MONGODB_CONNECTION_STRING = 'localhost'
MONGODB_DATABASE_NAME = 'default'
MONGODB_UPSERT = True
MONGODB_COLLECTION_NAME_FIELD = 'mongodb_collection_name'
MONGODB_COLLECTION_NAME_DEFAULT = 'default'
MONGODB_ITEM_PRIMARY_KEY_FIELD = 'primary_key'
MONGODB_ITEM_PRIMARY_KEY_DEFAULT = 'id'
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for gerapy-item-pipeline-0.1.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6f025ab474d934ae9053fd4ad8e5c3f142b8b4c7ee8d7f1fb5394cd15a014e0f |
|
MD5 | 7a895287e05f145a713dcbf70bd2dfe0 |
|
BLAKE2b-256 | 78b5c9fa02949d8e2e6c91a74d36f351a90ecb36433c10318b6204682f6a7b84 |
Close
Hashes for gerapy_item_pipeline-0.1.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 40761d98c11953e971d24ea27f1a4620d07fe5cb54e226077ce5aa7b5d303403 |
|
MD5 | 94c839656fdc88776390906ef51e7535 |
|
BLAKE2b-256 | 927b29a13b0fbde30b64cdd71cad8e0fe74d651f265658ff67059dcc013796d1 |