Item Pipeline Components for Scrapy & Gerapy
Project description
Gerapy Item Pipeline
This is a package for supporting Item Pipelines in Scrapy, also this package is a module in Gerapy.
Installation
pip3 install gerapy-item-pipeline
Usage
These are all kinds of the storage implemented.
MongoDB
MONGODB_CONNECTION_STRING = 'localhost'
MONGODB_DATABASE_NAME = 'default'
MONGODB_UPSERT = True
MONGODB_COLLECTION_NAME_FIELD = 'mongodb_collection_name'
MONGODB_COLLECTION_NAME_DEFAULT = 'default'
MONGODB_ITEM_PRIMARY_KEY_FIELD = 'primary_key'
MONGODB_ITEM_PRIMARY_KEY_DEFAULT = 'id'
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for gerapy-item-pipeline-0.0.2.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | fa4ac59823574c182bcf1d3961455f36730543a688d6d92c58e6fe5c3447f9fc |
|
| MD5 | 7fb73aade58b7135cedb04c38117ab2a |
|
| BLAKE2b-256 | d87b4bae1cc79d21859154a8160e5944a46403e872708b620d343f3938f28efa |
Close
Hashes for gerapy_item_pipeline-0.0.2-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | bd5c424483f33d2d023f697ce0b45c45dc79a1b4109f0acf0362a987bb806b08 |
|
| MD5 | aa70d3ea0cbe4ca6448e0a7bf6f45a10 |
|
| BLAKE2b-256 | f172b1977531be621aead724548479b034ed21027a495f33eaee27a01dfb6bf5 |
