Item Pipeline Components for Scrapy & Gerapy
Project description
Gerapy Item Pipeline
This is a package for supporting Item Pipelines in Scrapy, also this package is a module in Gerapy.
Installation
pip3 install gerapy-item-pipeline
Usage
These are all kinds of the storage implemented.
MongoDB
MONGODB_CONNECTION_STRING = 'localhost'
MONGODB_DATABASE_NAME = 'default'
MONGODB_UPSERT = True
MONGODB_COLLECTION_NAME_FIELD = 'mongodb_collection_name'
MONGODB_COLLECTION_NAME_DEFAULT = 'default'
MONGODB_ITEM_PRIMARY_KEY_FIELD = 'primary_key'
MONGODB_ITEM_PRIMARY_KEY_DEFAULT = 'id'
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file gerapy-item-pipeline-0.1.3.tar.gz.
File metadata
- Download URL: gerapy-item-pipeline-0.1.3.tar.gz
- Upload date:
- Size: 3.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.29.0 requests-toolbelt/0.9.1 tqdm/4.65.0 CPython/3.9.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 42070a9550c1b6e19e790b1c745c9c9b9b7eb37ecdafa32cd2fba5d33a598463 |
|
| MD5 | 29e8c82c2f123d3116d4681c9ba05fa2 |
|
| BLAKE2b-256 | ef44a0ca4167145b4e785461426160875a91a29eb9d090476a3b5b242f3aa10d |
File details
Details for the file gerapy_item_pipeline-0.1.3-py2.py3-none-any.whl.
File metadata
- Download URL: gerapy_item_pipeline-0.1.3-py2.py3-none-any.whl
- Upload date:
- Size: 3.3 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.29.0 requests-toolbelt/0.9.1 tqdm/4.65.0 CPython/3.9.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | f706c8ef68df34e5f725a920abbad81bec0790daaa6c45eca7de60548e639fae |
|
| MD5 | 9389118d4b4877e131e92c1ffb7e55fb |
|
| BLAKE2b-256 | 949b2da82a4e4e88f5d5c0e97e2470bde5bae92e220cd70338848ea46e12225e |
