Scrapy Item Pipeline to send items to RabbitMQ
Project description
A RabbitMQ Item Publisher for Scrapy Framework.
Scrapy-RabbitMQ-Publisher allows you to save publish items to RabbitMQ.
Installation
Using pip, type in your command-line prompt
pip install scrapy-rabbitmq-publisher
Or clone the repo and inside the scrapy-rabbitmq-publisher
directory, type
python setup.py install
Usage
Add following code to your scrapy settings.
RABBITMQ_HOST = "localhost"
RABBITMQ_PORT = 5672
RABBITMQ_USER = "guest"
RABBITMQ_PASSWORD = "guest"
RABBITMQ_VIRTUAL_HOST = "/"
RABBITMQ_EXCHANGE = "scrapy"
RABBITMQ_ROUTING_KEY = "item"
RABBITMQ_QUEUE = "item"
ITEM_PIPELINES = {
"scrapy_rabbitmq_publisher.pipelines.RabbitMQItemPublisherPipeline": 1,
}
Copyright & License
Copyright (c) 2019 Artem Rys - Released under The MIT License.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapy-rabbitmq-publisher-0.1.4.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2f222db6a1b7e05e0650701932c48b4238994cc965bc535aa6f9395d9d1026c6 |
|
MD5 | 86f4232067601af7c981875aae7e27ec |
|
BLAKE2b-256 | 61504d459e53ab1d4c49a3fab37dc50d5329a20940ef1be52e075131ac87f2f3 |
Close
Hashes for scrapy_rabbitmq_publisher-0.1.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d28657d22f6a55f30f96f391bdc7504728bd4a9a65761e73c5cd077e372108ee |
|
MD5 | 49961f1af4395e8151ed00a1df56c77b |
|
BLAKE2b-256 | e1e1cef7f5d9ef39c6831c33d114f13d9449a0a3b2054bd36635ea36e2702744 |