RabbitMQ to Solr Indexer
Project description
rabbitmq2solr
rabbitmq2solr is a simple utility that consumes messages from a RabbitMQ queue and index to Solr. Messages are expected to be JSON documents that send to Solr update endpoint. If indexing fails, the message is sent to a dead letter queue for later use. The messages that sent to DLQ, delivered as persistent messages. This job will exit when the queue is empty.
Environment Variables
MQ_HOST
: The hostname of the RabbitMQ server.MQ_PORT
: The port of the RabbitMQ server. Optional. Default: 5672.MQ_USER
: The username to use when connecting to the RabbitMQ server.MQ_PASS
: The password to use when connecting to the RabbitMQ server.MQ_VHOST
: The virtual host to use when connecting to the RabbitMQ server.MQ_QUEUE
: The name of the queue to consume messages from.MQ_QUEUE_DURABLE
: Whether or not the queue should be durable. Optional. Default: True.MQ_DLQ_EXCHANGE
: The exchange of the dead letter queue to use. If index errors occur, messages will be moved to this queue.MQ_DLQ_ROUTING_KEY
: The routing key of the dead letter queue to use.SOLR_BASE_URL
: The base url of the Solr server. Example: http://localhost:8983/solr (without trailing slash).SOLR_COLLECTION
: The name of the Solr collection to index to. Optional. Default: Routing key of message.LOG_LEVEL
: The log level to use. Optional. Default: DEBUG.CONSUMER_POOL_SIZE
: The number of concurrent consumers to use.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
File details
Details for the file rabbitmq2solr-1.0.0-py3-none-any.whl
.
File metadata
- Download URL: rabbitmq2solr-1.0.0-py3-none-any.whl
- Upload date:
- Size: 8.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/33.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 755b6752ae6251aaf2793200632d3d55d5b40aee54aacc9923e7b177a843d308 |
|
MD5 | 9bdeb9749fc0fd6be00792ca054b283b |
|
BLAKE2b-256 | bd2794520592532dd3f3918fbfdea07e8d303f57ec586a9c8552e72058687d9d |