Skip to main content

RabbitMQ to Solr Indexer

Project description

rabbitmq2solr

rabbitmq2solr is a simple utility that consumes messages from a RabbitMQ queue and index to Solr. Messages are expected to be JSON documents that send to Solr update endpoint. If indexing fails, the message is sent to a dead letter queue for later use. The messages that sent to DLQ, delivered as persistent messages. This job will exit when the queue is empty.

Environment Variables

  • MQ_HOST: The hostname of the RabbitMQ server.
  • MQ_PORT: The port of the RabbitMQ server. Optional. Default: 5672.
  • MQ_USER: The username to use when connecting to the RabbitMQ server.
  • MQ_PASS: The password to use when connecting to the RabbitMQ server.
  • MQ_VHOST: The virtual host to use when connecting to the RabbitMQ server.
  • MQ_QUEUE: The name of the queue to consume messages from.
  • MQ_QUEUE_DURABLE: Whether or not the queue should be durable. Optional. Default: True.
  • MQ_DLQ_EXCHANGE: The exchange of the dead letter queue to use. If index errors occur, messages will be moved to this queue.
  • MQ_DLQ_ROUTING_KEY: The routing key of the dead letter queue to use.
  • SOLR_BASE_URL: The base url of the Solr server. Example: http://localhost:8983/solr (without trailing slash).
  • SOLR_COLLECTION: The name of the Solr collection to index to. Optional. Default: Routing key of message.
  • LOG_LEVEL: The log level to use. Optional. Default: DEBUG.
  • CONSUMER_POOL_SIZE: The number of concurrent consumers to use.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

rabbitmq2solr-1.0.0-py3-none-any.whl (8.2 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page