Skip to main content

RabbitMQ to Solr Indexer

Project description

rabbitmq2solr

rabbitmq2solr is a simple utility that consumes messages from a RabbitMQ queue and index to Solr. Messages are expected to be JSON documents that send to Solr update endpoint. If indexing fails, the message is sent to a dead letter queue for later use. The messages that sent to DLQ, delivered as persistent messages. This job will exit when the queue is empty.

Environment Variables

  • MQ_HOST: The hostname of the RabbitMQ server.
  • MQ_PORT: The port of the RabbitMQ server. Optional. Default: 5672.
  • MQ_USER: The username to use when connecting to the RabbitMQ server.
  • MQ_PASS: The password to use when connecting to the RabbitMQ server.
  • MQ_VHOST: The virtual host to use when connecting to the RabbitMQ server.
  • MQ_QUEUE: The name of the queue to consume messages from.
  • MQ_QUEUE_DURABLE: Whether or not the queue should be durable. Optional. Default: True.
  • MQ_DLQ_EXCHANGE: The exchange of the dead letter queue to use. If index errors occur, messages will be moved to this queue.
  • MQ_DLQ_ROUTING_KEY: The routing key of the dead letter queue to use.
  • SOLR_BASE_URL: The base url of the Solr server. Example: http://localhost:8983/solr (without trailing slash).
  • SOLR_COLLECTION: The name of the Solr collection to index to. Optional. Default: Routing key of message.
  • LOG_LEVEL: The log level to use. Optional. Default: DEBUG.
  • CONSUMER_POOL_SIZE: The number of concurrent consumers to use.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

rabbitmq2solr-1.0.0-py3-none-any.whl (8.2 kB view details)

Uploaded Python 3

File details

Details for the file rabbitmq2solr-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: rabbitmq2solr-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 8.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/33.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10

File hashes

Hashes for rabbitmq2solr-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 755b6752ae6251aaf2793200632d3d55d5b40aee54aacc9923e7b177a843d308
MD5 9bdeb9749fc0fd6be00792ca054b283b
BLAKE2b-256 bd2794520592532dd3f3918fbfdea07e8d303f57ec586a9c8552e72058687d9d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page