A RabbitMQ provider for Apache Airflow
Project description
RabbitMQ Provider for Apache Airflow
Configuration
In the Airflow user interface, configure a connection with the Conn Type
set to RabbitMQ.
Configure the following fields:
Conn Id
: How you wish to reference this connection. The default value israbbitmq_default
.login
: Login for the RabbitMQ server.password
: Password for the RabbitMQ server.,port
: Port for the RabbitMQ server, typically 5672.host
: Host of the RabbitMQ server.vhost
: The virtual host you wish to connect to.
Modules
RabbitMQ Operator
The RabbitMQOperator
publishes a message to your specificed RabbitMQ server.
Import into your DAG using:
from rabbitmq_provider.operators.rabbitmq import RabbitMQOperator
RabbitMQ Sensor
The RabbitMQSensor
checks a given queue for a message. Once it has found a message
the sensor triggers downstream proccesses in your DAG.
Import into your DAG using:
from rabbitmq_provider.sensors.rabbitmq import RabbitMQSensor
Testing
To run unit tests, use:
poetry run pytest .
A RabbitMQ instance is required to run the tests. Use the following command:
docker run --rm -it --hostname my-rabbit -p 15672:15672 -p 5672:5672 rabbitmq:3-management
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for airflow-provider-rabbitmq-0.6.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | b941e89ac12a51972d11b49036ca73cea7699d7ea081084e987008a1eaf507a6 |
|
MD5 | 00c919056733144d92b0c430d08e85f1 |
|
BLAKE2b-256 | e8754ee630489a0dd055317ca4cd36c7e11ad82f954f1b08f78682caa4cacee3 |
Close
Hashes for airflow_provider_rabbitmq-0.6.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 84c0519597c0204b5a0f9a094ee8fe2714fd695ac0f7a5c92dec7e038f4762f4 |
|
MD5 | 39b27aa2e442e73aae299f86a5598690 |
|
BLAKE2b-256 | ecddd204a23712b7e2190657f66b81bffc5746a8e13eec480730de413b6a3c36 |