Skip to main content

Send MySQL binlog event to Google Cloud Pub/Sub

Project description

MySQL binlog to Google Cloud Pub/Sub

This package allows to send MySQL binlog to Google Cloud Pub/Sub. Each binlog
event will be sent as a message.

You can use this package as a library or a command line.

It use to get binlog
event as blinker's signal.

How it works?

1. First, use pymysqlbinlog2blinker to get binlog and send to blinker's signals.
2. Subscribes the right signals (depended on configuration).
3. Pass the signal through list of filters (filters can be configured). For i.e:
It will remove column name's prefix, remove some sensitive columns. Rename
the schema or table etc,
3. On each row, make a JWT for it.
4. Send the JWT value to the pubsub topic, topic's name can be configured.

How to use?

.. code-block:: shell

mysqlbinlog2gpubsub_cli test_conf.yaml

Configuration file

Example file `example_conf.yaml <>`_

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for mysqlbinlog2gpubsub, version 1.0.7
Filename, size File type Python version Upload date Hashes
Filename, size mysqlbinlog2gpubsub-1.0.7.tar.gz (10.8 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page