Skip to main content

Send MySQL binlog event to Google Cloud Pub/Sub

Project description

MySQL binlog to Google Cloud Pub/Sub
====================================

This package allows to send MySQL binlog to Google Cloud Pub/Sub. Each binlog
event will be sent as a message.

You can use this package as a library or a command line.

It use https://github.com/tarzanjw/python-mysql-binlog-to-blinker to get binlog
event as blinker's signal.


How it works?
-------------

1. First, use pymysqlbinlog2blinker to get binlog and send to blinker's signals.
2. Subscribes the right signals (depended on configuration).
3. Pass the signal through list of filters (filters can be configured). For i.e:
It will remove column name's prefix, remove some sensitive columns. Rename
the schema or table etc,
3. On each row, make a JWT for it.
4. Send the JWT value to the pubsub topic, topic's name can be configured.


How to use?
-----------

.. code-block:: shell

mysqlbinlog2gpubsub_cli test_conf.yaml


Configuration file
------------------

Example file `example_conf.yaml <https://github.com/tarzanjw/python-mysql-binlog-pubsub/blob/master/example_conf.yaml>`_

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mysqlbinlog2gpubsub-1.0.7.tar.gz (10.8 kB view details)

Uploaded Source

File details

Details for the file mysqlbinlog2gpubsub-1.0.7.tar.gz.

File metadata

File hashes

Hashes for mysqlbinlog2gpubsub-1.0.7.tar.gz
Algorithm Hash digest
SHA256 c8f6d9b66618abb10630f8a150240f1ea048d3ae3ba49566ad51425c9bcdda5c
MD5 18395156963c6f9b097c56f00dd5675b
BLAKE2b-256 077778a38f6ef9643792811cac9825627b4ce7cff946dbc1a83c74c15de7ef4d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page