MySQL binlog to Google Cloud Pub/Sub
====================================
This package allows to send MySQL binlog to Google Cloud Pub/Sub. Each binlog
event will be sent as a message.
You can use this package as a library or a command line.
It use https://github.com/tarzanjw/python-mysql-binlog-to-blinker to get binlog
event as blinker's signal.
How it works?
-------------
1. First, use pymysqlbinlog2blinker to get binlog and send to blinker's signals.
2. Subscribes the right signals (depended on configuration).
3. Pass the signal through list of filters (filters can be configured). For i.e:
It will remove column name's prefix, remove some sensitive columns. Rename
the schema or table etc,
3. On each row, make a JWT for it.
4. Send the JWT value to the pubsub topic, topic's name can be configured.
How to use?
-----------
.. code-block:: shell
mysqlbinlog2gpubsub_cli test_conf.yaml
Configuration file
------------------
Example file `example_conf.yaml <https://github.com/tarzanjw/python-mysql-binlog-pubsub/blob/master/example_conf.yaml>`_
====================================
This package allows to send MySQL binlog to Google Cloud Pub/Sub. Each binlog
event will be sent as a message.
You can use this package as a library or a command line.
It use https://github.com/tarzanjw/python-mysql-binlog-to-blinker to get binlog
event as blinker's signal.
How it works?
-------------
1. First, use pymysqlbinlog2blinker to get binlog and send to blinker's signals.
2. Subscribes the right signals (depended on configuration).
3. Pass the signal through list of filters (filters can be configured). For i.e:
It will remove column name's prefix, remove some sensitive columns. Rename
the schema or table etc,
3. On each row, make a JWT for it.
4. Send the JWT value to the pubsub topic, topic's name can be configured.
How to use?
-----------
.. code-block:: shell
mysqlbinlog2gpubsub_cli test_conf.yaml
Configuration file
------------------
Example file `example_conf.yaml <https://github.com/tarzanjw/python-mysql-binlog-pubsub/blob/master/example_conf.yaml>`_
1 maintainer
Release files for mysqlbinlog2gpubsub 1.0.7
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| mysqlbinlog2gpubsub-1.0.7.tar.gz | 10.8 kB | Details |
Release files / mysqlbinlog2gpubsub-1.0.7.tar.gz
| Download URL | mysqlbinlog2gpubsub-1.0.7.tar.gz |
|---|---|
| Size | 10.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c8f6d9b66618abb10630f8a150240f1ea048d3ae3ba49566ad51425c9bcdda5c
|
|
BLAKE2b-256 checksum How to use checksums |
077778a38f6ef9643792811cac9825627b4ce7cff946dbc1a83c74c15de7ef4d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
