Skip to main content

0.1.7

Project description

Mercator - Data Mapper for Protobuf
===================================

``version 0.1.7``

Python DSL to leverage translation of dictionaries and SQLAlchemy into Protobuf objects

.. image:: https://img.shields.io/pypi/pyversions/mercator.svg
:target: https://pypi.python.org/pypi/mercator
:alt: PyPi Project Page
.. image:: https://travis-ci.org/NewStore/mercator.svg?branch=master
:target: https://travis-ci.org/NewStore/mercator
:alt: Travis Build
.. image:: https://readthedocs.org/projects/mercator/badge/?version=latest
:target: http://mercator.readthedocs.io/en/latest/?badge=latest
:alt: Documentation Status
.. image:: https://codecov.io/gh/NewStore/mercator/branch/master/graph/badge.svg
:target: https://codecov.io/gh/NewStore/mercator
:alt: Test Coverage Reports


What is Mercator ?
------------------

Mercator is a Python library that simplifies the following of
serializing dictionary data into Protobuf binary data.

Mercator actually supports extracting data from:

- dictionaries
- SQLAlchemy model instances
- Any opaque python objects (e.g.: :py:class:`~collections.namedtuple`)


When should I use Mercator ?
~~~~~~~~~~~~~~~~~~~~~~~~~~~~

- When migrating custom implementations of RPC to gGRPC.
- When migrating in-memory data to Protobuf.


When should I **not** use Mercator ?
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


- When writing gRPC services from scratch.
- When writing anything that uses Protobuf gets called.


Install
-------

.. code:: bash

pip install mercator


Documentation
-------------

`https://mercator.readthedocs.org <https://mercator.readthedocs.org>`_


Basic Usage
-----------


1. Given a protobuf declaration
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


.. code:: protobuf

syntax = "proto3";
package services.social_platform;

import "google/protobuf/timestamp.proto";

message User {
message AuthToken {
string value = 1;
google.protobuf.Timestamp created_at = 2;
google.protobuf.Timestamp expires_at = 3;
}
}


2. Declare Mappings
~~~~~~~~~~~~~~~~~~~

.. code:: python


from mercator import (
ProtoMapping,
ProtoKey,
ProtoList,
SinglePropertyMapping,
)
from google.protobuf.timestamp_pb2 import Timestamp
from google.protobuf.struct_pb2 import Struct
from google.protobuf import struct_pb2


ProtobufTimestamp = SinglePropertyMapping(int, Timestamp, 'seconds')

class UserAuthTokenMapping(ProtoMapping):
__proto__ = domain_pb2.User.AuthToken
value = ProtoKey('data', str)
created_at = ProtoKey('created_at', ProtobufTimestamp)
expires_at = ProtoKey('expires_at', ProtobufTimestamp)


class UserMapping(ProtoMapping):
__proto__ = domain_pb2.User

tokens = ProtoList('tokens', UserAuthTokenMapping)


3. Generate python files
~~~~~~~~~~~~~~~~~~~~~~~~

.. code:: shell

python -m grpc_tools.protoc -I ./ --python_out=./ --grpc_python_out=./ ./*.proto


4. Process data!
~~~~~~~~~~~~~~~~

.. code:: python


info = {
'login': 'Hulk',
'email': 'bruce@avengers.world',
'tokens': [
{
'data': 'this is the token',
'created_at': 1552240433,
'expires_at': 1552240733,
}
],
}

user = UserMapping(info).to_protobuf()

assert isinstance(user, domain_pb2.User)


Contributing
------------

#. Check the `code structure documentation <CODE_STRUCTURE.rst>`_
#. Write tests
#. Write code
#. Send a pull-request

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mercator-0.1.7.tar.gz (9.6 kB view details)

Uploaded Source

File details

Details for the file mercator-0.1.7.tar.gz.

File metadata

  • Download URL: mercator-0.1.7.tar.gz
  • Upload date:
  • Size: 9.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.3

File hashes

Hashes for mercator-0.1.7.tar.gz
Algorithm Hash digest
SHA256 eda5c585aa39ff4cdb900cfbdecf9fc87c834dd5f1bf34dacf991d54256e8837
MD5 040715ddfb4a02b1887376342b145fcc
BLAKE2b-256 63d0c367135da657a4f598040ebf2db77880b227a7726eab5fcbefb31238745f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page