Skip to main content

DOI

Transmutate

Transmutate is a Python library designed to handle dataclass serialization and deserialization across various formats such as JSON, JSONB, and Protocol Buffers (Proto). The library supports both conversion to these formats and validation of dataclass fields.

Features

  • JSON Serialization: Convert dataclasses to and from JSON format.
  • JSONB Serialization: Convert dataclasses to and from JSONB format, a compact version of JSON.
  • Protocol Buffers Serialization: Generate Proto definitions from dataclasses.
  • Field Validation: Custom validation for dataclass fields using validation_<field> methods.
  • Service Definitions: Define gRPC services with customizable RPC methods.
  • Proto Generator: Automatically generate Proto files including service and message definitions.
  • Easy Integration: Built on top of Python's dataclasses, allowing seamless integration with existing codebases.

Installation

You can install Transmutate via Poetry by adding it to your pyproject.toml file or by using the following command:

poetry add transmutate

Alternatively, if you're using pip, you can install it with:

pip install transmutate

Usage

Below are some examples demonstrating how to use Transmutate with simple dataclasses.

Defining a Dataclass

You can define your dataclasses using the BaseModel from Transmutate, which provides built-in serialization and validation capabilities.

from dataclasses import dataclass, field
from typing import List, Optional
from transmutate.base_model import BaseModel

class Person(BaseModel):
    name: str
    age: int
    email: Optional[str] = None
    phone_numbers: List[str] = field(default_factory=list)

    def validation_age(self):
        if not (0 <= self.age <= 120):
            raise ValueError("Age must be between 0 and 120.")

    def validation_email(self):
        if self.email and "@" not in self.email:
            raise ValueError("Invalid email address.")

JSON Serialization

Convert a dataclass instance to JSON:

person = Person(name="John Doe", age=30, email="john.doe@example.com")
json_data = person.to_json()
print(json_data)

Output:

{
    "name": "John Doe",
    "age": 30,
    "email": "john.doe@example.com",
    "phone_numbers": []
}

Parse a JSON string back to a dataclass instance:

person_from_json = Person.from_json(json_data)
print(person_from_json)

JSONB Serialization

Convert a dataclass instance to JSONB:

jsonb_data = person.to_jsonb()
print(jsonb_data)

Output:

{"name":"John Doe","age":30,"email":"john.doe@example.com","phone_numbers":[]}

Parse a JSONB string back to a dataclass instance:

person_from_jsonb = Person.from_jsonb(jsonb_data)
print(person_from_jsonb)

Proto Serialization

Generate a Proto definition from a dataclass:

proto_definition = person.to_proto()
print(proto_definition)

Output:

syntax = "proto3";

message Person {
  string name = 1;
  int32 age = 2;
  string email = 3;
  repeated string phone_numbers = 4;
}

Custom Validation

You can define custom validation logic for fields in your dataclasses using validation_<field> methods. These methods will automatically be called during initialization.

@dataclass
class Address(BaseModel):
    street: str
    city: str
    zip_code: str

    def validation_zip_code(self):
        if not self.zip_code.isdigit() or len(self.zip_code) != 5:
            raise ValueError("Zip code must be a 5-digit number.")

Defining a gRPC Service

The Service class allows you to define gRPC services with various RPC types.

from transmutate.service import Service, RpcType
from typing import List

class TestMessage(BaseModel):
    name: str
    age: int
    email: str
    phone_numbers: List[str]

class AnotherMessage(BaseModel):
    status: str
    message: str

service = Service(
    name="TestService",
    types=[RpcType.UNARY, RpcType.SERVER_STREAMING],
    method_names=["GetInfo", "StreamInfo"],
    request_dataclass=TestMessage,
    response_dataclass=AnotherMessage
)

Proto File Generation

Use ProtoGenerator to automatically generate Proto files for services and messages.

from transmutate.proto_generator import ProtoGenerator

services = [
    Service(
        name="TestService",
        types=[RpcType.UNARY, RpcType.SERVER_STREAMING],
        method_names=["GetInfo", "StreamInfo"],
        request_dataclass=TestMessage,
        response_dataclass=AnotherMessage
    )
]

proto_generator = ProtoGenerator(service_name="TestService", services=services)
proto_generator.generate_proto()

Output Proto file will be saved in the specified directory:

syntax = "proto3";

package testservice;

service TestService {
  rpc GetInfo (TestMessage) returns (AnotherMessage);
  rpc StreamInfo (TestMessage) returns (stream AnotherMessage);
}

message TestMessage {
  string name = 1;
  int32 age = 2;
  string email = 3;
  repeated string phone_numbers = 4;
}

message AnotherMessage {
  string status = 1;
  string message = 2;
}

Testing

Transmutate includes a suite of unit tests to ensure functionality. You can run the tests using unittest or pytest.

# Using unittest
poetry run python -m unittest discover tests

# Using pytest
poetry run pytest tests

Contributing

Contributions to Transmutate are welcome! Please feel free to open issues or submit pull requests on the GitHub repository.

License

Transmutate is open-source software licensed under the MIT License.

Metadata

Release files for transmutate 0.2.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for transmutate 0.2.2
File Size Uploaded Provenance
transmutate-0.2.2.tar.gz 8.7 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for transmutate 0.2.2
File Interpreter ABI Platform
transmutate-0.2.2-py3-none-any.whl Python 3 none any Details

Total release size: 18.1 kB

Release files / transmutate-0.2.2.tar.gz

Download URL transmutate-0.2.2.tar.gz
Size 8.7 kB
Tags Source
SHA-256 checksum
How to use checksums
74d32b2a8adfa2cfaa69bbaca4af8627a7929e9322e8d117e450f9755cc68962
BLAKE2b-256 checksum
How to use checksums
a7f66c3ee48fb86b25a9b74c8eeaf2db0e84425a0e6a037a8df3aa51b2e04bc2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.7.1 CPython/3.10.12 Linux/5.15.153.1-microsoft-standard-WSL2

Release files / transmutate-0.2.2-py3-none-any.whl

Download URL transmutate-0.2.2-py3-none-any.whl
Size 9.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
43c9138ef040b7b5b9fe9af1ff766ba3a2a256755281fb40a726ad30400b4fd9
BLAKE2b-256 checksum
How to use checksums
3720d66708034f6cddca44638b83cb9e58906e375461f268966faf5782cef780
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.7.1 CPython/3.10.12 Linux/5.15.153.1-microsoft-standard-WSL2

Security for transmutate 0.2.2

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page