Serialize with type annotations
Project description
type-serialize
Serialize with type annotations
Features
- Supported in Python 3.8 and later.
- Serialize classes without additional code.
- Custom classes
- @dataclas
- NamedTuple
- Enum
- (Experimental) numpy.ndarray
- Deserialization using type annotations.
- Compress serialization results: bz2, gzip, lzma, zlib
- No dependencies
Overview
To pass a custom object to the json.dumps and json.loads functions, there is the following method.
- Expand json.JSONEncoder and json.JSONDecoder.
- Convert to built-in Python object supported by json.JSONEncoder and json.JSONDecoder.
Both methods require additional code and have some problems.
- Problem of not checking symbols when manipulating strings.
- When adding/deleting/editing a property, all related codes must be changed together.
- Painful typecasting (as the biggest problem).
As a way to hide these problems with a library and use serialization and deserialization, I chose type annotations. (Although the library is complicated; haha...) There are some additional advantages to using this.
- Static type checking using mypy.
- Autocomplete in IDE like PyCharm.
Things to know
- All public fields are serialized.
- Methods are not serialized.
- Private fields that start with an underscore (
_
) are not serialized. - Members specified with the
@property
decorator are not serialized. - When deserializing, all fields must be type-annotated.
- A value of
None
is ignored by the serialization target.
Installation
pip install type-serialize
If you want to add numpy, orjson, msgpack support:
pip install type-serialize[full]
Usage
Serializable python object
from dataclasses import dataclass
from type_serialize import deserialize, serialize
@dataclass
class Sample:
field1: str
field2: int
data = Sample(field1="a", field2=100)
obj = serialize(data)
assert isinstance(obj, dict)
assert obj["field1"] == "a"
assert obj["field2"] == 100
print(obj)
result = deserialize(obj, Sample)
assert isinstance(result, Sample)
assert data == result
print(result)
JSON dumps/loads
from dataclasses import dataclass
from type_serialize.json import dumps, loads
@dataclass
class Sample:
field1: str
field2: int
data = Sample(field1="a", field2=100)
json_data = dumps(data)
print(json_data)
result = loads(json_data, Sample)
print(result)
MsgPack dumps/loads
from dataclasses import dataclass
from type_serialize.msgpack import dumps, loads
@dataclass
class Sample:
field1: str
field2: int
data = Sample(field1="a", field2=100)
json_data = dumps(data)
print(json_data)
result = loads(json_data, Sample)
print(result)
Binary encode/decode
from dataclasses import dataclass
from datetime import datetime
from typing import Any, List, Optional
from type_serialize import decode, encode
@dataclass
class Sample:
field1: str
field2: Optional[str] = None
field3: Optional[List[int]] = None
field4: Optional[Any] = None
field5: Optional[datetime] = None
data = Sample(
field1="a",
field3=[0, 1, 2],
field4={"k": 100},
field5=datetime.now(),
)
raw = encode(data)
assert isinstance(raw, bytes)
assert len(raw) > 0
print(raw)
result = decode(raw, Sample)
assert isinstance(result, Sample)
assert data == result
print(result)
The encoding format can be adjusted with the coding
argument.
from type_serialize import ByteCodingType, decode, encode
data = ...
print(encode(data, coding=ByteCodingType.MsgpackGzip))
orjson support
If orjson is installed, it is automatically detected and used.
To turn off this option, set the TYPE_SERIALIZE_DISABLE_ORJSON_INSTALL
environment variable to 1
.
License
See the LICENSE file for details. In summary, tbag is licensed under the MIT license.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Hashes for type_serialize-1.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 887366404fed56a9a23c5f5c526f6f2f47b7bbd69d274ae0fe7c64a6d090afdb |
|
MD5 | 9b5af76d082ef5f89edec0c3ee63df25 |
|
BLAKE2b-256 | 0f78290c914a268c9f2d1268221bfc15572efd83eba5990629e6c70c771b12e4 |