Skip to main content

convclasses

https://img.shields.io/github/workflow/status/zeburek/convclasses/Test%20package/master https://badge.fury.io/py/convclasses.svg https://img.shields.io/pypi/dm/convclasses.svg https://img.shields.io/pypi/l/convclasses.svg https://img.shields.io/pypi/pyversions/convclasses.svg https://readthedocs.org/projects/convclasses/badge/?version=stable

convclasses is an open source Python library for structuring and unstructuring data. convclasses works best with dataclasses classes and the usual Python collections, but other kinds of classes are supported by manually registering converters.

Python has a rich set of powerful, easy to use, built-in data types like dictionaries, lists and tuples. These data types are also the lingua franca of most data serialization libraries, for formats like json, msgpack, yaml or toml.

Data types like this, and mappings like dict s in particular, represent unstructured data. Your data is, in all likelihood, structured: not all combinations of field names are values are valid inputs to your programs. In Python, structured data is better represented with classes and enumerations. dataclasses is an excellent library for declaratively describing the structure of your data, and validating it.

When you’re handed unstructured data (by your network, file system, database…), convclasses helps to convert this data into structured data. When you have to convert your structured data into data types other libraries can handle, convclasses turns your classes and enumerations into dictionaries, integers and strings.

Here’s a simple taste. The list containing a float, an int and a string gets converted into a tuple of three ints.

>>> import convclasses
>>> from typing import Tuple
>>>
>>> convclasses.structure([1.0, 2, "3"], Tuple[int, int, int])
(1, 2, 3)

convclasses works well with dataclasses classes out of the box.

>>> import convclasses
>>> from dataclasses import dataclass
>>> from typing import Any
>>> @dataclass(frozen=True)  # It works with normal classes too.
... class C:
...     a: Any
...     b: Any
...
>>> instance = C(1, 'a')
>>> convclasses.unstructure(instance)
{'a': 1, 'b': 'a'}
>>> convclasses.structure({'a': 1, 'b': 'a'}, C)
C(a=1, b='a')

Here’s a much more complex example, involving dataclasses classes with type metadata.

>>> from enum import unique, Enum
>>> from typing import Any, List, Optional, Sequence, Union
>>> from convclasses import structure, unstructure
>>> from dataclasses import dataclass
>>>
>>> @unique
... class CatBreed(Enum):
...     SIAMESE = "siamese"
...     MAINE_COON = "maine_coon"
...     SACRED_BIRMAN = "birman"
...
>>> @dataclass
... class Cat:
...     breed: CatBreed
...     names: Sequence[str]
...
>>> @dataclass
... class DogMicrochip:
...     chip_id: Any
...     time_chipped: float
...
>>> @dataclass
... class Dog:
...     cuteness: int
...     chip: Optional[DogMicrochip]
...
>>> p = unstructure([Dog(cuteness=1, chip=DogMicrochip(chip_id=1, time_chipped=10.0)),
...                  Cat(breed=CatBreed.MAINE_COON, names=('Fluffly', 'Fluffer'))])
...
>>> print(p)
[{'cuteness': 1, 'chip': {'chip_id': 1, 'time_chipped': 10.0}}, {'breed': 'maine_coon', 'names': ('Fluffly', 'Fluffer')}]
>>> print(structure(p, List[Union[Dog, Cat]]))
[Dog(cuteness=1, chip=DogMicrochip(chip_id=1, time_chipped=10.0)), Cat(breed=<CatBreed.MAINE_COON: 'maine_coon'>, names=['Fluffly', 'Fluffer'])]

Consider unstructured data a low-level representation that needs to be converted to structured data to be handled, and use structure. When you’re done, unstructure the data to its unstructured form and pass it along to another library or module. Use dataclasses type metadata to add type metadata to attributes, so convclasses will know how to structure and destructure them.

Features

  • Converts structured data into unstructured data, recursively:

    • dataclasses classes are converted into dictionaries in a way similar to dataclasses.asdict, or into tuples in a way similar to dataclasses.astuple.

    • Enumeration instances are converted to their values.

    • Other types are let through without conversion. This includes types such as integers, dictionaries, lists and instances of non-dataclasses classes.

    • Custom converters for any type can be registered using register_unstructure_hook.

  • Converts unstructured data into structured data, recursively, according to your specification given as a type. The following types are supported:

    • typing.Optional[T].

    • typing.List[T], typing.MutableSequence[T], typing.Sequence[T] (converts to a list).

    • typing.Tuple (both variants, Tuple[T, ...] and Tuple[X, Y, Z]).

    • typing.MutableSet[T], typing.Set[T] (converts to a set).

    • typing.FrozenSet[T] (converts to a frozenset).

    • typing.Dict[K, V], typing.MutableMapping[K, V], typing.Mapping[K, V] (converts to a dict).

    • dataclasses classes with simple attributes and the usual __init__.

      • Simple attributes are attributes that can be assigned unstructured data, like numbers, strings, and collections of unstructured data.

    • All dataclasses classes with the usual __init__, if their complex attributes have type metadata.

    • typing.Union s of supported dataclasses classes, given that all of the classes have a unique field.

    • typing.Union s of anything, given that you provide a disambiguation function for it.

    • Custom converters for any type can be registered using register_structure_hook.

Credits

Major credits and best wishes for the original creator of this concept - Tinche, he developed cattrs which this project is fork of.

Major credits to Hynek Schlawack for creating attrs and its predecessor, characteristic.

convclasses is tested with Hypothesis, by David R. MacIver.

convclasses is benchmarked using perf, by Victor Stinner.

History

2.0.0

  • Add support for modifiers
    • Add dataclass field name modifier

  • Add support for generic types (ported from cattrs)

1.1.0

  • Removed Python 3.6 support

  • Added Python 3.9 support

1.0.0

  • Rename cattrs into conclasses

  • Move convclasses from attrs usage onto dataclasses

  • Fix incorrect structuring/unstructuring of private fields

  • Change pendulum in docs onto arrow

cattrs history

0.9.1 (2019-10-26)

  • Python 3.8 support.

0.9.0 (2018-07-22)

  • Python 3.7 support.

0.8.1 (2018-06-19)

  • The disambiguation function generator now supports unions of attrs classes and NoneType.

0.8.0 (2018-04-14)

  • Distribution fix.

0.7.0 (2018-04-12)

  • Removed the undocumented Converter.unstruct_strat property setter.

  • Removed the ability to set the Converter.structure_attrs instance field. As an alternative, create a new Converter:

>>> converter = cattr.Converter(unstruct_strat=cattr.UnstructureStrategy.AS_TUPLE)
  • Some micro-optimizations were applied; a structure(unstructure(obj)) roundtrip is now up to 2 times faster.

0.6.0 (2017-12-25)

  • Packaging fixes. (#17)

0.5.0 (2017-12-11)

  • structure/unstructure now supports using functions as well as classes for deciding the appropriate function.

  • added Converter.register_structure_hook_func, to register a function instead of a class for determining handler func.

  • added Converter.register_unstructure_hook_func, to register a function instead of a class for determining handler func.

  • vendored typing is no longer needed, nor provided.

  • Attributes with default values can now be structured if they are missing in the input. (#15)

  • Optional attributes can no longer be structured if they are missing in the input.

In other words, this no longer works:

@attr.s
class A:
    a: Optional[int] = attr.ib()

>>> cattr.structure({}, A)
  • cattr.typed removed since the functionality is now present in attrs itself. Replace instances of cattr.typed(type) with attr.ib(type=type).

0.4.0 (2017-07-17)

  • Converter.loads is now Converter.structure, and Converter.dumps is now Converter.unstructure.

  • Python 2.7 is supported.

  • Moved cattr.typing to cattr.vendor.typing to support different vendored versions of typing.py for Python 2 and Python 3.

  • Type metadata can be added to attrs classes using cattr.typed.

0.3.0 (2017-03-18)

  • Python 3.4 is no longer supported.

  • Introduced cattr.typing for use with Python versions 3.5.2 and 3.6.0.

  • Minor changes to work with newer versions of typing.

    • Bare Optionals are not supported any more (use Optional[Any]).

  • Attempting to load unrecognized classes will result in a ValueError, and a helpful message to register a loads hook.

  • Loading attrs classes is now documented.

  • The global converter is now documented.

  • cattr.loads_attrs_fromtuple and cattr.loads_attrs_fromdict are now exposed.

0.2.0 (2016-10-02)

  • Tests and documentation.

0.1.0 (2016-08-13)

  • First release on PyPI.

Metadata

Release files for convclasses 2.0.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for convclasses 2.0.0
File Size Uploaded Provenance Actions
convclasses-2.0.0.tar.gz 33.2 kB Without provenance Details for convclasses-2.0.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for convclasses 2.0.0
File Interpreter ABI Platform Actions
convclasses-2.0.0-py2.py3-none-any.whl Python 3, Python 2 none any Details for convclasses-2.0.0-py2.py3-none-any.whl

Total release size: 49.6 kB

Release files / convclasses-2.0.0.tar.gz

Download URL convclasses-2.0.0.tar.gz
Size 33.2 kB
Tags Source
SHA-256 checksum
How to use checksums
3284e214e32536a68f7e916cb22b74d842cd2c3e9696eab52ada72ff85ad9245
BLAKE2b-256 checksum
How to use checksums
94b67d27bd15ff23da59b9d4a680eea48158d5b762daaf891798abfdaaabb243
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.7.9

Release files / convclasses-2.0.0-py2.py3-none-any.whl

Download URL convclasses-2.0.0-py2.py3-none-any.whl
Size 16.5 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
8a2bfd35f19d3a3f7eb62426f42fe839bf454ba8a7ee729f640a0258d685f711
BLAKE2b-256 checksum
How to use checksums
df271cee7c07018e3219ad5533006afda30f514a1cb3e50cf02e8c91f98bfb6d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.7.9

Security for convclasses 2.0.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page