mitm-tooling 0.8.2

No project description provided

mitm-tooling

This python package contains basic functionality to work with "Models-in-the-Middle" (MitM) data sets. It bundles a generic mechanism to load and export relational data as a configurable MitM.

Package Structure

• mitm_tooling/data_types: Defines the basic attribute data types supported in MitMs.
• mitm_tooling/definition: Contains MitM definitions. Currently, only MAED is supported.
• mitm_tooling/extraction/sql: Functionality for mapping and (virtually) transforming relational databases. This is used by the maed[/mitm]-exporter-backend.
• mitm_tooling/representation: Defines different representations of MitM data. From the proposed zipped format to dataframes and a relational DB representation.
  • /sql: Defines the relational representation along with utilities for inserting any (mapped) MitM data, by essentially executing a (streamable) ETL pipeline.
• mitm_tooling/transformation: Functionality for converting different representations into each other. Also contains
  • /superset: Functionality for generating superset-importable definitions, particularly programmatically defined dynamic dashboards. This is used by the superset-mitm-service.
• mitm_tooling/utilities: Some utility functions.

Extension Points

1. Adding new MitMs via a .yaml definition.
2. Adding transformation capabilities to/from other formats.
3. Adding new model-specific visualization creators (e.g., mitm_tooling/transformation/superset/visualizations/maed/dashboards.py)