Skip to main content

a framework for specifying and executing mappings between data models

Project description

linkml-map

Pyversions PyPi codecov

LinkML Map is a framework for specifying and executing declarative mappings between data models. At its core is the TransformationSpecification — a YAML-based language for describing how to map one data model to another, independent of serialization format or execution engine.

Features:

  • YAML-based lightweight transformation syntax
  • Python library for executing mappings on data files
  • Tabular data support (TSV/CSV) with streaming for large datasets
  • Experimental SQL compilation backend (DuckDB) for set-based transforms
  • Derivation of target (implicit) schemas, allowing easy customization of data models (profiling)
  • Simple YAML dictionaries for simple mappings
  • Automatic unit conversion
  • Use of subset of Python to specify complex mappings
  • Visualizations of mappings
  • Mappings are reversible (provided all expressions used are reversible)
  • Multiple output formats (YAML, JSON, JSONL, TSV, CSV)

For full documentation see linkml.io/linkml-map/.

Status:

The transformation data model is not yet fully stable, and may be subject to change. Not all parts of the model are implemented in the reference Python framework.

Quickstart

Install:

pip install linkml-map
# or, in a uv-managed project: uv add linkml-map

When using uv, prefix CLI invocations with uv run (e.g. uv run linkml-map --help).

Run the included example (the example files live in this repo):

git clone https://github.com/linkml/linkml-map.git
cd linkml-map/tests/input/examples/personinfo_basic
linkml-map map-data --unrestricted-eval \
  -T transform/personinfo-to-agent.transform.yaml \
  -s source/personinfo.yaml \
  data/Container-001.yaml

See the Quick Start guide for the expected output and next steps.

More

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

linkml_map-0.5.3rc1.tar.gz (551.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

linkml_map-0.5.3rc1-py3-none-any.whl (131.2 kB view details)

Uploaded Python 3

File details

Details for the file linkml_map-0.5.3rc1.tar.gz.

File metadata

  • Download URL: linkml_map-0.5.3rc1.tar.gz
  • Upload date:
  • Size: 551.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for linkml_map-0.5.3rc1.tar.gz
Algorithm Hash digest
SHA256 58fe8f82058884c5052d1c2f68e515d4f60c08840a2719417b06a1a1844fa554
MD5 e80bd72ce9e7af78cc9c739085dcf741
BLAKE2b-256 18f13de10694a1196befe2feaae8a560198533970643ccfa67af95ff9a9a933e

See more details on using hashes here.

Provenance

The following attestation bundles were made for linkml_map-0.5.3rc1.tar.gz:

Publisher: pypi-publish.yaml on linkml/linkml-map

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file linkml_map-0.5.3rc1-py3-none-any.whl.

File metadata

  • Download URL: linkml_map-0.5.3rc1-py3-none-any.whl
  • Upload date:
  • Size: 131.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for linkml_map-0.5.3rc1-py3-none-any.whl
Algorithm Hash digest
SHA256 6b51fa6a7c905978fa62b783cca3760826db302d15698fda4c470499c84c5755
MD5 a1b0958604e62602c426a8bbbfadde63
BLAKE2b-256 4c356abfb0ab688bc53ca5ca337385d0dcf426366e55da0a344c5ab24aaf35bf

See more details on using hashes here.

Provenance

The following attestation bundles were made for linkml_map-0.5.3rc1-py3-none-any.whl:

Publisher: pypi-publish.yaml on linkml/linkml-map

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page