omega-prime 0.1.14

Omega-Prime: Data Model, Data Format and Python Library for Handling Ground Truth Traffic Data

Omega-Prime: Data Model, Data Format and Python Library for Handling Ground Truth Traffic Data

Data Model, Format and Python Library for ground truth data containing information on dynamic objects, map and environmental factors optimized for representing urban traffic. The repository contains:

Data Model and Sepcification

see ./docs/omega_prime_specification.md

• 🌍 Data Model: What signals exists and how these are defined.
• 🧾 Data Format Specification: How to exchange and store those signals.

Python Library

• 🔨 Create omega-prime files from many sources (see ./tutorial.ipynb):
  • ASAM OSI GroundTruth trace (e.g., output of esmini)
  • Table of moving object data (e.g., csv data)
  • ASAM OpenDRIVE map
  • LevelXData datasets through lxd-io
  • extend yourself by subclassing DatasetConverter
• 🗺️ Map Association: Associate Object Location with Lanes from OpenDRIVE or OSI Maps (see tutorial_locator.ipynb)
• 📺 Plotting of data: interative top view plots using altair
• ✅ Validation of data: check if your data conforms to the omega-prime specification (e.g., correct yaw) using pandera
• 📐 Interpolation of data: bring your data into a fixed frequency
• 📈 Metrics: compute interaction metrics like PET, TTC, THW (see tutorial_metrics.ipynb)
• 🚀 Fast Processing directly on DataFrames using polars, polars-st

The data model and format utilze ASAM OpenDRIVE and ASAM Open-Simulation-Interface GroundTruth messages. omega-prime sets requirements on presence and quality of ASAM OSI GroundTruth messages and ASAM OpenDRIVE files and defines a file format for the exchange and storage of these.

Omega-Prime is the successor of the OMEGAFormat. It has the benefit that its definition is directly based on the established standards ASAM OSI and ASAM OpenDRIVE and carries over the data quality requirements and the data tooling from OMEGAFormat. Therefore, it should be easier to incorporate omega-prime into existing workflows and tooling.

To learn more about the example data read example_files/README.md. Example data was taken and created from esmini.

Installation

pip install omega-prime

Usage

A detailed introduction to the features and usage can be found in tutorial.ipynb

Create an omega-prime file from an OSI GroundTruth message trace and an OpenDRIVE map:

import omega_prime

r = omega_prime.Recording.from_file('example_files/pedestrian.osi', xodr_path='example_files/fabriksgatan.xodr')
r.to_mcap('example.mcap')

If you want to create an OSI trace on your own in python, check out the python library betterosi.

Read and plot an omega-prime file:

r = omega_prime.Recording.from_file('example.mcap')
ax = r.plot()

Convert Existing Datasets to omega-prime

LevelXData

You can convert data from LevelXData to omega-prime. Under the hood lxd-io is used to perform the conversion.

from omega_prime.converters import LxdConverter
converter = LxdConverter('./exiD-dataset-v2.0', './exiD-as-omega-prime', n_workers=4)
# convert the dataset and store the omega-prime files in the new directory
converter.convert()
# access Recordings directly without storing them
iterator_of_recordings = converter.yield_recordings()

or with omega-prime from-lxd ./exiD-dataset-v2.0 ./exiD-as-omega-prime --n-workers=4.

Tested with exiD-v2.0 and inD-v1.1

File Format

Based on MCAP, ASAM OSI and ASAM OpenDRIVE the ASAM OSI GroundTruth messages and ASAM OpenDRIVE map are packaged as shown in the following figure.

Acknowledgements

This package is developed as part of the SYNERGIES project.

Funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or European Climate, Infrastructure and Environment Executive Agency (CINEA). Neither the European Union nor the granting authority can be held responsible for them.