ASAM QSQ - Quantifying Simulation Quality
Ideation workshop
on: Sep 11, 2025 | 14:00 - 17:00 CEST
at: Hybrid | on-site: ASAM e.V., Hoehenkirchen (near Munich), Germany
Motivation
Trust in virtual Homologation relies not only on the transparency of the Simulation process, but also on the quality of the underlying models, frameworks, and related tools. While several initiatives and research projects, such as prostep IVIP, INTACS, SetLEVEL, EVIDENT, and HAIViSH, have advanced the discussion on credibility, there remains a critical gap: no standardized metrics exist to assess the quality of Simulation frameworks and models, particularly in sensor Simulation. Vehicle dynamics models are a rare exception, with established quality criteria documented. At the same time, the market for Simulation solutions in ADAS/AD development is broad and diverse, making it difficult for users to identify the right tools for their needs or compare them objectively. This proposal aims to close that gap by defining a standardized, machine-readable data format for describing tool offerings and requirements, supported by an agreed set of quality metrics.
Goal
The goal of this workshop is to start the discussion on a new standardized, machine-readable data format for storing and exchanging quality metrics for Simulation frameworks and models. The scope also includes defining an agreed, use-case–specific weighting of the respective metrics to emphasize features relevant to particular tasks.
The discussion shall include:
Identification or definition of a taxonomy
Generalized and scope-specific metrics definitions for Simulation frameworks and models
Exemplary KPIs for frameworks and models
A proof of concept (PoC) to validate the applicability of the proposed Standard
The project shall also address how compliance with existing standards of ASAM and other organizations (e.g. Modelica) contribute to quality of Simulation frameworks and models. A key aspect will be the exchangeability of data, libraries, and other assets between tools.
Read full proposal
Register
