Toward harmonizing prospective effectiveness assessment for road safety: Comparing tools in standard tools in standard scenario simulation

Peter Wimmer, Michael Düring, Henri Chajmowicz, Fredrik Granum, Julian King, Harald Kolk, Olaf Op den Camp, Paolo Scognamiglio, Michael Wagner

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Objective:With the overall goal to harmonize prospective effectiveness assessment of activesafety systems, the specific objective of this study is to identify and evaluate sources of variationin virtual precrash simulations and to suggest topics for harmonization resulting in increasedcomparability and thus trustworthiness of virtual simulation-based prospective effective-ness assessment.Methods:A round-robin assessment of the effectiveness of advanced driver assistance systemswas performed using an array of state-of-the-art virtual simulation tools on a set of standard testcases. The results were analyzed to examine reasons for deviations in order to identify and assessaspects that need to be harmonized and standardized. Deviations between results calculated byindependent engineering teams using their own tools should be minimized if the research ques-tion is precisely formulated regarding input data, models, and postprocessing steps.Results:Two groups of sources of variations were identified; one group (mostly related to theimplementation of the system under test) can be eliminated by using a more accurately formu-lated research question, whereas the other group highlights further harmonization needs becauseit addresses specific differences in simulation tool setups. Time-to-collision calculations, vehicledynamics, especially braking behavior, and hit-point position specification were found to be themain sources of variation.Conclusions:The study identified variations that can arise from the use of different simulation set-ups in assessment of the effectiveness of active safety systems. The research presented is a first ofits kind and provides significant input to the overall goal of harmonization by identifying specificitems for standardization. Future activities aim at further specification of methods for prospectiveassessments of the effectiveness of active safety, which will enhance comparability and trust-worthiness in this kind of studies and thus contribute to increased traffic safety.
Original languageEnglish
Pages (from-to)S139-S145
JournalTraffic injury prevention
Volume20
Issue numberS1
DOIs
Publication statusPublished - 2019

Fingerprint

road
scenario
Safety
harmonization
simulation
Active safety systems
Research
Specifications
Songbirds
Braking
Standardization
Data structures
Group
trustworthiness
traffic safety
assistance
driver
engineering

Cite this

Toward harmonizing prospective effectiveness assessment for road safety: Comparing tools in standard tools in standard scenario simulation. / Wimmer, Peter; Düring, Michael; Chajmowicz, Henri; Granum, Fredrik; King, Julian; Kolk, Harald; Op den Camp, Olaf; Scognamiglio, Paolo; Wagner, Michael.

In: Traffic injury prevention, Vol. 20, No. S1, 2019, p. S139-S145.

Research output: Contribution to journalArticleResearchpeer-review

Wimmer, Peter ; Düring, Michael ; Chajmowicz, Henri ; Granum, Fredrik ; King, Julian ; Kolk, Harald ; Op den Camp, Olaf ; Scognamiglio, Paolo ; Wagner, Michael. / Toward harmonizing prospective effectiveness assessment for road safety: Comparing tools in standard tools in standard scenario simulation. In: Traffic injury prevention. 2019 ; Vol. 20, No. S1. pp. S139-S145.
@article{d4da431238864f99b21729e37b76ffe5,
title = "Toward harmonizing prospective effectiveness assessment for road safety: Comparing tools in standard tools in standard scenario simulation",
abstract = "Objective:With the overall goal to harmonize prospective effectiveness assessment of activesafety systems, the specific objective of this study is to identify and evaluate sources of variationin virtual precrash simulations and to suggest topics for harmonization resulting in increasedcomparability and thus trustworthiness of virtual simulation-based prospective effective-ness assessment.Methods:A round-robin assessment of the effectiveness of advanced driver assistance systemswas performed using an array of state-of-the-art virtual simulation tools on a set of standard testcases. The results were analyzed to examine reasons for deviations in order to identify and assessaspects that need to be harmonized and standardized. Deviations between results calculated byindependent engineering teams using their own tools should be minimized if the research ques-tion is precisely formulated regarding input data, models, and postprocessing steps.Results:Two groups of sources of variations were identified; one group (mostly related to theimplementation of the system under test) can be eliminated by using a more accurately formu-lated research question, whereas the other group highlights further harmonization needs becauseit addresses specific differences in simulation tool setups. Time-to-collision calculations, vehicledynamics, especially braking behavior, and hit-point position specification were found to be themain sources of variation.Conclusions:The study identified variations that can arise from the use of different simulation set-ups in assessment of the effectiveness of active safety systems. The research presented is a first ofits kind and provides significant input to the overall goal of harmonization by identifying specificitems for standardization. Future activities aim at further specification of methods for prospectiveassessments of the effectiveness of active safety, which will enhance comparability and trust-worthiness in this kind of studies and thus contribute to increased traffic safety.",
author = "Peter Wimmer and Michael D{\"u}ring and Henri Chajmowicz and Fredrik Granum and Julian King and Harald Kolk and {Op den Camp}, Olaf and Paolo Scognamiglio and Michael Wagner",
note = "doi: 10.1080/15389588.2019.1616086",
year = "2019",
doi = "10.1080/15389588.2019.1616086",
language = "English",
volume = "20",
pages = "S139--S145",
journal = "Traffic injury prevention",
issn = "1538-9588",
publisher = "Taylor & Francis Group",
number = "S1",

}

TY - JOUR

T1 - Toward harmonizing prospective effectiveness assessment for road safety: Comparing tools in standard tools in standard scenario simulation

AU - Wimmer, Peter

AU - Düring, Michael

AU - Chajmowicz, Henri

AU - Granum, Fredrik

AU - King, Julian

AU - Kolk, Harald

AU - Op den Camp, Olaf

AU - Scognamiglio, Paolo

AU - Wagner, Michael

N1 - doi: 10.1080/15389588.2019.1616086

PY - 2019

Y1 - 2019

N2 - Objective:With the overall goal to harmonize prospective effectiveness assessment of activesafety systems, the specific objective of this study is to identify and evaluate sources of variationin virtual precrash simulations and to suggest topics for harmonization resulting in increasedcomparability and thus trustworthiness of virtual simulation-based prospective effective-ness assessment.Methods:A round-robin assessment of the effectiveness of advanced driver assistance systemswas performed using an array of state-of-the-art virtual simulation tools on a set of standard testcases. The results were analyzed to examine reasons for deviations in order to identify and assessaspects that need to be harmonized and standardized. Deviations between results calculated byindependent engineering teams using their own tools should be minimized if the research ques-tion is precisely formulated regarding input data, models, and postprocessing steps.Results:Two groups of sources of variations were identified; one group (mostly related to theimplementation of the system under test) can be eliminated by using a more accurately formu-lated research question, whereas the other group highlights further harmonization needs becauseit addresses specific differences in simulation tool setups. Time-to-collision calculations, vehicledynamics, especially braking behavior, and hit-point position specification were found to be themain sources of variation.Conclusions:The study identified variations that can arise from the use of different simulation set-ups in assessment of the effectiveness of active safety systems. The research presented is a first ofits kind and provides significant input to the overall goal of harmonization by identifying specificitems for standardization. Future activities aim at further specification of methods for prospectiveassessments of the effectiveness of active safety, which will enhance comparability and trust-worthiness in this kind of studies and thus contribute to increased traffic safety.

AB - Objective:With the overall goal to harmonize prospective effectiveness assessment of activesafety systems, the specific objective of this study is to identify and evaluate sources of variationin virtual precrash simulations and to suggest topics for harmonization resulting in increasedcomparability and thus trustworthiness of virtual simulation-based prospective effective-ness assessment.Methods:A round-robin assessment of the effectiveness of advanced driver assistance systemswas performed using an array of state-of-the-art virtual simulation tools on a set of standard testcases. The results were analyzed to examine reasons for deviations in order to identify and assessaspects that need to be harmonized and standardized. Deviations between results calculated byindependent engineering teams using their own tools should be minimized if the research ques-tion is precisely formulated regarding input data, models, and postprocessing steps.Results:Two groups of sources of variations were identified; one group (mostly related to theimplementation of the system under test) can be eliminated by using a more accurately formu-lated research question, whereas the other group highlights further harmonization needs becauseit addresses specific differences in simulation tool setups. Time-to-collision calculations, vehicledynamics, especially braking behavior, and hit-point position specification were found to be themain sources of variation.Conclusions:The study identified variations that can arise from the use of different simulation set-ups in assessment of the effectiveness of active safety systems. The research presented is a first ofits kind and provides significant input to the overall goal of harmonization by identifying specificitems for standardization. Future activities aim at further specification of methods for prospectiveassessments of the effectiveness of active safety, which will enhance comparability and trust-worthiness in this kind of studies and thus contribute to increased traffic safety.

U2 - 10.1080/15389588.2019.1616086

DO - 10.1080/15389588.2019.1616086

M3 - Article

VL - 20

SP - S139-S145

JO - Traffic injury prevention

JF - Traffic injury prevention

SN - 1538-9588

IS - S1

ER -