Integrated computer-aided forensic case analysis, presentation, and documentation based on multimodal 3D data

Alexander Bornik, Martin Urschler, Dieter Schmalstieg, Horst Bischof, Astrid Krauskopf, Thorsten Schwark, Eva Scheurer, Kathrin Yen

Research output: Contribution to journalArticle

Abstract

Three-dimensional (3D) crime scene documentation using 3D scanners and medical imaging modalities like computed tomography (CT) and magnetic resonance imaging (MRI) are increasingly applied in forensic casework. Together with digital photography, these modalities enable comprehensive and non-invasive recording of forensically relevant information regarding injuries/pathologies inside the body and on its surface. Furthermore, it is possible to capture traces and items at crime scenes. Such digitally secured evidence has the potential to similarly increase case understanding by forensic experts and non-experts in court. Unlike photographs and 3D surface models, images from CT and MRI are not self-explanatory. Their interpretation and understanding requires radiological knowledge. Findings in tomography data must not only be revealed, but should also be jointly studied with all the 2D and 3D data available in order to clarify spatial interrelations and to optimally exploit the data at hand. This is technically challenging due to the heterogeneous data representations including volumetric data, polygonal 3D models, and images. This paper presents a novel computer-aided forensic toolbox providing tools to support the analysis, documentation, annotation, and illustration of forensic cases using heterogeneous digital data. Conjoint visualization of data from different modalities in their native form and efficient tools to visually extract and emphasize findings help experts to reveal unrecognized correlations and thereby enhance their case understanding. Moreover, the 3D case illustrations created for case analysis represent an efficient means to convey the insights gained from case analysis to forensic non-experts involved in court proceedings like jurists and laymen. The capability of the presented approach in the context of case analysis, its potential to speed up legal procedures and to ultimately enhance legal certainty is demonstrated by introducing a number of representative forensic cases.

LanguageEnglish
Pages12-24
Number of pages13
JournalForensic science international
Volume287
DOIs
StatusPublished - Jun 2018

Fingerprint

Documentation
Tomography
Crime
Magnetic Resonance Imaging
Photography
Diagnostic Imaging
Hand
Pathology
Wounds and Injuries

Fields of Expertise

  • Information, Communication & Computing

Cooperations

  • BioTechMed-Graz

Cite this

Integrated computer-aided forensic case analysis, presentation, and documentation based on multimodal 3D data. / Bornik, Alexander; Urschler, Martin; Schmalstieg, Dieter; Bischof, Horst; Krauskopf, Astrid; Schwark, Thorsten; Scheurer, Eva; Yen, Kathrin.

In: Forensic science international, Vol. 287, 06.2018, p. 12-24.

Research output: Contribution to journalArticle

Bornik, Alexander ; Urschler, Martin ; Schmalstieg, Dieter ; Bischof, Horst ; Krauskopf, Astrid ; Schwark, Thorsten ; Scheurer, Eva ; Yen, Kathrin. / Integrated computer-aided forensic case analysis, presentation, and documentation based on multimodal 3D data. In: Forensic science international. 2018 ; Vol. 287. pp. 12-24
@article{7928af12a1fd4880b81f35dd45fe84e5,
title = "Integrated computer-aided forensic case analysis, presentation, and documentation based on multimodal 3D data",
abstract = "Three-dimensional (3D) crime scene documentation using 3D scanners and medical imaging modalities like computed tomography (CT) and magnetic resonance imaging (MRI) are increasingly applied in forensic casework. Together with digital photography, these modalities enable comprehensive and non-invasive recording of forensically relevant information regarding injuries/pathologies inside the body and on its surface. Furthermore, it is possible to capture traces and items at crime scenes. Such digitally secured evidence has the potential to similarly increase case understanding by forensic experts and non-experts in court. Unlike photographs and 3D surface models, images from CT and MRI are not self-explanatory. Their interpretation and understanding requires radiological knowledge. Findings in tomography data must not only be revealed, but should also be jointly studied with all the 2D and 3D data available in order to clarify spatial interrelations and to optimally exploit the data at hand. This is technically challenging due to the heterogeneous data representations including volumetric data, polygonal 3D models, and images. This paper presents a novel computer-aided forensic toolbox providing tools to support the analysis, documentation, annotation, and illustration of forensic cases using heterogeneous digital data. Conjoint visualization of data from different modalities in their native form and efficient tools to visually extract and emphasize findings help experts to reveal unrecognized correlations and thereby enhance their case understanding. Moreover, the 3D case illustrations created for case analysis represent an efficient means to convey the insights gained from case analysis to forensic non-experts involved in court proceedings like jurists and laymen. The capability of the presented approach in the context of case analysis, its potential to speed up legal procedures and to ultimately enhance legal certainty is demonstrated by introducing a number of representative forensic cases.",
author = "Alexander Bornik and Martin Urschler and Dieter Schmalstieg and Horst Bischof and Astrid Krauskopf and Thorsten Schwark and Eva Scheurer and Kathrin Yen",
note = "Copyright {\circledC} 2018 The Author(s). Published by Elsevier B.V. All rights reserved.",
year = "2018",
month = "6",
doi = "10.1016/j.forsciint.2018.03.031",
language = "English",
volume = "287",
pages = "12--24",
journal = "Forensic science international",
issn = "0379-0738",
publisher = "Elsevier Ireland Ltd",

}

TY - JOUR

T1 - Integrated computer-aided forensic case analysis, presentation, and documentation based on multimodal 3D data

AU - Bornik,Alexander

AU - Urschler,Martin

AU - Schmalstieg,Dieter

AU - Bischof,Horst

AU - Krauskopf,Astrid

AU - Schwark,Thorsten

AU - Scheurer,Eva

AU - Yen,Kathrin

N1 - Copyright © 2018 The Author(s). Published by Elsevier B.V. All rights reserved.

PY - 2018/6

Y1 - 2018/6

N2 - Three-dimensional (3D) crime scene documentation using 3D scanners and medical imaging modalities like computed tomography (CT) and magnetic resonance imaging (MRI) are increasingly applied in forensic casework. Together with digital photography, these modalities enable comprehensive and non-invasive recording of forensically relevant information regarding injuries/pathologies inside the body and on its surface. Furthermore, it is possible to capture traces and items at crime scenes. Such digitally secured evidence has the potential to similarly increase case understanding by forensic experts and non-experts in court. Unlike photographs and 3D surface models, images from CT and MRI are not self-explanatory. Their interpretation and understanding requires radiological knowledge. Findings in tomography data must not only be revealed, but should also be jointly studied with all the 2D and 3D data available in order to clarify spatial interrelations and to optimally exploit the data at hand. This is technically challenging due to the heterogeneous data representations including volumetric data, polygonal 3D models, and images. This paper presents a novel computer-aided forensic toolbox providing tools to support the analysis, documentation, annotation, and illustration of forensic cases using heterogeneous digital data. Conjoint visualization of data from different modalities in their native form and efficient tools to visually extract and emphasize findings help experts to reveal unrecognized correlations and thereby enhance their case understanding. Moreover, the 3D case illustrations created for case analysis represent an efficient means to convey the insights gained from case analysis to forensic non-experts involved in court proceedings like jurists and laymen. The capability of the presented approach in the context of case analysis, its potential to speed up legal procedures and to ultimately enhance legal certainty is demonstrated by introducing a number of representative forensic cases.

AB - Three-dimensional (3D) crime scene documentation using 3D scanners and medical imaging modalities like computed tomography (CT) and magnetic resonance imaging (MRI) are increasingly applied in forensic casework. Together with digital photography, these modalities enable comprehensive and non-invasive recording of forensically relevant information regarding injuries/pathologies inside the body and on its surface. Furthermore, it is possible to capture traces and items at crime scenes. Such digitally secured evidence has the potential to similarly increase case understanding by forensic experts and non-experts in court. Unlike photographs and 3D surface models, images from CT and MRI are not self-explanatory. Their interpretation and understanding requires radiological knowledge. Findings in tomography data must not only be revealed, but should also be jointly studied with all the 2D and 3D data available in order to clarify spatial interrelations and to optimally exploit the data at hand. This is technically challenging due to the heterogeneous data representations including volumetric data, polygonal 3D models, and images. This paper presents a novel computer-aided forensic toolbox providing tools to support the analysis, documentation, annotation, and illustration of forensic cases using heterogeneous digital data. Conjoint visualization of data from different modalities in their native form and efficient tools to visually extract and emphasize findings help experts to reveal unrecognized correlations and thereby enhance their case understanding. Moreover, the 3D case illustrations created for case analysis represent an efficient means to convey the insights gained from case analysis to forensic non-experts involved in court proceedings like jurists and laymen. The capability of the presented approach in the context of case analysis, its potential to speed up legal procedures and to ultimately enhance legal certainty is demonstrated by introducing a number of representative forensic cases.

U2 - 10.1016/j.forsciint.2018.03.031

DO - 10.1016/j.forsciint.2018.03.031

M3 - Article

VL - 287

SP - 12

EP - 24

JO - Forensic science international

T2 - Forensic science international

JF - Forensic science international

SN - 0379-0738

ER -